Oh noes, a FAIL! Notes from the unconference session on 'failure' at MW2009

These are my really rough notes from the unconference session at Museums and the Web, written up quickly in order to capture the essence of the discussion and open it up for comment.

Susan Chun, Dana Mitroff Silvers, Bruce Wyman and I began and were later joined by Seb Chan and Jennifer Trant.

I explained my motivation in suggesting the session – intelligent, constructive failure is important. Finding ways to create a space for that conversation isn't something we do well at the moment.

Susan started the conversation by pointing out that there were different definitions or types of failure. Defining 'failure' more precisely is useful.

Types of failures include: over budget, badly implemented, badly specified, future failures.

Dana pointed out that we needed to define success as well as defining failure. A more nuanced understanding of failure is important, especially when hoping to encourage more people to talk about failure. Discussion about choosing the right metrics for success – the right metrics may vary depending on whether you're a funder or a department or whoever.

Funding models can set you up for failure.

Bruce pointed out that it's not the failure that matters, it's what you do with the failure.

Some apparent failures may not really be failures.

Are you funding the process or the product?

Not having the mechanism for exposing the knowledge is a failure.

The definitions of failure and success need to include the net gain for an organisation or in new/improved processes as well as the product.

What kind of environment is needed so that people can publish judgements of their own success or failure?

Susan suggested the MCN project registry would be a good place for this information.

What if it was routine to talk about what failed or succeeded in each project? Funding should reward people who talk about failures. Discussion about space for reflection on 'lessons learned' in project summation.

Agency is important – you talk about the failures of your own projects, other people don't dob you in.

Dana – talking about failures in a project should be a normal part of MW papers.

Label it 'lessons learned', not 'failure'.

Susan – [Remove roadblocks about what happens if funders hear you think your project failed in some way -] Talk to funders about requiring an examination or reflection of each project for failure in the same way the issue of open source development was tackled. Pro-active approach!

Me: when you're putting in for funding, you should have to show that you've talked to people with similar projects about the lessons they learned.

Susan – put ILMS (Institute of Museum and Library Services) reports online. [A small but practical thing to do]. Change the culture of secrecy.

Funding can be a carrot and a stick. Without that, institutional change is hard.

Points of resistance (some summing up):
understanding how to define failure/success
culture of secrecy
fear of exposure to funders
lacking the jargon to describe failure (which would also help normalise the process of discussing it openly)

Jennifer – if there aren't any negative consequences, why can't you talk about it?

General discussion about the need for early, continual dialogue about projects. It's difficult to talk about failures if you're not already talking about the project. Paraphrasing Seb -talking about it already in an informal context, like a blog, may help here.

Iterative, transparent reporting is important. It also helps other people talk about failures.

Susan – other causes of failures are project that never happened. Whether they missed their time, didn't get funding, whatever. Consider those as failures too, and talk about them. Everyone benefits, whether that's the person with the great idea that never got to see it happen, or people who've built on it later.

Talk about nascent projects. Exposing them to comment early can help prevent failure. Like the old crack about voting, public discussion about projects should happen early and often!

Hoarding ideas is pointless.

We need a template for talking about failure. Prompts or questions for consideration.

It's not just overall project failures, it can include institutional, departmental or structural failures.

Dana suggested confessional sessions, perhaps at the next Museums and the Web conference. Jennifer and Seb took it up, suggesting YouTube captures with disguised voices and silhouettes to make it easier, and encouraging discussion of failures by type or theme.

Discussion about the role of commentators, respondents in sessions. The voice of the one that didn't work.

Find an acceptable form of critical questions so that people can help prevent other projects failing, make the most of the experience out there.

Putting my money where my mouth is, one final comment from Seb was about a possible failure of the unconference sessions in not getting people together again at the end to report back. This was received constructively, and might happen during the final plenary.

Clay Shirky at Smithsonian 2.0

Below are my notes from watching the video of Clay Shirky at the Smithsonian 2.0 event on YouTube. I figure they might be useful to someone, though I'm sure I missed interesting points, and I didn't take notes on bits that sounded like his talk in London a little while later.

[I've been thinking generally about the Smithsonian 2.0 event, and realised that it doesn't matter that from the outside, the outcomes weren't groundbreaking – a lot of what they were saying seemed self-evident, or least what is generally seen as The Right Thing to do in cultural heritage tech circles – the process was the important part.

It's not so much what they're saying, it's the fact they're having the conversation. Their institution made room, literal as well as metaphoric, for the conversation, and they (presumably) invited people from all over their organisations to participate in those conversations. It's the importance of the visibility of the project, the big name guests, the resources invested – that's the groundbreaking part.]

Anyway, onto the talk.   There were some good soundbits – for ten years we had 'new media capabilities but old media messages'. In the days of super-distribution, 'the critical moment for media isn't production, it's distribution'.

[This next paragraph (or 16'50" – 19' in the video) is transcribed a bit more closely as I wanted to quote it in an article]
'Look at what Flickr's done. They've reversed the usual pattern of interest groups. Usually it's 'let's get everybody who cares about High Dynamic Range photography in a room, and then we'll share what we know'. Gather, then share. On Flickr, the pattern is 'share, then gather'. The artifact itself has created the surface to which the people adhere. It's created the environment for the conversation. Every artifact is a latent community. Which is to say, every artifact, in addition to being interesting to the people who come to look at it, or read it or watch it or what have you, has additional potential value in that all the people who are looking at it might also be interested in talking to each other. You can imagine a hub and spoke system, where the artifact is at the hub… the group that assembled here didn't have to know in advance they cared about High Dynamic Range photography, all they had to know about was that they liked that picture. If you think of the artifact as a hub, and there are spokes leading into it, which are the people who care about it, you can draw the line now going in both directions, it's not just that the artifact goes outwards and people can view it, people can talk back. Everybody sort of gets that hub and spoke model.  What's really astonishing is the lateral lines, the lines you can draw among the spokes, because there are many more of those lines to be drawn than there are [of] the hub and spoke. So if every artifact is a latent community, much of social value comes from having these kinds of convening platforms available for people to start sharing value in communities of practice.'

The enormous cost of professionally managed artefacts… Library of Congress project on preserving digital artefacts… metadata in cataloguing system not about managing ideas, about managing artefacts. (Ontologies) force organisations to be mind readers and fortune tellers.

What could go wrong? People take digital assets, repurpose them. It's already happened.  [So it's ok.]  So if repurposing already happens, how do we get value out of it?

Fear of being expected to control everything with your name on it; society has internalised idea that you're not.  [So it's really ok.]  As well as the kinds of uses you don't have to expect, you get the kinds of uses you don't have to feel responsible for.

If taking tax dollars, should do something for the public. When implement new forms of sharing, it also changes the way things happen in the institution. It would be easier for a curator to find something from one of the Smithsonian museums because of the Commons.

Question – if it's good, will they always come? Ans: no. Qu: how do you deal with that? Ans: the effect of failure on an institution is likelihood times cost. Spend more time discussing whether something is a good idea than would have spent just trying it (yes!). It's easy digitally to fail fast, cheaply, easy to learn from failure.

If you want to have something spread to the public, try it a few different ways. Don't make one perfect system then assume it will pass on to the public, be propagated. Have a few different ways of trying things. On average, the stuff that interests people propagates; you can't treat it as a distributed media buy. Have an economic structure where you can afford prizes cos haven't put all eggs in one basket.

Question – following up on tagging on Flickr – reactions to when moustaches were being tagged – people felt it degraded the value of the content.  Ans: aggregate value of tag is high, create cross-cutting collection. But it's always possible to find the banal stuff. Objection is not that people are saying these things, it's that "we have to hear it now". Previously separated spheres of expert and public discourse…

Question – how do you measure value – two different ways of measuring it, how do you bring them together?  Ans: so many different kinds of value, no institution can create them all, but they can host them. So, how much is this costing us and is there any reason to stop it from happening?  (But was the qu about digitisation and other things with up-front costs?)

If you think value is only things that you buy and manage and control… being a platform increases value for and the loyalty of the people who go there.

Woohoo!

The results of JISC's dev8D 'developer happiness' prize have been announced – congratulations to List8D and their "web 2.0-friendly reading lists" – it's something I'd love to see in my own uni course.

And yay the Three Lazy Geeks, because we came second! That was a lovely surprise, and really the glace cherry on the icing of the cake because the whole event was a great experience, and I really enjoyed working with Ian and Pete, as rushed as the whole thing was.

Yay! Three Lazy Geeks shortlisted for dev8D prize

We're in the top five, whoop!

The reviewers said, "Really comprehensive treatment of the problem and associated issues. Worth pursuing I think… As a solution this is a good idea and was produced by genuine collaboration at the Dev8D event."

So a short but happy developer post from me. The whole experience was lots of fun, and it would never have worked without Ian Ibbotson and Pete Sefton. I think the thing that I like most about it is that it not only re-uses existing tools, it fits with how people already work. It's not "this application will change your life, but first you have to change your life". I know that the (mostly junior) academics I've mentioned it to have loved the idea, so it might have real users if it was developed, which would be lovely.

Tim Berners-Lee at TED on 'database hugging' and linked data

This TED talk by Tim Berners-Lee: The next Web of open, linked data is worth watching if you've been 'wondering whatever happened to the semantic web?', or what this 'linked data' is about all.

I've put some notes below – I was transcribing it for myself and thought I might as well share it. It's only a selection of the talk and I haven't tidied it because they're not my words to edit.

Why is linked data important?

Making the world run better by making this data available. If you know about some data in some government department you often find that, these people, they're very tempted to keep it, to hug your database, you don't want to let it go until you've made a beautiful website for it. … Who am I to say "don't make a website…" make a beautiful website, but first, give us the unadulterated data. Give us the raw data now.

You have no idea, the number of excuses people come up with to hang onto their data and not give it to you, even though you've paid for it.

Communicating science over the web… the people who are going to solve those are scientists, they have half-formed ideas in their head, but a lot of the state of knowledge of the human race at the moment is in database, currently not sharing. Alzheimer's scientists … the power of being able ask questions which bridge across different disciplines is really a complete sea-change, it's very, very important. Scientists are totally stymied at the moment, the power of the data that other scientists have collected is locked up, and we need to get it unlocked so we can tackle those huge problems. if I go on like this you'll think [all data from] huge institutions but it's not. [Social networking is data.]

Linked data is about people doing their bit to produce their bit, and it all connecting. That's how linked data works. … You do your bit, everybody else does theirs. You may not have much data yourself, to put on there, but you know to demand it.

It's not just about the number of places where data comes. It's about connecting it together. When you connect it together you get this power… out of it. It'll only really pay off when everybody else has done it. It's called Linked Data, I want you to make it, I want you to demand it.

Sophie Germain, a tech heroine

When I first heard about Ada Lovelace Day, I started thinking about who I'd write about. I figured the usual suspects like Grace Hopper were out, but that left the field wide open – there are so many cool women around in different fields.

Yet despite all the possibilities in times and fields closer to my own, I've ended up thinking about a woman who who died 178 years ago. Mathematician and physicist Marie-Sophie Germain has been described as "probably the most profoundly intellectual woman that France has ever produced".  I have long-since forgotten my high school maths and physics, but I was drawn to her stubbornness, her tenacity, her sheer need to keep learning. about.com says:

After discovering geometry, Sophie Germain taught herself mathematics, and also Latin and Greek so that she could read the classical mathematics texts. Her parents opposed her study and tried to stop it, so she studied at night. They took away candles and forbid nighttime fires, even taking her clothes away, all so that she could not read at night. Her response: she smuggled candles, she wrapped herself in her bedclothes. She still found ways to study.

She was eventually recognised by the French Academy of Sciences, though her history is full of poignant reminders of the difficulties she faced.  PBS says:

Although she made no further contributions to proving Fermat's Last Theorem, others were to build on her work. She had offered hope that those equations in which n equals a Germain prime could be tackled, however the remaining values of n remained intractable.

After Fermat, Germain embarked on an eventful career as a physicist, a discipline in which she would again excel only to be confronted by the prejudices of the establishment. Her most important contribution to the subject was "Memoir on the Vibrations of Elastic Plates," a brilliantly insightful paper which was to lay the foundations for the modern theory of elasticity.

From a different perspective:

Although it was Germain who first attempted to solve a difficult problem, when others of more training, ability and contact built upon her work, and elasticity became an important scientific topic, she was closed out. Women were simply not taken seriously. (MacTutor History of Mathematics)

I think this is the saddest of all – Britannica says, "[d]uring the 1820s she worked on generalizations of her research but, isolated from the academic community on account of her gender and thus largely unaware of new developments taking place in the theory of elasticity, she made little real progress."

It's sad, not just on a personal level – imagine having that brain, that drive to collaborate and create, and not being taken seriously because of your gender – but can you imagine how much further the field of mathematics or physics might have advanced if she'd been supported and allowed to participate fully in the scientific community?

I couldn't find any images of Sophie Germain that I could clearly re-use, so instead you could go check out the range of faces tagged womensday on the Flickr Commons site, many of whom are scientists or inventors themselves. If I knew more about them I'd look for candidates for Modern Bluestocking.

Ada Lovelace Day at the Science Museum

I'm really excited that we've managed to get some new pages and updated text about Ada Lovelace on the Science Museum website, and particularly that it's in time for Ada Lovelace Day.  On a personal note, I'm thrilled because 'women in technology' has long been an issue close to my heart.  I think role models are important and I don't know if you can get better than the woman often described as "the world’s first computer programmer". 

It's also exciting because it shows that with the right infrastructure, and institutional support, museums can move quickly (ish) and be responsive to current events.  It couldn't have happened without the support of the curatorial and marketing departments.

The Computing gallery in the Science Museum has some great objects – Babbage's Analytical Engine and the Difference Engine built by the Science Museum according to Babbage's original specifications (and half ofBabbage's brain in a jar).  There are also performances by the Ada Lovelace drama character on Tuesday, March 24, so pop in if you're in London.

Speaking of Ada Lovelace Day, I'd better get my ALD09 blog post written tonight!  If you're not sure who to write about I've posted about possible candidates under the label AdaLovelaceDay09.

Get thee to a wiki – the great API challenge in action

Help us work on an informal, lightweight way of devising shared data, API standards for museum and cultural heritage organisations – museum-api.pbwiki.com is open for business.

You could provide examples of APIs you've used or produced, share your experience as a consumer of web services, tell us about your collections.

Commenting on other people's queries and content is an easy way to get started.  I'd particularly love to hear from curators and collections managers – we should be working together to enable greater access to collections.  If you check it out and none of it makes any sense – be brave and say so!  We should be able to explain what we're doing clearly, or we're not doing it right.

Some background: as announced on the nascent museumdev blog, the Science Museum is looking at releasing an API soon – it'll be project-specific to start with, but we're creating it with the intention of using that as an iterative testing and learning process to design an API for wider use. We could re-invent the wheel, but we'd rather make it easy for people to use what they've learnt using other APIs and other museum collections – the easiest way to do that is to work with other museums and developers. The Science Museum's initial public-facing collections API will be used for a 'mashup competition' based on object metadata from our 'cosmos and culture' gallery.

Speaking of museumdev, I started it as somewhere where I could ask questions, point people to discussions, a home for collections of links and stuff in development.  It's also got random technical bits like 'Tip of the Day: saving web.config as Unicode' because I figure I might as well share my mistakes^H^H^H^H^H^H^H^H learning experiences in the hope that someone, somewhere, benefits.

'The 50 Most Important Women in Science'

More inspiration for Ada Lovelace Day 2009 from Discover magazine's 2002 list of The 50 Most Important Women in Science. Not everyone listed is directly involved with technology, but it's worth checking them out anyway, because as the article points out, '[i]f just one of these women had gotten fed up and quit—as many do—the history of science would have been impoverished':

Three percent of tenured professors of physics in this country are women. Nonetheless, a woman physicist stopped light in her lab at Harvard. Another woman runs the linear accelerator at Stanford. A woman discovered the first evidence for dark matter. A woman found the top quark. The list doesn't stop there, but the point is clear.

Three years ago, Discover started a project to look into the question of how women fare in science. We knew there were large numbers of female researchers doing remarkable work, and we asked associate editor Kathy A. Svitil to talk to them. The result of her investigation is a selection of 50 of the most extraordinary women across all the sciences. Their achievements are detailed in the pages that follow.

To read their stories is to understand how important it is that the barriers facing women in science be broken down as quickly and entirely as possible. If just one of these women had gotten fed up and quit—as many do—the history of science would have been impoverished. Even the women who have stuck with it, even those who have succeeded spectacularly, still report that being a woman in this intensely male world is, at best, challenging and, at worst, downright disheartening.

It will take goodwill and hard work to make science a good choice for a woman, but it is an effort at which we cannot afford to fail. The next Einstein or the next Pasteur may be alive right now—and she might be thinking it's not worth the hassle.

An easy candidate for Ada Lovelace Day – Barbara Liskov, winner of the 2008 Turing Award

How cool is she? ACM Turing Award Goes to Creator of Influential Innovations in Computer Software Design

NEW YORK, March 10, 2009 – ACM, the Association for Computing Machinery, has named Barbara Liskov of the Massachusetts Institute of Technology (MIT) the winner of the 2008 ACM A.M. Turing Award.  The award cites Liskov for her foundational innovations to designing and building the pervasive computer system designs that power daily life.  Her achievements in programming language design have made software more reliable and easier to maintain.  They are now the basis of every important programming language since 1975, including Ada, C++, Java, and C#.  The Turing Award, widely considered the "Nobel Prize in Computing," is named for the British mathematician Alan M. Turing.  The award carries a $250,000 prize, with financial support provided by Intel Corporation and Google Inc.

The first woman to be awarded a Ph.D. from a Computer Science department (in 1968 from Stanford University), Liskov revolutionized the programming field with groundbreaking research that underpins virtually every modern computer application for both consumers and businesses. Her contributions have led to fundamental changes in building the computer software programs that form the infrastructure of our information-based society. Her legacy has made software systems more accessible, reliable, and secure 24/7.