Notes from 'User-Generated Content' session at MW2008

These are my notes from the User-generated content session at Museums and the Web, Montreal, 2008. All mistakes are mine, any corrections are welcome, my comments are in [square brackets] below.

The papers presented were The Art of Storytelling: Enriching Art Museum Exhibits and Education through visitor narratives by Matthew Fisher, Alexandra Sastre, Beth Twiss-Garrity; The Living Museum: Supporting the Creation of Quality User-Generated Content by Allison Farber, Paul Radensky and Getting 'In Your Face': Strategies for Encouraging Creativity, Engagement and Investment When the Museum is Offline by Martin Lajoie, Gillian McIntyre, Ian Rubenzahl, Colin Wiginton.

The "Art of Storytelling" project at the Delaware Art Museum.
The paper covered visitor-contributed content (VCC), the key factors to success, and the motivations behind allowing visitors to contribute. The paper goes into more of the theoretical foundations.

The key findings of the Art of Storytelling project evaluation:

What's the value to the visitor who contributes? It engages visitors in thinking critically and creatively about and in response to art.
What's the value to the museum? They get feedback and to engage new audiences
What's the value to the other visitors? There is some confusion, but also it can be inspiring, enriching, and encourage others to participate.

It's not appropriate or appealing for all collections, but it's hard to predict which in advance.

[When looking at models of participation:] Allow the motivated to contribute, allow the rest to benefit; don't penalise for non-participation.

Simplicity – remove barriers to entry (engage first, login last if at all).

Promote in traditional and non traditional venues; have a clear invitation to participate.

Motivating factors included curatorial encouragement (have curators there encouraging people), juried selections, stipends for selected storytellers.

What's in it for the audience? They get 15 minutes next to an Andy Warhol. Establish an audience for your visitor-contributors – affiliation with an institution is valued, even if comes with caveats. [Theirs is an art museum – does that work for all audiences, or for all types of content?]

Don't try and create communities beyond the your collections (because others with bigger budgets are after the same eyeballs).

They gave lots of examples from a summary of evaluation of other projects (but the slides were hard to see):
Isabella Stewart Gardner Museum in Boston – thinking through art. Active looking skills.
The Wolfsonian Institute in Miami – Artful Citizenship Project.
Guggenheim – Learning Through Art.
Aldrich Contemporary Art Museum – Round by Halsey Burgund.
Denver Art museum – Frederic Remington exhibit, Hamilton building programming.
Philadelphia area art museums; art, literacy, museums.

They then provided some background information about the Art of Storytelling at the Delaware Art Museum – story telling kiosks in the museum.

Their 'a-ha' moment was realising that the experience was more transformational for the original story tellers (i.e. the adults) than the audience. Transcend traditional ideas re lack of authority.

In conclusion, visitor-contributed content programs are valuable to the original contributors and museums get valuable insight into audiences, but it's an open question as to whether they're valuable for other visitors.

The Museum of Jewish Heritage, supporting the creation of quality user-generated content in the "Living Museum".
The project started as outreach project for Jewish communities without local museum.

The process: students visit a local museum, learn a bit about how museums are structured in terms of display of objects and organisation. The students choose an artefact to represent Jewish heritage at home, then write labels at school. They then organise artefacts into galleries, create gallery title and text panels, then create in-school and online exhibitions. Students research artefacts and tell their own stories. They include measurements because you can't get a sense of scale on the internet. One piece of text tells story of artefact and the other tells significance of artefact to family.

[They aren't promoting it until they feel the site is ready – a familiar story!]

They run seminars with teachers to help them submit quality content, but they still get objects unrelated to Jewish heritage, text with spelling and grammar errors, incomplete labels, unclear photos, factual errors.

The goals included: educational – a connection to Jewish heritage, parental involvements, museology, improve writing and research skills; institutional – high quality images so people can see what they're looking at; privacy of students; motivation of students.

Teachers say students are motivated to get stuff right because it's going online.

Unlike other user-generated content sites, the content is pre-reviewed, as the project has very specific educational goals. They control who creates content on the website (anyone can use but only teachers from Jewish schools can post content) and check that kids can't be identified. They are trying not to expose the kids and their personal stories to comment or modification by other users.

They are going to implement a spell checker.

How can they help users to contribute quality content? Convey expectations, consider needs of both kinds of users, offer support, concentrate on process and product of exhibition creation, review submitted content and offer recommendations.

"In Your Face", Art Gallery of Ontario
In Your Face: The People's Portrait Project.
While the Art Gallery of Ontario building was under construction, they were interested in rethinking the way the organisation worked, and how to keep people connected to the institution.

They got the idea from UK's National Portrait Gallery BP prize, but they didn't want a contest.

They advertised on back of the national paper for a few weeks as they had free space. They wrote a copyright statement that people had to sign, specified a size, and said they would hang every piece that came in. They received 17,000 portraits.

First they got lots of entries from rural areas, then the rest of Canada and the world. There was an extraordinary variety in portraits, and also in the parcels. They also arrived with stories.

It was a one way thing – people knew they weren't going to get the portraits back. It mattered to them to get them exhibited in the AGO.

There was more diversity in portraits and in the people who came to see them than usually seen in the gallery. People paid money to see the portraits as they were 'after the gate'. It was lots of work for staff on top of their normal job cos it turned out to be huge, but gave them (the staff) energy. It also made their audiences real for the staff and helped make the institution inclusive.

Contemporary artists from their collection also sent in portraits, but their names weren't shown so it was all egalitarian.

They also created a Flickr group (but weren't able to get that projected in the gallery). It now has 10,000 portraits in it.

They had a parallel project – Collection X. It was an online project where visitors could make their own exhibition. Collect, connect and create. 'Open source museum' [- the online paper goes into more detail, including the use of RSS.]

Partly [?] as a result of the project, guiding principles developed for institution include relevance, responsiveness, creativity, transparency, diversity and forum.

Questions asked:
How do you balance museum's agenda with visitor expectations? Is it possible to assert control and foster programming that is open-ended? How do we think about expertise, quality and standards? How do we integrate and manage creativity in ways that are dynamic and long-term? Is curatorial expertise or audience experience paramount? Some things curators are uneasy about. Dynamism also means some volatility – how does that work?

Lessons learned:
Take risks, experiment and be willing to make mistakes
Museums can function as catalysts for creativity [my emphasis, this was the meme that ran through the whole session, for me]
A critical mass of creativity asserts its own kind of aesthetic
There is value in integrating user-generated content that is actual as well as virtual
Museum and the public can function as producers and consumers of culture to create a shared sense of ownership
The public will be invested if programming is authentic and they feel respected.

Nielson on 'should your website have concise or in-depth content?'

Long pages with all the text, or shorter pages with links to extended texts – this question often comes up in discussions about our websites. It's the kind of question that can be difficult to answer by looking at the stats for existing sites because raw numbers mask all kinds of factors, and so far we haven't had the time or resources to explore this with our different audiences.

In Long vs. Short Articles as Content Strategy Jakob Nielsen says:

  • If you want many readers, focus on short and scannable content. This is a good strategy for advertising-driven sites or sites that sell impulse buys.
  • If you want people who really need a solution, focus on comprehensive coverage. This is a good strategy if you sell highly targeted solutions to complicated problems.

But the very best content strategy is one that mirrors the users' mixed diet. There's no reason to limit yourself to only one content type. It's possible to have short overviews for the majority of users and to supplement them with in-depth coverage and white papers for those few users who need to know more.

Of course, the two user types are often the same person — the one who's usually in a hurry, but is sometimes in thorough-research mode. In fact, our studies of B2B users show that business users often aren't very familiar with the complex products or services they're buying and need simple overviews to orient themselves before they begin more in-depth research.

Hypertext to the Rescue
On the Web, you can offer both short and long treatments within a single hyperspace. Start with overviews and short, simplified pages. Then link to long, in-depth coverage on other pages.

With this approach, you can serve both types of users (or the same user in different stages of the buying process).

The more value you offer users each minute they're on your site, the more likely they are to use your site and the longer they're likely to stay. This is why it's so important to optimize your content strategy for your users' needs.

So how do we adapt commercial models for a cultural heritage context? Could business-to-business users who start by familiarising or orienting themselves before beginning more in-depth research be analogous to the 'meaning making modes' for museum visitors – browsers and followers, searchers or researchers – identified by consultants Morris, Hargreaves, McIntyre?

Is a 'read more' link on shorter pages helpful or disruptive of the visitors' experience? Can the shorter text be written to suit browsers and followers and the 'read more' link crafted to tempt the searchers?

I wish I could give the answer in the next paragraph, but I don't know it myself.

Museums and Clayton's audience participation

A comment Seb left on Nate's blog post about "master" metadata got me thinking about cognitive dissonance and whether museums who say they're open to public participation and content really act as if they are. Are we providing a Clayton's call for audience participation?

If what you do – raise the barrier to participation so high that hardly anyone is going to bother commenting or tagging – speaks louder than what you say – 'sure, we'd love to hear what you have to say' – which one do you think wins?

To pick an example I've seen recently (and this is not meant to be a criticism of them or their team because I have no idea what the reasons were) the London Transport Museum have put 'all Museum objects and stories on display in the new Museum' on their collections website, which is fantastic. If you look at a collection item, the page says, "Share a story with us – comment on this image", which sounds really open and inviting.

But, if you want to comment, they ask for a lot of information about you first – check this random example.

So, ok. There are lots of possible reasons for this. UK museums have to deal with the Data Protection Act, which might complicate things, and their interpretation of the DPA might mean they ask for more information rather than less and add that scary tick box.

Or maybe they think the requirement to give this information won't deter their audience. I'd imagine that London Transport Museum's specialist audiences won't be put off by a registration form – some of their users are literally trainspotters and at risk of believing a stereotype, if they can bear the kind of weather that requires anoraks, they're probably not put off by a form.

Or maybe they're trying to control spam (though email addresses are no barrier to spam, and it's easy to use Akismet or moderation to trap spam); or maybe it's a halfway house between letting go and keeping control; or maybe they're tweaking the form in response to usage and will lower the barriers if they're not getting many comments.

Or maybe it's because the user-generated content captured this way goes directly into their collection management system and they want to record some idea of the provenance of the data. From a post to the UK Museums Computer Group list:

We have just launched the London Transport Online Museum. Users can view
every object, gallery and label text on display in our new museum in Covent Garden.

Following on from the current discussion thread we have incorporated into this new site, the facility for users to leave us memories / stories on all objects on display. Rather than a Wiki submission these stories are made directly on the website and will be fed back into our collection management system. These submissions can be viewed by all users as soon as they have passed through moderation process.

We will closely monitor how many responses we get and feedback to the group.

Please have a look, and maybe even leave us a memory?

[My emphasis in bold]

Moving on from the example of the London Transport Museum…

Whether the gap between their stated intentions and the apparent barriers to accepting user-generated content is the result of internal ambivalence about or resistance to user-generated content, concern about spam or 'bad data', or a belief that their specialist audiences will persist despite the barriers doesn't really make a difference; ultimately the intentionality matters less than the effect.

By raising the barrier to participation, aren't they ensuring that the casual audience remains exactly that – interested, but not fully engaged?

And as Seb pointed out, "Remembering that even tagging on the PHM collection – 15million views in 2007, 5 thousand tags . . . – and that is without requiring ANY form of login."

It also reminds me of what Peter Samis said at Museums and the Web in Montreal about engaging with museum visitors digitally: "We opened the door to let visitors in… then we left the room".

(If you're curious, the title is a reference to an Australian saying: Clayton's was "the drink you have when you're not having a drink", as as Wikipedia has it 'a compromise which satisfies no-one'. 'Ersatz' might be another word for it.)

Calling geeks in the UK with an interest in cultural heritage content/audiences

You might be interested in BathCamp – a bar camp in Bath on a Saturday (with overnight stay) in late August. This is an initial open call so head along to the website (BathCamp) and check it out. Ideally you would have an interest in cultural heritage content, audiences or applications, but we love the idea of getting fresh perspectives from a wide range of people so we don't expect that you would have worked with the cultural heritage sector (museums, galleries, libraries, archives, archaeology) before.

Questions from 'Beyond Single Repositories' at MW2008

I'm still working on getting my notes from Museums and the Web in Montreal online.

These are notes from the questions at the 'Beyond Single Repositories' session. This session was led by Ross Parry, and included the papers Learning from the People: Traditional Knowledge and Educational Standards by Daniel Elias and James Forrest and The Commons on Flickr: A Primer by George Oates.

This clashed with the User-Generated Content session that I felt I should see for work, but I managed to sneak in at the end of Ross's session. I expected this room to be packed, but it wasn't. I guess the ripples of user-generated content and Web 2.0-ish stuff are still spreading beyond the geeks, and the pebbles of single repositories and the semantic web have barely dropped into the pond for most people. As usual, all mistakes are mine – if you asked a question and I haven't named you or got your question wrong, drop me a line.

Quite a lot of the questions related to 'The Commons'.

There was a question about the difference between users who download and retain context of images, versus those who just download the image and lose all context, attribution, etc. George: Flickr considered putting the metadata into EXIF but it was problematic and wasn't robust enough to be useful.

Another question: how to link back to institution from Flickr? George: 'there's this great invention called the hyperlink'. And links can also go to picture libraries to buy prints.

[I need to check this but it could really help make the case for Commons in museums if that's the case. We might also be able to target different audiences with different requirements – e.g. commercial publications vs school assignments. I also need to check if Flickr URLs are permanent and stable.]

Seb Chan asked: how does business model of having images on Flickr co-exist with existing practices?

Flickr are cool with museums putting in content at different resolutions – it's up to institution to decide.

"It's so easy to do things the correct way" so please teach everyone to use CC licence stuff appropriately.

Issues are starting to be raised about revenue sharing models.

[I wonder if we could put in FOI requests to find out exactly how much revenue UK museums make from selling images compared to the overhead in servicing commercial picture libraries, and whether it varies by type of image or use. It'd be great if we could put some Museum of London/MoLAS images on Commons, particularly if we could use tagging to generate multilingual labels and re-assess images in terms of diversity – such an important issue for our London audiences; or to get more images/objects geo-located. I also wonder if there are any resourcing issues for moderation requirements, or do we just cope with whatever tags are added?]

Update: following the conference, Frankie Roberto started a discussion on the Museums Computer Group list under the subject 'copyright licensing and museums'. You have to be a member to post but a range of perspectives and expertise would really help move this discussion on.

Move your FAQ to Wikipedia?

Mal Booth from the Australian War Memorial (AWM) makes the fascinating suggestion: they should move their entire Encyclopaedia to Wikipedia. Their encyclopaedia seems to function as a fully researched and referenced FAQ with content creation driven by public enquiries, and would probably sit well in Wikipedia.

In Wikipedia and "produsers", Mal says:

"Putting the content up on Wikipedia.org gives it MUCH wider exposure than our website ever can and it therefore has the potential to bring new users to our website that may not even know we exist (via links in to our own web content). With a wikipedia.org user account, we can maintain an appropriate amount of control over the content (more than we have at present over wikipedia content that started as ours, already put up there by others).

Another point is that putting it up on Wikipedia allows us to engage the assistance of various volunteers who'd like to help us, but don't live locally."

He also presents some good suggestions from their web developer, Adam: they should understand and participate in the Wikipedia community, and identify themselves as AWM professionals before importing content. I think they've taken the first step by assessing the suitability of their content for Wikipedia.

It's also an interesting example of an organisation that is willing to 'let go' of their content and allow it to be used and edited outside their institution. Mal's blog is a real find (and I'm not just saying that because it has 'Melbin' (Melbourne) in the title), and I'll be following the progress of their project with interest.

I wonder how issues of trust and authority will play out on their entries: by linking to the relevant Wikipedia entries, the AWM is giving those entries a level of authority they might not otherwise have. They're also placing a great deal of trust in Wikipedia authors.

Mal links to a post by Alex Bruns, Beyond Public Service Broadcasting: Produsage at the ABC and summarises the four preconditions for good user-generated content:

  • the replacement of a hierarchy with a more open participatory structure;
  • recognising the power of the COMMUNITY to distinguish between constructive and destructive contributions;
  • allowing for random (granular, simple) acts of participation (like ratings); and
  • the development of shared rather than owned content that is able to be re-used, re-mixed or mashed up.

Adam's post lists key principles that anyone "looking to develop successful and sustainable participatory media environments" should take into account. These points are defined and expanded on in the original post, which is well worth reading:

  1. Open Participation, Communal Evaluation
  2. Fluid Heterarchy, Ad Hoc Meritocracy
  3. Unfinished Artefacts, Continuing Process
  4. Common Property, Individual Rewards

More on cultural heritage and resistance to the participatory web

I've realised that in my post on 'Resistance to the participatory web from within the cultural heritage sector?', I should have made it clear that I wasn't thinking specifically of people within my current organisation. I've been lucky enough to meet a range of people from different institutions at various events or conferences, and when I get a chance I keep up with various cultural heritage email discussion lists and blogs. One way or another I've been quietly observing discussions about the participatory web from a wide range of perspectives within the cultural heritage and IT sectors for some time.

Ok, that said, the responses have been interesting.

Thomas at Medical Museion said:

This are interesting observations, and I wonder: Can this resistance perhaps be understood in terms of an opposition among curators against a perceived profanation of the sacred character of the museum? In the same way as Wikipedia and other user-generated content websites have been viewed with skepticism from the side of many academics — not just because they may contain errors (which encyclopedia doesn’t?), but also because it is a preceived profanation of Academia. (For earlier posts about profanation of the museum as a sacred institution, see here and here.). Any ideas?

I'm still thinking about this. I guess I don't regard museums as sacred institutions, but then as I don't produce interpretative or collection-based content that could be challenged from outside the institution, I haven't had a vested interest in retaining or reinforcing authority.

Tom Goskar at Past Thinking provided an interesting example of the visibility and usefulness of user-generated content compared to official content and concluded:

People like to talk about ancient sites, they like to share their photos and experiences. These websites are all great examples of the vibrancy of feeling about our ancient past.

For me that's one of the great joys of working in the cultural heritage sector – nearly everyone I meet (which may be a biased sample) has some sense of connection to museums and the history they represent.

The growth of internet forums on every topic conceivable shows that people enjoy and/or find value in sharing their observations, opinions or information on a range of subjects, including cultural heritage objects or sites. Does cultural heritage elicit a particular response that is motivated by a sense of ownership, not necessarily of the objects themselves, but rather of the experience of, or access to, the objects?

It seems clear that we should try and hook into established spaces and existing conversations about our objects or collections, and perhaps create appropriate spaces to host those conversations if they aren't already happening. We could also consider participating in those conversations, whether as interested individuals or as representatives of our institutions.

However institutional involvement with and exposure to user-generated content could have quite different implications. It not only changes the context in which the content is assessed but it also lends a greater air of authority to the dialogues. This seems to be where some of the anxiety or resistance to the participatory web resides. Institutions or disciplines that have adapted to the idea of using new technologies like blogs or podcasts to disseminate information may baulk at the idea that they should actually read, let alone engage with any user-generated content created in response to their content or collections.

Alun wrote at Vidi:

Interesting thoughts on how Web 2.0 is or isn’t used. I think one issue is a question of marking authorship, which is why Flickr may be more acceptable than a Wiki.

I think that's a good observation. Sites like Amazon also effectively differentiate between official content from publishers/authors and user reviews (in addition to 'recommendation'-type content based on the viewing habits of other users).

Another difference between Flickr and a wiki is that the external user cannot edit the original content of the institutional author. User-generated content sites like the National Archives wiki can capture the valuable knowledge generated when external people access collections and archives, but when this user-generated content is intermingled with, and might edit or correct, 'official' content it may prove a difficult challenge for institutions.

The issue of whether (and how) museums respond to user-generated content, and how user-generated content could be evaluated and integrated with museum-generated content is still unresolved across the cultural heritage sector and may ultimately vary by institution or discipline.

BBC: "Aboriginal archive offers new DRM"

A new method of digital rights management (DRM) which relies on a user's profile has been pioneered by Aboriginal Australians.

The Mukurtu Wumpurrarni-kari Archive has been developed by a community based in Australia's Northern Territory.

It asks every person who logs in for their name, age, sex and standing within their community.

This information then restricts what they can search for in the archive, offering a new take on DRM

It's a fascinating example of how real world community practice can be translated into online viewing. As the article says, "[f]or example, men cannot view women's rituals, and people from one community cannot view material from another without first seeking permission. Meanwhile images of the deceased cannot be viewed by their families." This has been an issue for Australian museums in the past and it'll be interesting to see if this 'DRM' solution is adopted more widely.

BBC: Aboriginal archive offers new DRM