Archive for the ‘Grid’ Category

Is now the time for Collections in the Cloud?

Thursday, September 22nd, 2011

I want you to imagine a scenario with me. Picture your museum. Now imagine it with no servers, no in-house IT team, no Collections data onsite at all. Imagine that all of the software you use to manage your Collections is accessible through your browser, with your data held in a secure, stable server farm somewhere far, far away.

How do you feel?

The idea of applying the principles of Cloud Computing and Software as a Service (SaaS) to Collections Management is not new. Indeed, in some ways it is much older than most people think - harking back as it does to the very early days of using remote terminals to access processing power provided centrally on a mainframe. Back in the early 1980’s, museums all over Europe would ship their hard-copy record cards to the MDA Computing Bureau to be transcibed into electronic records, again, making use of the economies of centralised computing power.

Fast forward 30 years, and the scale, complexity and richness of electronic recording of information about museum artefacts have expanded exponentially. Documentation and cataloguing are a global business, supported by a thriving community of highly specialised software applications and standards such as SPECTRUM.

The prevailing model of computing in museums is (as it is in most other types of enterprise) to have a number of relatively highly-powered machines connected to a Local Area Network which acts both as a conduit to the Internet, a firewall, a communications layer and a shared filestore. Until relatively recently, most Collections Management Systems were engineered to operate in this environment - either installed across the network or on a dedicated internal server. 

This model had its advantages. A LAN could include multiple physical locations, enabling, for example, curators onsite and conservators in offsite stores to interact with a common dataset. It empowered the museum to run its own kit, and to establish policies for things like backup and disaster recovery. In essence, it put the information about the collections inside the same physical context as those collections.

But the networked-application model also has some profound drawbacks. It is inherently inefficient, requiring expensive user support and onsite technicians. It requires physical space appropriate to the operation of high-powered and energy-hungry machines. It places a barrier to the upgrade path for the software, requiring manual intervention, downtime and occasionally bespoke development. The knock-on effect of this is that innovations funded by one user of the software are seldom cascaded automatically across the entire user community (or where they are, the time-delay involved can be considerable).

Collections Management Software as a Service, in which Collections data is held on low-cost, scalable offsite storage and manipulated using browser-based interfaces, appears to hold the solution to many of these issues.

It makes sense from the developers point of view - hugely reducing the complexity and therefore cost of maintaining 2000-3000 separate installations of their software. It provides a relatively painless path through which upgrades and new features can be cascaded out across the entire user-base of a given system. Not only this, but it offers a development path for new features and functionality - perhaps in the form of integration with tools for Digital Asset and Digital Rights Management, Workflow Management, Visualisation or Digital Preservation.

It also makes sense from a managers point of view - onsite IT infrastructure (and the skills to maintain it) can be very expensive. The space required for dedicated onsite kit can be given over to storage, administration or other hard-pressed functions. CMSaaS can be cheaper, offering the flexibility of subscription-based models which scale with the content and its uses, and in the process, offering a means of futureproofing against the evolution of the museum and its information management needs.

It makes sense, too, from a professional point of view. A community of clients using a common Cloud-based Collections Management System forms, almost by definition, a community of practice. It leads to the sharing of knowledge and expertise, to mutual support and other forms of collaboration. Not only this, but it naturally tends towards the principle of openness with museum datasets, encouraging the more proactive use of data through API and 3rd party applications and websites.

For all of these reasons, the majority of the leading Collections Management Systems have either already developed fully-hosted versions of their applications or are in the process of developing them. And business, it seems, is booming - at least partly in response to the strictures imposed on museums by funding cuts. Most vendors are reporting significant increases in the uptake of their Software as a Service offers, with some confidently predicting a full transition to Cloud-based, browser-based Collections Management within the next decade.

And yet there are many for whom the idea of Cloud-based Collections is unpalatable, to say the least. Some point to the inherent instability and insecurity of the Cloud as being too much of an operational risk to entrust their Collections data (which is intended to be the canonical and authoritative record of the Collection) to it. Others point to the fragility of their connection to the web - raising the prospect of downtime, lag or failure. Others point to the creativity and innovation which comes from having technologists, technology, curators and data under one roof. Others, too, suggest that this places them in a position of total dependency on their vendors and software providers, effectively rendering them hostage to the vendors charging model. It is also suggested that each and every installation of a Collections Management System represents a bespoke tool, specific to the needs of that museum and that SaaS would fail to deliver the kind of local configurability that museums and their Collections demand.

It is too early to say whether all of these concerns are equally valid. Certainly many museums run antiquated hardware and suffer from poor Internet connections - although people suffering with a bad PC should in theory benefit from the lighter processor load of using browser-based applications. Many are also governed under a Local Authority IT Policy which stipulates requirements that make CMSaaS all but impossible. It is also fair to say that many Browser-based applications are not quite as responsive as their locally-installed counterparts (although the gap is closing).

As to the risk inherent in Cloud storage, I suspect this may be based on an overestimation of the stability and security of locally-based physical media. After all, the data is still bits encoded on a spinning disk (or solid-state drive) whether it is under your stairs or sitting in racks in a data warehouse somewhere. I also suspect that the inexorable and inevitable rise of mainstream consumer-focussed applications which run in the Cloud will gradually help people to overcome this concern.

As to the creativity and innovation that comes from having museum technologists on the team - this has doubtless led to the flowering of ideas and applications, but it may simply not be sustainable in the face of the economic realities confronting museums in most countries worldwide. This is, of course, a gross simplification, but we may come to see a relatively small number of museums (outside of the larger institutions) that are able to maintain this kind of staffing and capital overhead. Many museum technologists - disaffected in some cases by the inability of the museum to enable them to deliver what they know they are capable of, have themsevles defected to commercial vendors and development houses.

In reality, we are unlikely to see a total transition to Collections Management in the Cloud anytime soon. This is a tremendously diverse sector, with a huge range of different types and scales of institution. There will always be those who need an installer and a locally-based application, for whom this is the simplest and most effective option. What I do think we’ll see, particularly over the next 4-5 year cycle, is two significant trends:

1. A significant swing in the medium-to-larger end of the museum community towards full-service online Collections Management Software and;

2. The emergence of more online tools with a very low barrier to entry (both in terms of cost and complexity) which are suited to the needs (and budgets) of smaller local and community museums.

Is it time for Collections in the Cloud? I’d love to know what you think!

Notes from European Member States Expert Group meeting

Tuesday, June 28th, 2011

The following notes are taken live at the European Commission’s Member States Expert Group meeting. Opinions expressed are the author’s own.

INTRODUCTION

The meeting was introduced by Mr Khalil Rouhana, Director of Directorate E (Digital Library Initiative) at the European Commission. (more…)

Language Matters

Sunday, June 26th, 2011

Recently, the Europeana Foundation ran a survey to find out whether people would be willing to sign their new Licence Agreements. It wasn’t a wholly straightforward question since, for the first time, the Agreements specifically included the ability for unknown 3rd parties to put the metadata contained in Europeana to commercial uses. Permitting commercial uses is vital if Europeana is to achieve its ambition of publishing metadata about Europeana digital cultural content as Linked Open Data, and of sharing it with partners such as Wikipedia. (more…)

We Are What We Do

Thursday, June 23rd, 2011

I was invited along to the offices of We Are What We Do the other day for a get-together to discuss the launch of HistoryPin.

For those of you that are unfamiliar with HistoryPin, it is essentially a web-based and mobile application which encourages young people and old people to ‘pin’ their photographs and the stories they tell to a map of the world. The web platform and iPhone app will be ‘launched’ (the web platform’s already been available for a while in a basic form) on the 11th July. (more…)

A New Way Forward for Museums

Tuesday, May 10th, 2011

I was asked recently to summarise the current UK situation for museums and the digital agenda for some overseas visitors. Here’s what I said: (more…)

Rising to the Challenge: Presentation to Bits to Blogs

Thursday, March 10th, 2011

My theme today is ‘rising to the Digital Challenge in Difficult Times’.

Many of you will know that this is one of my favourite themes - because I think that some aspects of the new Digital environment offer us an unprecedented opportunity to do something new. To become something new. To win a new place in the hearts and minds of a society that is disaffected with the politics and economics of short-termism and instant gratification. To establish a new contract with punters that is based on meaning and validity in a turbulent world. (more…)

Europeana in Scotland

Tuesday, December 14th, 2010

Attending today the Europeana Scotland event co-organised by the Collections Trust and Museums Galleries Scotland. The event is an opportunity for Scottish museums and other cultural institutions to find out what Europeana is, how it works and what it can do to help them get their Collections to a wider audience. (more…)

Guest Blog: UKOLN’s support services

Monday, October 26th, 2009

I’m delighted to introduce the first in a series of guest blogs from friends and colleagues who work with the sector to explore innovative uses of technology. Please welcome Marieke Guy, who blogs regularly for UKOLN.

Marieke is a research officer in the Community and Outreach Team at UKOLN, a centre of excellence in digital information management, based at the University of Bath. UKOLN provide advice and services to the library, information and cultural heritage communities. Marieke is a regular Twitterer (http://twitter.com/mariekeguy) and can be emailed using m.guy@ukoln.ac.uk.

(more…)

To Key or not to Key

Thursday, October 22nd, 2009

Some of you may be aware that the Collections Trust is mid-way through rolling out the Culture Grid, a new service which brings digital content produced by museums, archives and libraries to a mainstream audience via services like Google, Flickr, Wikipedia and the BBC.

More information about the Culture Grid - what it is and how it works - is online on the Collections Trust’s YouTube channel at:

http://www.youtube.com/user/CollectionsTrust

(more…)

Culture Grid Starts to Take Shape

Monday, April 27th, 2009

Things are (finally!) moving on the Culture Grid front. If you missed it in previous posts, ‘Culture Grid’ is the working title for the MLA-funded project to connect cultural data and the online mass-market, mopping up the last 10 years of legacy services on the way.

Stage 1 is to invest in the Peoples Network Discover Service platform so that it can handle a variety of different content formats, supported by API, SOAP and OAI harvest in and a variety of web services to get the content back out.

This investment began with the BBC CenturyShare project, which we’ve just signed off with the BBC and Knowledge Integration. CenturyShare runs on the PNDS infrastructure, and allowed us to develop towards a new more extensible version (v3.0!)

Stage 2 is to implement a managed withdrawal from the legacy services - Cornucopia, MICHAEL and the MLA Institution Server. This is tricky, because about 7 individual services depend on Cornucopia for backend infrastructure, not to mention the SSNConnect platform, which draws on Cornucopia data.

As part of this withdrawal, we’ll be harvesting these datasets into the PNDS/Culture Grid architecture, and doing some testing to make sure they’re nice and stable.

Stage 3 gets really interesting. We’ve got 3 dependent projects which will be putting data into the Grid and drawing it back out again via web services to develop web interfaces. The Peoples Record is a London 2012/Cultural Olympiad project which will use the Grid as backend infrastructure. The Grid will also power our contribution to the EuropeanaLocal prototype in September (the last staging post before full Europeana integration). Finally, we’ll be working to get the Grid content exposed to GoogleBase for indexing via Google.

Alongside all of this, we’ve got a whole lot of development going on. Naomi Korn is going to be working with us on the Rights framework (and we’ve got a discussion going on with DACS and the UK IPO to set up a licensing scheme to make it work). We’ve been talking about the Digital Preservation angle and thinking about setting up a long-term preservation strategy for all this metadata.

Then we’ll need to sort out sector address data so we can start running location-based services through the Grid. All of which while we’re running the parallel redevelopment of Collections Link. Oh yeah, and we’ve got to make a proposal for the use of Persistent Unique Identifiers under Europeana.

Don’t say we never tell you what we’re doing!