Guideline

Managing Web Resources for Persistent Access

The success of a distributed information system such as the World Wide Web (www) for research depends on the long-term consistency of the interlinking between online resources and the persistence of the links that are provided in the catalogues, indexes and listings that constitute resource discovery services.

Links between resources can range from casual links inserted in a document because it is possible to do so (e.g. a link to the site of an organisation because the name of that organisation is mentioned), to the formal citation of references, source documents, research results or to other related information that is an integral part of the resource. The category of link that represents formal citation is the most significant for the integrity of the intellectual heritage and it is especially important that these links continue to identify and provide access to the resources.

The persistence of links between resources and of links in resource discovery services is essential to ensure long-term public access to web-based materials. It is, therefore, an important aspect of the archiving and preservation strategies adopted for these resources. For information on how to manage web resources to assist later preservation action, see the companion document Safeguarding Australia’s Web Resources: Guidelines for Creators and Publishers

Creators, publishers, libraries and other information repositories all have a vital role to play in ensuring web-based information resources can be located and accessed for use in the current environment and into the future. These guidelines are intended to assist those responsible for the management of published online materials to make sure links made to those resources continue to work.

Why links fail to work

Broken links are very common on the web and most people will have come across an error message saying that the resource is no longer available.

Among the most common reasons why links on the web fail to work are:

Documents that 'disappear'

A document may be removed from a website for many different reasons, including:

When considering removing a document from a web site bear in mind that:

Documents that are moved

When considering moving documents around a site, bear in mind that:

Managing resources to ensure persistence of citation

The maintenance of links to resources on the web is essentially a task of good management. It involves planning ahead and taking deliberate steps to avoid the unnecessary removal or movement of documents on the site. The following guidelines will assist with developing a data policy for your site that should be used to manage resources for persistent access.

Determine document characteristics

Take a look at the types of document you have on your site, or on your organisation’s site, and see what categories they fall into. Resource categories which need persistent access include:

There will also be transient or temporary information, which can be removed.

The information which needs to be managed for persistent access will generally fall into two types:

Static resources include items which have a definitive version and will not be altered - e.g. a published policy document, an annual report, a conference paper - all of which reflect the point of time at which they were created.

Dynamic resources are materials that undergo change, either incremental change by addition of content or change by modification, deletion and insertion of content. They can be either 'archival' or ephemeral resources.

The 'archival' category includes material that you wish to preserve and provide persistent access to. The decision about what level of persistence of access to provide will be a matter of judgement and will depend on the nature of the material. An electronic journal that operates in an incremental fashion, for example, may require consistent access to both the 'home page' and to individual issues and articles for citation purposes; for a publication which may be modified by change, addition and deletion, you may wish to consider archiving and providing access to successive versions so that little information is lost and the evolving nature of the publication is documented.

The ephemeral category includes 'What’s new', 'What’s on', opening hours, contact information, lists of current publications, etc. These are not likely to be cited in other resources, but are frequently bookmarked for regular use and users want the latest version. Old versions are generally of no particular interest and this category needs persistence of citation only for the current version.

Once you have determined what categories and type of material you have, decide how you will ensure that citations to the material in the form of links remain active and enable the user following the link to access the resource.

Maintain active links

There are many ways to manage material so that citations remain active. They fall into three broad categories:

Use a persistent identifier system

Most resources currently on the World Wide Web are described using a Uniform Resource Locator (URL). The URL, as generally used, describes a resource in terms of its current location, i.e. it describes the domain name of the server, directory path and the document name of the resource.

The location-based nature of the URL is its major weakness for document naming, since the identifier will change if the material is moved either to a different server or a different place in the file structure of the same server. When this happens, all links to this resource embedded in other documents or databases will be broken.

A persistent identifier is a name for a resource which will remain the same regardless of where the document is located. Use of a persistent identifier will ensure that when a document is moved, or its ownership changes, the links to it will remain actionable.

It is important to note that a persistent identifier system will only be effective if it is maintained. When resources are moved, the current location must be associated with the persistent identifier in whatever system is chosen. This is usually achieved by a resolver database. There is no system which does not require such management.

Your choice strategies to achieve persistent identification will depend on your circumstances. Some options are:

Use redirects to guide users to the current location of the resource

As a minimum, the standard redirect capabilities of the web server can be used to redirect requests for resources using a persistent identifier to the actual location of the document or resource. This method is hard to manage on a large site and records of redirects in place need to be kept.

Use a resolver database

A resolver database can be used to map the name to a current location. Discuss this option with your web master or Internet Service Provider (ISP), as there may be other people who have material on the site who may also wish to use such a facility. One option for achieving this is to mount a Persistent Uniform Resource Locator (PURL) server on the site. The PURL server software is made available for downloading from Online Computer Library Centre's (OCLC) PURL site.

Use a persistent identifier service offered by another organisation

There are a number of other persistent identifier systems designed for use on the Internet. You may wish to investigate the use of one of these, such as: DOI (Digital Object Identifier) or a Handle system . OCLC offers a PURL service to organisations that do not wish to mount a PURL server on their own site. Users can register and apply online for a PURL and maintain their PURL(s) by updating the location of the resource online if it is moved.

Persistent identifier services and the National Library of Australia

The National Library of Australia is strongly committed to using and promoting persistent identifiers. For more information refer to Role of the National Library.

Organise the website to reduce the need to move material around

Even if a persistent identifier system is not used, a web site can be organised and managed to reduce the need to move material around.

Organisation of the site

The directory structure in a site can be structured and named in a way which reduces the likelihood of change being necessary. Consider the following guidelines:

Re-organising the web site

You do not have to reorganise the directory structure of a web site to revamp the site for a 'new look'. The navigation and presentation features of a web site are completely separate from the underlying organising structure of the site. The site can be given a totally new look by redesigning the graphics, presentation and navigation without moving any of the underlying files on which it is built.

Keep older material accessible

Older documents which have been superseded need not be removed from a web site just because they no longer reflect current policy, or because their factual content is dated, or simply because they are no longer 'flavour of the month'. Older content is valuable to researchers and policy developers and can be of interest to others. As stated earlier, there will be links to the documents from other sources which will be broken if the document is removed.

To keep older documents, you do not necessarily have to retain them on the main pages of the site. They can be:

Access through a logical archive

When documents are no longer presented on the main pages of a site, they can be made available through a logical archive. The documents themselves are not moved, but access to them is through some form of 'archive listing' on the site. Because they have not moved, the documents remain accessible via the links that have already been made to them in other resources.

Moving to a physical archive on the site

Documents may also be moved physically to a section of the site designated as an archive for management purposes and accessed via an archive listing or a search engine run over the archive. For long-term preservation, this is a safer way to proceed, since it simplifies the management process. If this method is chosen, a pointer or some other form of mapping will be needed to direct users to the new location.

Ideally, items would be identified for long-term preservation at the time of creation and would be located in such an archive when initially mounted on the server.

Lodging with an archival institution

If you cannot maintain access to the resources on your own site, then consider asking another body, such as a library or an archive, to take over management of the document for you. The National Library of Australia, National Archives of Australia, your local State library or archive or university library may be willing to preserve it if it is considered to be within the scope of their archiving policies. Again, if this is done, a pointer to the new location will need to be maintained.

If an older document is 'archived' using any of the above methods, you may wish to display a notice with the resource stating that it no longer represents current policy, or advising that the content has been superseded and directing the user to more up-to-date information.

For further information on ways to assist the preservation process for resources published on the web, see the companion document “Safeguarding Australia’s Web Resources: Guidelines for Creators and Publishers”

Role of the National Library

The National Library is responsible for collecting and providing long-term access to information resources that relate to Australia. This responsibility extends to published information in digital form. The Library has been archiving selected Australian online publications (individual documents, collections, e-journals and web pages) in its PANDORA Archive since 1996.

The Library is also digitising material in its Australiana collections for public access via its web site and is publishing information online. Persistent access is a major consideration for the Library in making these resources available. The Library has developed naming schemes for its digital resources, as well as a means of resolving persistent names to the locations of the resources. Approaches to offering a national persistent identifier service are now being considered and the Library would be interested in working with other organisations on this project.

Information about the Library's use of persistent identifiers is available at www.nla.gov.au/initiatives/persistence.html

Contact

For more information or assistance with any matter raised in these guidelines, please contact:

Director
Digital Archiving Branch
National Library of Australia
Canberra ACT 2600

Email: elecunit@nla.gov.au
Phone: 02 6262 1140
Fax: 02 6273 4322

November 2002

Top

About This Site | Copyright | Privacy | Accessibility | Site Map | Site Search | Content A-Z | Contact Us