File formats
A file format is a 'particular way to encode information for storage in a computer file.' 1 A file extension generally indicates the format of a particular file. There are many types of file formats and many of them are proprietary. However, a growing awareness of the issues and difficulties related to proprietary formats especially within a digital preservation context has encouraged the development of open source (non-proprietary) file formats.
1. Wikipedia
Articles
| Books
| Events
| Organisations and Websites
| Online tutorial
| Policies, Strategies & Guidelines
| Projects and Case Studies
| Bibliographies
| Glossaries
| Journals & Newsletters
| Discussion Lists
| Surveys
| Tools
| Evaluations
- AONS II: Continuing the Trend Towards Preservation "software" nirvana
Pearson, David
(Date Created: Oct 2007)
(Australia)
- This paper presented at IPRES 2007, reports on the AONS II project undertaken by the National Library of Australia in conjunction with the Australian Partnership for Sustainable Repositories.The AONS software tool allows users to automatically monitor the status of file formats in their repositories and receive notification of obsolescence risks.
- http://ipres.las.ac.cn/pdf/David%20Pearson-AONS%20II_%20continuing%20t
he%20trend%20towards%20preservation%20software%20'Nirvana'%20-%20.pdf
- Screenshots of presentation and paper available from the the IPRES2007 website. http://ipres.las.ac.cn/
- AONS II: Continuing the Trend Towards Preservation Software 'Nirvana'
Pearson, David
In: iPRES2007 - Special issue
(Date Created: 25 Jan 2008)
(Australia)
- This paper was originally presented at iPRES 2007 in Beijing China. It reports on the AONS II project undertaken by the National Library of Australia in conjunction with the Australian Partnership for Sustainable Repositories. The AONS software tool allows users to automatically monitor the status of file formats in their repositories and receive notification of obsolescence risks.
- http://www.infotech.ac.cn/qikan/manage/wenzhang/2008-0229.pdf
- New Technology for Library and Information Service, iPres2007 Special Issue, Vol1, 25 Jan 2008.
- AONS System Documentation
Curtis, Joseph
(Date Created: 29 Sep 2006)
(Australia)
- This is a technical document on the the system documentation for AONS (Automatic Obsolescence Notification System). AONS is a software system that provides automatic notification of digital objects in a repository that may become obsolescent by using preservation information about the file formats. The document covers the architecture, registry and repository interface, AONS core and database structure.
- http://www.apsr.edu.au/publications/aons_report.pdf
-

Archival Data Format Requirements
Christensen, Steen S.
(Date Created: Jul 2004)
(Denmark)
- This document discusses the requirements of the Netarkivet in terms of both file formats and metadata. The document outlines the basic requirements for storage formats that can be used for long term preservation. Different storage formats are then evaluated in relation to Netarkivet specifications and a recommendation for a suitable long term storage format is made.
- http://netarkivet.dk/publikationer/Archival_format_requirements-2004.p
df
-

Attributes of File Formats for Long Term Preservation of Scientific and Engineering Data in Digital Libraries
Barkstrom, Bruce R.; Folk, Mike
(Date Created: 2002)
- This paper was produced as part of the Investigating Scientific Data Management Applications with Electronic Records Project sponsored by NARA (National Archives and Records Administration). The paper discusses the characteristics of file formats that can be advantageous in the preservation and storage of scentific and engineering data. File formats are discussed in the context of archival storage and access, usability, data integrity and maintainability and durability.
- http://www.ncsa.uiuc.edu/NARA/Sci_Formats_and_Archiving.doc
- Automatic Format Identification Using Pronom and DROID. Digital Preservation Technical Paper No. 1
Brown, Adrian
(Date Created: Oct 2005)
(United Kingdom)
- This technical paper describes DROID (Digital Record Object Identification), an open source software tool that performs automated identification of file formats.
- http://www.nationalarchives.gov.uk/aboutapps/fileformat/pdf/automatic_
format_identification.pdf
- Corporate Alzheimer's : Coping With Forgotten File Formats
Waters, John K.
(Date Created: 04 Apr 2006)
(United States of America)
- This brief article describes the latest developments in XML based 'open file' formats that claim to free documents from the restrictions of proprietary software for long term access.
- http://www.law.com/jsp/PubArticle.jsp?id=900005450719
- Evaluating File Formats for Long Term Preservation
Rog, Judith; van Wijk, Caroline
(Date Created: Feb 2008)
(Netherlands)
- This paper outlines the Koninklijke Biliotheek's recently developed file format risk assessment methodology for long term preservation. The paper discusses whether it is possible to obtain universal agreement on a methodology particularly with the added challenges of web archiving. The authors seek feedback from other institutions.
- http://www.kb.nl/hrd/dd/dd_links_en_publicaties/publicaties/KB_file_fo
rmat_evaluation_method_27022008.pdf
- JHOVE2 : a Next-Generation Architecture for Format-Aware Digital Object Preservation Formatting
Harvard University Library
(Last Updated: 01 Jun 2006)
(United States of America)
- The paper discusses the scope of the JHOVE2 (JSTOR/Harvard Object Validation Environment) project proposal. This project will seek to retain existing JHOVE functionality and refactor the existing architecture, support enhancements, increase the range of supported formats, and develop modules for supporting key preservation processes. Input from the JHOVE user community will be sought as part of the design phase. The proposal was submitted by Harvard University, Portico, and Stanford University to the Library of Congress under the National Digital Information Infrastructure Preservation Program (NDIIPP) initiative.
- http://hul.harvard.edu/jhove/JHOVE2-proposal.doc
-
Lossy or Lossless? File Compression Strategies Discussion at ALA
Dale, Robin
In: RLG DigiNews
(Date Created: 15 Feb 1999)
- This 'technical feature' summarises discussions which took place at the American Library Association midwinter meeting in Philadelphia about lossy versus lossless file compression techniques. Six practitioners: Carl Fleischhauer, Louis Sharpe, III, Howard Besser, Peter Hirtle, Joy Paulson and Steven Puglia give their opinions on factors which
affect the decision to use different compression techniques.
- http://digitalarchive.oclc.org/da/ViewObjectMain.jsp?fileid=0000070519
:000006287498&reqid=15167#technical1
- Preservation of TeX/LaTeX Documents
Barnes, Ian
(Date Created: 21 Jul 2006)
- TeX is a mathematical typesetting programme language and LaTeX is based on TeX. The report addresses the suitability of TeX/LaTeX as a preservation format. The author maintains that in the long term these documents should be converted to an XML format such as Doc Book XML with embedded MathML.
- http://www.apsr.edu.au/publications/LaTeX-preservation.pdf
- Tomorrow's File Endings : On Archiving Principles and Archiving Formats
Uneson, Marcus
(Date Created: 2005)
- This paper discusses general digital archiving principles, such using open standards and text based formats, particularly in regard to the archiving of scientific and scholarly publications. The efficacy of using various file formats in an archival setting are also discussed. These formats include pdf, pdf-a, tex/latex and xml.
- http://www.sciecom.org/sciecominfo/artiklar/uneson_05_02.shtml
Top
- File Formats for Preservation
10 - 11 May 2004
, Austrian National Library, Wien
(Austria)
- Includes links to presentations, evaluation reports, and further information from the Vienna Seminar.
- http://www.erpanet.org/events/2004/vienna/index.php
Top
Organisations and Websites
|
- File Formats Blog
McGath, Gary
(Regularly Updated)
- Gary McGath is a software Engineer at Harvard University Libraries. His blog features 'news and comments about technical issues relating to file formats, file validation, and archival software.'
- http://fileformats.blogspot.com/
Top
Policies, Strategies & Guidelines
|
- Digital Lifecycles And File Types : Final Report
Bates, Melanie; Loddington, Steve; Manuel, Sue; Oppenheim, Charles
(Date Created: May 2006)
- As part of the JISC funded Rights And Rewards In Blended Institutional Repositories Project, this report provides an overview of characteristics, advantages and disadvantages of various types of image and text file formats. It also includes information about managing the lifecycle of a digital item as well as standards and specifications concerning metadata (e.g. Dublin Core and METS). It discusses issues to consider when packaging content (e.g. for loading into a learning management system) and provides an overview of various content packaging tools. It concludes with an
introduction to reference models and frameworks used to describe processes managed by repositories and the systems in which they operate.
- http://hdl.handle.net/2134/1793
- Digital Preservation Guidance Note 1: Selecting File Formats for Long-Term Preservation
Brown, Adrian
(Last Updated: Apr 2008)
(United Kingdom)
- Produced by the Digital Preservation Department of the National Archives (UK) as part of its series of guidance notes on issues relating to the preservation of electronic records, this document focuses on the selection of file formats for long-term preservation. It describes various criteria that need to be considered when dealing with file format issues and selection. Version 2 was published in April 2008.
- http://www.nationalarchives.gov.uk/documents/selecting-file-formats.pd
f
- This document is the first in a series of guidance notes developed by the Digital Preservation Department, National Archives, UK. It is also available as an RTF document.
- Digital Preservation Guidance Note 4: Graphics File Formats
Brown, Adrian
(Date Created: 09 Jul 2003)
(United Kingdom)
- Produced by the Digital Preservation Department of the National Archives (UK) as part of its series of guidance notes on the preservation of electronic records, this document focuses on selecting file formats for use with images. It provides summary information about the most common graphics file formats in current use to help users to make informed decisions regarding the selection of most suitable files. The guidelines provided are limited to static images.
- http://www.nationalarchives.gov.uk/documents/graphic_file_formats.pdf
- This document is the fourth in a series of guidance notes developed by the Digital Preservation Department, National Archives, UK. It is also available as an RTF document.
- PDF Guidelines : Recommendations for the Creation of PDF Files for Long-term Preservation and Access
Rog, Judith
(Last Updated: 31 May 2007)
(Netherlands)
- This document provides the guidelines on the standards that pdf files deposited with the e-Depot should comply. The guidelines cover accessibility and structure, fonts, colour, compression, images and executable actions.
- http://www.kb.nl/hrd/dd/dd_links_en_publicaties/PDF_Guidelines.pdf
Top
Projects and Case Studies
|
- Alternative File Formats for Storing Master Images
Gillesse, Robert; Rog, Judith; Verheusen, Astrid
(Date Created: 7 Mar 2008)
(Netherlands)
- This in depth report (64 pages) describes a project undertaken by the Koninklijke Bibliotheek on possible alternative file formats for storing master images from mass digitisation projects. The KB currently stores uncompressed TIFFs. This report considers JPEG 2000, PNG, JPEG and TIFF LZW as alternatives. It describes each format and considers the consequences for required storage capacity, image quality, long term sustainability and functionality.
- http://www.kb.nl/hrd/dd/dd_links_en_publicaties/publicaties/Alternativ
e%20File%20Formats%20for%20Storing%20Masters%202%201.pdf
- Digital Lifecycles And File Types : Final Report
Bates, Melanie; Loddington, Steve; Manuel, Sue; Oppenheim, Charles
(Date Created: May 2006)
- As part of the JISC funded Rights And Rewards In Blended Institutional Repositories Project, this report provides an overview of characteristics, advantages and disadvantages of various types of image and text file formats. It also includes information about managing the lifecycle of a digital item as well as standards and specifications concerning metadata (e.g. Dublin Core and METS). It discusses issues to consider when packaging content (e.g. for loading into a learning management system) and provides an overview of various content packaging tools. It concludes with an
introduction to reference models and frameworks used to describe processes managed by repositories and the systems in which they operate.
- http://hdl.handle.net/2134/1793
- JHOVE2 : a Next-Generation Architecture for Format-Aware Digital Object Preservation Formatting
Harvard University Library
(Last Updated: 01 Jun 2006)
(United States of America)
- The paper discusses the scope of the JHOVE2 (JSTOR/Harvard Object Validation Environment) project proposal. This project will seek to retain existing JHOVE functionality and refactor the existing architecture, support enhancements, increase the range of supported formats, and develop modules for supporting key preservation processes. Input from the JHOVE user community will be sought as part of the design phase. The proposal was submitted by Harvard University, Portico, and Stanford University to the Library of Congress under the National Digital Information Infrastructure Preservation Program (NDIIPP) initiative.
- http://hul.harvard.edu/jhove/JHOVE2-proposal.doc
Top
- AONS II: Continuing the Trend Towards Preservation "software" nirvana
Pearson, David
(Date Created: Oct 2007)
(Australia)
- This paper presented at IPRES 2007, reports on the AONS II project undertaken by the National Library of Australia in conjunction with the Australian Partnership for Sustainable Repositories.The AONS software tool allows users to automatically monitor the status of file formats in their repositories and receive notification of obsolescence risks.
- http://ipres.las.ac.cn/pdf/David%20Pearson-AONS%20II_%20continuing%20t
he%20trend%20towards%20preservation%20software%20'Nirvana'%20-%20.pdf
- Screenshots of presentation and paper available from the the IPRES2007 website. http://ipres.las.ac.cn/
Top
- Preserving the Data Explosion: Using PDF
Fanning, Betsy A.
(Date Created: Apr 2008)
(United Kingdom; United States of America)
- This 27p. report reviews PDF and the newly introduced PDF/Archive (PDF/A) format as a potential solution for long-term digital preservation. It considers the use of PDF/A as part of a comprehensive records management program, to archive electronic documents as a standard to aid preservation and future retrieval.
- http://www.dpconline.org/docs/reports/dpctw08-02.pdf
- DPC Technology Watch Report 08-02
Top
Related Topics: Format registries | Format standards
Broader Topic:
Standards
NATIONAL LIBRARY OF AUSTRALIA, Canberra, ACT 2600, AUSTRALIA
Telephone + 61 2 6262 1111; Facsimile +61 2 6257 1703; Telephone Typewriter
Number: 1800 026 372
|