National Library of Australia - Home page
 

 

 

Format standards

Limit to: Document markup languages | JPEG

Articles | Books | Events | Organisations and Websites | Online tutorial | Policies, Strategies & Guidelines | Projects and Case Studies | Bibliographies | Glossaries | Journals & Newsletters | Discussion Lists | Surveys | Tools | Evaluations

Articles

Archive With Care
Rees, Peter (Date Created: Jun 2005)
This article covers the problems of a lack of open format standards from the perspective of the research data recorded in ELNs (Electronic Laboratory Notebooks), in particular their use by the pharmaceutical industry. Although formats like PDF/A can solve some problems, there is still reliance on proprietary file formats used in analytical instruments and other scientific software.
http://www.scientific-computing.com/features/feature.php?feature_id=40
Issue 82 (June 2005), Scientific Computing World
Historical Bits and Bites of Data Formats : Stainless Design for Digital Endurance
Aschenbrenner, Andreas In: RLG DigiNews (Date Created: Feb 2004)
This paper analyses the use of XML as a preservation format, particularly in those areas which may be problematic. The article discusses the ideal design criteria for the development data types and then concentrates on the shortcomings or concerns of XML in preserving data formats.
http://worldcat.org/arcviewer/1/OCC/2007/08/08/0000070511/viewer/file3
683.html#article2
Historical Conversion & Document Formats : Backfile Conversion and Format Issues for Information Stored in Digital Archives
Hewlett Packard; Romany, Nancy (Date Created: 2002)
AIMM Industry Whitepaper on Records, Document and Enterprise Content Management for the Public Sector. First ed.
ISBN: 3936534020
http://web.archive.org/web/20050720133806/http://h30046.www3.hp.com/up
loads/whitepapers/conversion_formats_wp.pdf
AIIM Industry Whitepaper vol. 2 . Archived by the Internet Archive
Corporate Alzheimer's : Coping With Forgotten File Formats
Waters, John K. (Date Created: 04 Apr 2006) (United States of America)
This brief article describes the latest developments in XML based 'open file' formats that claim to free documents from the restrictions of proprietary software for long term access.
http://www.law.com/jsp/PubArticle.jsp?id=900005450719
Safekept
Historical Digital Video Preservation Reformatting Project : a Report
Media Matters (Date Created: Jun 2004)
This report (88 p., 2MB) was undertaken on behalf of the Dance Heritage Coalition and funded by the Andrew W. Mellon Foundation. It is intended that the results of this research will be used as the basis of a nationally-accepted model, providing a technical foundation to those engaged in dance documentation and preservation, as well as others who use videotape to document their experiences and research. The report describes some of the problems with lossy compression compared to the viability of JPEG 2000 compression as a lossless alternative. Also discussed is the concept of 'file wrappers' by audiovisual digital media which combines video files, audio files, and metadata into a single, unified format. A chief goal of this report was to endorse a specific file format to use for the preservation of dance material. The report concludes by recommending the file format Material Exchange Format (MXF) container format. The report also recommends use of JPEG 2000 compression, as it serves preservation needs and is affordable to implement.
http://www.danceheritage.org/preservation/Digital_Video_Preservation_R
eport.doc
Historical Editors Interview: JPEG 2000
Lee, Daniel In: RLG DigiNews (Date Created: 15 Dec 2002)
An interview with Dr Daniel Lee, convenor of ISO's JPEG group, about JPEG 2000, an emerging alternative image encoding format offering advantages over the current JPEG standard, including lossless compression and support for multiple resolutions.
http://worldcat.org/arcviewer/1/OCC/2007/08/08/0000070513/viewer/file8
82.html#interview
Evaluation of Motion JPEG 2000 for Video Archiving
Gill, Michael; Pearson, Glenn (Date Created: Apr 2005) (United States of America)
This paper discusses the applicability of Motion JPEG 2000 (MJ2) as a format for long term video preservation. This paper examines three MJ2 implementations - Kakadu, Morgan Multimedia's codec and Open JPEG 2000.
http://archive.nlm.nih.gov/pubs/pearson/MJ2_video_archiving.pdf
Paper presented at the Archiving 2005 conference, April 26-29, 2005, Washington D.C.
Format for Digital Preservation of Images : A Study on JPEG 2000 File Robustness
Buonora, Paola; Liberati, Franco In: D-Lib magazine (Date Created: Jul 2008)
This article considers the robustness of JPEG2000 and argues that this format has attributes which make it suitable as an alternative storage format to TIFF for high quality images. Simple tools and free software can be used to increase JPEG2000's robustness.
http://www.dlib.org/dlib/july08/buonora/07buonora.html
JPEG 2000 as a Preservation and Access Format for the Wellcome Trust Digital Library
Buckley, Robert; Tanner, Simon (ed.) (Date Created: Aug 2009) (United Kingdom)
This report (17 p.) discusses the suitability of the JPEG2000 formats for preservation and access and how the Wellcome Library can make best use of particular properties to develop a solution for their situation. Recommendations are made on compression, resolution and quality layers.
http://wellcomelibrary.blogspot.com/2009/09/wellcome-library-to-use-jp
eg2000-image.html
Downloadable from Scribd image viewer.
JPEG2000 Implementation at Library and Archives Canada
Desrochers, Pierre; Thurgood, Brian (Date Created: 11 Mar 2007) (Canada)
This paper given at Museums and the Web 2007 (April 11-14, 2007 San Francisco, California) provides a high-level overview of JPEG2000 and describes the implementation of a pilot project using JPEG2000 at Library and Archives Canada in 2006/2007.
http://www.archimuse.com/mw2007/papers/desrochers/desrochers.html
Available in J. Trant & D. Bearman (eds.) Museums and the Web 2007. Proceedings.
JSTOR/Harvard Object Validation Environment (JHOVE)
Donnelly, Martin (Date Created: Mar 2006)
JHOVE is an open source framework for the identification, validation and characterisation of various file formats, including html. xml, gif, tiff, jpeg2000, and wave. The article looks at how formats are identified, validated and characterisated as well as system development, standards and legal factors. Also included are sample records.
http://www.dcc.ac.uk/resource/case-studies/jhove/jhove.pdf
DCC Case Studies and Interviews, ISSN 1749-8767
Lossless Video Compression for Archives: Motion JPEG2k and Other Options
Davila, R. Justin; Gilmore, Ian (Date Created: Jan 2006)
This article compares various lossless video schemes including JPEG, MPEG and MPEG 4 as well as some lesser known systems. They are discussed against the requirements that an archival file being both lossless to preserve content and also compressed to conserve storage capacity.
http://www.media-matters.net/docs/WhitePapers/WPMJ2k.pdf
Preservation Handbook : Marked-up Textual Data
Morrison, Allan; Wynne, Martin (Date Created: 11 Apr 2006) (United Kingdom)
This publication is a part of a series of preservation handbooks published by the AHDS (Arts and Humanities Data Service). Although this document is written for AHDS staff, the information is useful to the broader digital preservation community. The handbook gives an overview of the various mark up formats, focussing on open source formats.
http://www.ahds.ac.uk/preservation/presMarkUp_v4.pdf
Also available in RTF format.
Research Report on JPEG2000 for Video Archiving
Gilmour, Ian (Date Created: 17 Jan 2007) (United States of America)
This technical report tests Motion-JPEG2000 with the aim of determine typical values of compression for a range of program content, to assess whether average and peak values affect accuracy of predicting data capacities for planning digitizing projects and to investigate particular characteristics which may significantly increase or reduce encoded file sizes.
http://www.media-matters.net/docs/WhitePapers/IansWhitePaper.pdf
Media Matters Technical Report
Standards-based Solution for the Accurate Transfer of Digital Assets
Bekaert, Jeroen ; Van de Sompel, Herbert In: D-Lib magazine (Date Created: Jun 2005) (United States of America)
This article describes the results of a collaboration between the Research Library of the Los Alamos National Laboratory (LANL) and the American Physical Society (APS) to produce a system for the transfer of digital content from the APS collection to LANL. It discusses the standards involved including: MPEG-21 Digital Item Declaration (MPEG-21 DID), MPEG-21 Digital Item Identification (MPEG-21 DII), the W3C XML Signature Syntax and Processing standard, and OAI-PMH and includes the schema in appendices.
http://dx.doi.org/10.1045/june2005-bekaert
http://www.dlib.org/dlib/june05/bekaert/06bekaert.html
Status Report on JPEG 2000 Implementation for Still Images: The UConn Survey
Bennett, Michael J.; Lowe, David (Date Created: May 2009) (United States of America)
This paper focuses on the major issues identified during a survey of cultural heritage institutions by the University of Connecticut Libraries conducted in August to October 2008 on the status of JPEG 2000 implementation as a still image format. Responses from users and non-users are considered. Migration concerns including codec inconsistency, perception and misperceptions of advantages and disadvantages which have influenced upake including intellectual property rights are discussed. The paper which was given at IS & T's Archiving 2009 conference is also available in the Final Program & Proceedings (pp 209-212).
http://digitalcommons.uconn.edu/libr_pubs/19/
UConn Libraries Published Works. Paper 19. Available for download as PDF.
New From TIFF to JPEG 2000? Preservation Planning at the Bavarian State Library Using a Collection of Digitized 16th Century Printings
Beinert, Tobias; Brantl, Markus; Kugler, Anna; Kulovits, Hannes; Rauber, Andreas; Schoger, Astrid In: D-Lib magazine (Date Created: Nov 2009) (Germany)
This article describes the use of PLATO, the preservation planning tool developed by the PLANETS project, in assessing the suitability of migration of images in TIFF format to JPEG 2000 by the Bavarian State Library. After examining the proposal and taking into consideration the Library's specific preservation requirements and policies and results of experiments with available migration tools, it was decided not to undertake the proposed migration at this point in time. Using PLATO assisted in the identification and documentation of the factors which contributed to the decision making process. The article emphasises the need for individual organisations to make preservation decisions based on their individual situation.
http://www.dlib.org/dlib/november09/kulovits/11kulovits.html
Tomorrow's File Endings : On Archiving Principles and Archiving Formats
Uneson, Marcus (Date Created: 2005) (Sweden)
This paper discusses general digital archiving principles, such using open standards and text based formats, particularly in regard to the archiving of scientific and scholarly publications. The efficacy of using various file formats in an archival setting are also discussed. These formats include pdf, pdf-a, tex/latex and xml.
http://www.sciecom.org/ojs/index.php/sciecominfo/article/viewFile/31/3
2
Safekept
UVC for Images
Koninklijke Bibliotheek (Date Created: 2004) (Netherlands)
The UVC for JPEG is a follow-up for the 'proof of concept' of the UVC for PDF carried out in 2002. This operational tool enables permanent, platform independent access for JPEG images, regardless of future technological changes. The tool may be used to store other file types, such as PDF, but with reduced functionality, with only an image of the material being preserved. It is planned that this approach will be extended to TIFF and eventually to native PDF.
http://www.kb.nl/hrd/dd/dd_onderzoek/uvc_voor_images-en.html
Dutch version available at: http://www.kb.nl/hrd/dd/dd_onderzoek/uvc_voor_images.html

Top

Events

2009 Conference and Members' Meeting of the TEI Consortium: Text Encoding in the Era of Mass Digitization
11 - 15 Nov 2009 , University of Michigan, Ann Arbor
TEI Consortium
(United States of America)
This conference is organized around the theme 'text encoding in the era of mass digitization'. It will feature keynote lectures, parallel sessions, the annual TEI business meeting, a poster session/tools demonstration and slam, and special interest group (SIG) meetings.
http://www.lib.umich.edu/spo/teimeeting09/
DPC/BL JPEG 2000 Workshop
25 Jun 2007 , British Library Conference Centre (United Kingdom)
One day workshop on the use of JPEG 2000 in digital repositories organised by the Digital Preservation Coalition and the British Library.
http://www.dpconline.org/graphics/events/0706jpeg2000wkshop.html
Presentations (PDF) available from this website.

Top

Organisations and Websites

File Formats Blog
McGath, Gary (Regularly Updated)
Gary McGath is a software Engineer at Harvard University Libraries. His blog features 'news and comments about technical issues relating to file formats, file validation, and archival software.'
http://fileformats.blogspot.com/
JPEG 2000 in Libraries and Archives
University of Connecticut (Regularly Updated)
The decision to create this Web site arose out the Symposium on the Adoption of JPEG 2000 by Archives and Libraries on November 4-5, 2004. The website allows users to register and post their own information on best practice, articles, projects, and products that use the standard. The website provides access to the Symposium report and project briefing; access to resources by type and focus and access to an associated blog. The website has a companion mailing list discussing the application of JPEG 2000 in libraries and archives.
http://j2karclib.info/
MPEG Homepage
Moving Picture Experts Group (Regularly Updated)
This website contains information on the development of international standards for compression, decompression, processing, and coded representation of moving pictures, audio and their combination, including MPEG 7 and MPEG 21. The website has links to meetings, documents, tutorials and workplans.
http://www.chiariglione.org/mpeg/
OASIS Open Document Format for Office Applications (OpenDocument)
OASIS (Organization for the Advancement of Structured Information Standards) (Date Created: May 2005)
The OASIS Open Document format is an XML-based file format specification for office applications. The OpenDocument v1.0 specification was officially approved as an OASIS standard on 1 May 2005 and can be downloaded from the Office Document Format Technical Committee web page.
http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=office
Open Document Format : ODF Alliance
OpenDocument Format Alliance (Regularly Updated)
This alliance was formed in March 2006 from a coalition of over 30 organisations from around the world. ODF is an open standard to allow sustainable reading and exchange of common office documents. The goals of the ODF Alliance are to support and encourage the use of ODF in the public sector.
http://www.odfalliance.org/
OpenRAW : Digital Image Preservation Through Open Documentation
OpenRAW (Regularly Updated)
This website was initiated by a group of digital photographers as a reaction to proprietary raw file formats and the negative impact of these formats on digital preservation and future access. Currently, each manufacturer's format is proprietary and has multiple variations for different camera models. The goal of this organisation is to encourage camera manufacturers to publicly document their RAW image formats.
http://www.openraw.org/
PDF/A Competence Center
PDF/A Competence Center (Date Created: 2006)
The PDF/A Competence Center was established as an international association in 2006 with the objective to promote the exchange of information and experience in the field of long-term archiving in accordance with ISO 19005 (PDF/A). Its members include companies and experts from 20 countries.
http://www.pdfa.org/
Safekept
Sustainability of Digital Formats Planning for Library of Congress Collections
Arms, Caroline R.; Fleischhauer, Carl (Regularly Updated) (United States of America)
This website provides information on the suitability of various formats for preserving the Library of Congress's digital collections. Formats are examined for still images, sound recordings, textual content, and moving images, although it is planned to examine more complex digital works such as web sites. Formats are examined using several factors including tranperancy, technical protection, patents, self-documentation and external dependencies.
http://www.digitalpreservation.gov/formats/index.shtml
Towards a New Meta Standard for Long Term Digital Video Preservation
Pearson, Glenn (Date Created: 12 Dec 2005)
This is a series of links to documents for consideration about ways to encourage lossless video encoding for preservation, with a particular interest in JPEG 2000 frame encodings.
http://archive.nlm.nih.gov/VideoArchivists2005/follow-on.html

Top

Policies, Strategies & Guidelines

Document management : Electronic document file format for long-term preservation : Part 1: Use of PDF 1.4 (PDF/A-1)
International Organization for Standardization (Date Created: Oct 2005)
The ISO (International Organization for Standardization) has released the ISO 19005-1:2005 standard which specifies how to use the Portable Document Format (PDF) 1.4 for long-term preservation of electronic documents. The Press release gives more detail on this important development. See also ISO 3200-1:2008 Document management -- Portable document format -- Part 1: PDF 1.7.
http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm
?csnumber=38920
Available for purchase in pdf and paper formats.
Safekept
Guidelines for Computer File Types, Interchange Formats and Information Standards
Brown, David L. (Date Created: 28 Jun 2004) (Canada)
This document gives recommendations for preferred formats for various file types and exchange formats. The recommendations include digital audio, digital video, text documents, emails, geospatial data and databases. The recommendations are based on various considerations such as whether formats are based on international standards and are openly available. Although the recommendations were developed to help optimise interoperability of digital information between the government of Canada and Libraries and Archives Canada, the principles are also applicable to computer file and exchange formats generally.
http://www.collectionscanada.gc.ca/government/products-services/007002
-3017-e.html
OASIS Open Document Format for Office Applications (OpenDocument)
OASIS (Organization for the Advancement of Structured Information Standards) (Date Created: May 2005)
The OASIS Open Document format is an XML-based file format specification for office applications. The OpenDocument v1.0 specification was officially approved as an OASIS standard on 1 May 2005 and can be downloaded from the Office Document Format Technical Committee web page.
http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=office
PDF Guidelines : Recommendations for the Creation of PDF Files for Long-term Preservation and Access
Rog, Judith (Last Updated: 31 May 2007) (Netherlands)
This document provides guidelines on the standards that pdf files deposited with the e-Depot should comply with. The guidelines cover accessibility and structure, fonts, colour, compression, images and executable actions.
http://www.kb.nl/hrd/dd/dd_links_en_publicaties/PDF_Guidelines.pdf
Safekept
Sustainability of Digital Formats Planning for Library of Congress Collections
Arms, Caroline R.; Fleischhauer, Carl (Regularly Updated) (United States of America)
This website provides information on the suitability of various formats for preserving the Library of Congress's digital collections. Formats are examined for still images, sound recordings, textual content, and moving images, although it is planned to examine more complex digital works such as web sites. Formats are examined using several factors including tranperancy, technical protection, patents, self-documentation and external dependencies.
http://www.digitalpreservation.gov/formats/index.shtml

Top

Projects and Case Studies

Alternative File Formats for Storing Master Images
Gillesse, Robert; Rog, Judith; Verheusen, Astrid (Date Created: 7 Mar 2008) (Netherlands)
This in depth report (64 pages) describes a project undertaken by the Koninklijke Bibliotheek on possible alternative file formats for storing master images from mass digitisation projects. The KB currently stores uncompressed TIFFs. This report considers JPEG 2000, PNG, JPEG and TIFF LZW as alternatives. It describes each format and considers the consequences for required storage capacity, image quality, long term sustainability and functionality.
http://www.kb.nl/hrd/dd/dd_links_en_publicaties/publicaties/Alternativ
e%20File%20Formats%20for%20Storing%20Masters%202%201.pdf
JSTOR/Harvard Object Validation Environment (JHOVE)
Donnelly, Martin (Date Created: Mar 2006)
JHOVE is an open source framework for the identification, validation and characterisation of various file formats, including html. xml, gif, tiff, jpeg2000, and wave. The article looks at how formats are identified, validated and characterisated as well as system development, standards and legal factors. Also included are sample records.
http://www.dcc.ac.uk/resource/case-studies/jhove/jhove.pdf
DCC Case Studies and Interviews, ISSN 1749-8767

Top

Surveys

Digital Project Staff Survey of JPEG 2000
Bennett, Michael J.; Lowe, David (Date Created: Jan 2009) (United States of America)
This survey of JPEG 2000 user community perceptions was undertaken by the University of Connecticut Libraries in Fall 2008. The responses to the survey are available to download as excel or zip file. The responses revealed that there were a number of concerns and questions that need to be addressed to enhance adoption of JPEG 2000. These are explored further in the associated final report which was given as a paper at IS & T's Archiving 2009 conference.
http://digitalcommons.uconn.edu/libr_pubs/16/
UConn Libraries Published Works. Paper 16. Available for download Excel spreadsheet or html through zip file extraction.
Status Report on JPEG 2000 Implementation for Still Images: The UConn Survey
Bennett, Michael J.; Lowe, David (Date Created: May 2009) (United States of America)
This paper focuses on the major issues identified during a survey of cultural heritage institutions by the University of Connecticut Libraries conducted in August to October 2008 on the status of JPEG 2000 implementation as a still image format. Responses from users and non-users are considered. Migration concerns including codec inconsistency, perception and misperceptions of advantages and disadvantages which have influenced upake including intellectual property rights are discussed. The paper which was given at IS & T's Archiving 2009 conference is also available in the Final Program & Proceedings (pp 209-212).
http://digitalcommons.uconn.edu/libr_pubs/19/
UConn Libraries Published Works. Paper 19. Available for download as PDF.

Top

Evaluations

JPEG 2000 - a Practical Digital Preservation Standard?
Buckley, Robert (Date Created: Feb 2008) (United Kingdom)
This in-depth report (28 p) describes the JPEG 2000 format and related challenges It is aimed at assisting organisations to make informed decisions about the JPEG 2000 format and their future storage needs. This report will be of particular interest to the archival and library sectors who are interested in JPEG 2000 as a potentially more efficient storage format for their major digitisation programmes and image repositories who already use the format to collect and distribute a variety of images including geospatial, medical images, digital cinema, and networked images.
http://www.dpconline.org/docs/reports/dpctw08-01.pdf
DPC Technology Watch Report 08-01

Top


Related Topics: File formats | Format registries

Broader Topic: Standards

Home | About | Search | Browse topics | Feedback | Contributions | What's New?
NATIONAL LIBRARY OF AUSTRALIA,
Canberra, ACT 2600, AUSTRALIA
Telephone + 61 2 6262 1111; Facsimile +61 2 6257 1703;
Telephone Typewriter Number: 1800 026 372