Data preservation is the act of conserving and maintaining both the safety and integrity of data. Preservation is done through formal activities that are governed by policies, regulations and strategies directed towards protecting and prolonging the existence and authenticity of data and its metadata. Data can be described as the elements or units in which knowledge and information is created,  and metadata are the summarizing subsets of the elements of data; or the data about the data. The main goal of data preservation is to protect data from being lost or destroyed and to contribute to the reuse and progression of the data.
Most historical data collected over time has been lost or destroyed. War and natural disasters combined with the lack of materials and necessary practices to preserve and protect data has caused this. Usually, only the most important data sets were saved, such as government records and statistics, legal contracts and economic transactions. Scientific research and doctoral theses data have mostly been destroyed from improper storage and lack of data preservation awareness and execution. Over time, data preservation has evolved and has generated importance and awareness. We now have many different ways to preserve data and many different important organizations involved in doing so.
The first digital data preservation storage solutions appeared in the 1950s, which were usually flat or hierarchically structured. While there were still issues with these solutions, it made storing data much cheaper, and more easily accessible. In the 1970s relational databases as well as spreadsheets appeared. Relational data bases structure data into tables using structured query languages which made them more efficient than the preceding storage solutions, and spreadsheets hold high volumes of numeric data which can be applied to these relational databases to produce derivative data. More recently, non-relational (non-structured query language) databases have appeared as compliments to these relational databases which hold high volumes of unstructured data.
The importance of preserving data is vast. When data is lost it is as though it never existed. It is important to realize that data is the building block of everything, it is seen on both small and large scales. Data can be lost in many different ways, whether it be natural disasters, wars, data breaches or just through negligence or decay.
Data can be lost on a small or independent scale whether it’s personal data loss, or data loss within businesses and organizations, as well as on a larger or national or global scale which can negatively and potentially permanently affect things such as environmental protection, medical research, homeland security, public health and safety, economic development and culture.
Ways in which data collections can be used when preserved and stored properly can be seen through the U.S. Geological Survey, which stores data collections on natural hazards, natural resources, and landscapes. The data collected by the U.S. Geological Survey is used by federal and state land management agencies towards land- use planning and management.
In contrast, data holdings are collections of gathered data that are informally kept and do not prepare for long-term preservation. For example, a collection or back-up of personal files. Data holdings are generally the storage methods used in the past when data has been lost due to environmental and other historical disasters.
Furthermore, data retention differs from data preservation in the sense that by definition, to retain an object (data) is to hold or keep possession or use of the object. To preserve an object is to protect, maintain and keep up for future use.
Thus, data preservation exceeds the concept of having or possessing data or back up copies of data. Data preservation ensures persistent access to data by planning back-up and recovery strategies, preceding the event of a disaster or technological change.
Digital preservation, is similar to data preservation, but is mainly concerned with technological threats, and solely digital data. Essentially digital data is a set of formal activities to enable ongoing or persistent use and access of digital data exceeding the occurrence of technological malfunction or change. Digital preservation is aware of the inevitable change in technology and protocols, and prepares for data will need to be accessible across new types of technologies and platforms while being the integrity of the data and metadata being conserved.
Technology, while providing great process in conserving data that may not have been possible in the past, is also changing at such a quick rate that digital data may not be accessible anymore due to the format being incompatible with new software. Without the use of data preservation much of our existing digital data is at risk.
The majority of methods used towards data preservation today are digital methods, which are so far the most effective methods that exist.
Archives are a collection of historical documents and records. Archives contribute and work towards the preservation of data by collecting data that is well organized, while providing the appropriate metadata to confirm it.
An example of an important data archive is The LONI Image Data Archive, which is an archive that collects data regarding clinical trials and clinical research studies.
Catalogues, directories and portals
Catalogues, directories and portals are consolidated resources which are kept by individual institutions, and are associated with data archives and holdings. In other words, the data is not presented on the site, but instead might act as metadata and aggregators, and may administer thorough inventories.
Repositories are places where data archives and holdings can be accessed and stored. The goal of repositories is to make sure that all requirements and protocols of archives and holdings are being met, and data is being certified to ensure data integrity and user trust.
A repository that holds all data sets on a single site.
An example of a major single-site repository the Data Archiving and Networking Services which is a repository which provides ongoing access to digital research resources for the Netherlands.
A repository that hosts data set on multiple institutional sites.
An example of a well known multi-site repository is OpenAIRE which is a repository that hosts research data and publications collaborating all of the EU countries and more. OpenAIRE promotes open scholarship and seeks to improves discover-ability and re-usability of data.
Trusted Digital Repostitory
A repository that seeks to provide reliable, trusted access over a long period of time. The repository can be single or multi-sited but must cooperate with the Reference Model for an Open Archival Information System, as well as adhere to a set of rules or attributes that contribute to its trust such as having persistent financial responsibility, organizational buoyancy, administrative responsibility security and safety.
An example of a trusted digital repository is The Digital Repository of Ireland (DRI) which is a multi-site repository that hosts Ireland’s humanity and social science data sets.
Cyber infrastructures which consists of archive collections which are made available through the system of hardware, technologies, software, policies, services and tools. Cyber infrastructures are geared towards the sharing of data supporting peer-to-peer collaborations and a cultural community.
An example of a major cyber-infrastructure is The Canadian Geo-spatial Data Infrastructure which provides access to spatial data in Canada.
- ^“Dictionary Definitions”. InterPARES 2 Terminology Database. InterPARES2. 2013. Retrieved 21 October 2013.
- ^Kitchin, R (2012). “Conceptualizing Data”. The Data Revolution. London: Sage: 1–26.
- ^ Jump up to:ab Cyberinfrastructure Council (2007). “Cyberinfrastructure vision for 21st century discovery” (PDF). Washington DC: National Science Foundation.
- ^ Jump up to:ab c d e f g h i Kitchin, R (2012). “Small Data, Data Infrastructures and Data Brokers”. The Data Revolution. London: Sage: 27–47.
- ^Driscoll, K (2012). “From punched cards to “big data”: a social history of database populism”. communication +1. 1 (4). Retrieved 22 February 2013.
- ^ Jump up to:ab Pierce, F.; Steinmetz, J.; Dickinson, T.; McHugh, J. (2010). “The importance of data preservation”. The Geological Society of America.
- ^(2017) Retain [Definition]. Marriam-Webster. Retrieved From: https://www.merriam-webster.com/dictionary/retain
- ^(2107) Preserve [Definition]. Marriam-Webster. Retrieved From: https://www.merriam-webster.com/dictionary/preserve
- ^ Jump up to:ab Corrado, E.; Sandy, M. (2014). “Digital Preservation for Libraries, Archives, and Museums”. Chapter 1. Rowman & Littlefield Publishers: 3–16.
- ^“Data Preservation”. International Federation of Data Organizations For Social Science. 2012.
- ^Lauriault, T. P.; Hackett, Y; Kennedy, E (2013). Geo-spatial Data Preservation Primer. Ottawa: Hickling, Aurthurs and Low.
- ^“About Us”. LONI Image and Data Archive. 2017.
- ^O’Carroll, A.; Collins, S.; Gallgher, D.; Tang, J.; Webb, S (2013). Caring for the Digital Content, Mapping International Approaches. Dublin: NUI Maynooth, Trinity College Dublin, Royal Irish Academy and Digital Repository of Ireland.
- ^“About DANS”. Data Archiving and Networked Services. 2016.
- ^“Project Factsheets”. OpenAIRE. 2017.
- ^“About DRI”. Digital Repository of Ireland. 2014–2015.
- ^“Canada’s Spatial Data Infrastructure”. Government of Canada. 2017.
Ofer Abarbanel is a 25 year securities lending broker and expert who has advised many Israeli regulators, among them the Israel Tax Authority, with respect to stock loans, repurchase agreements and credit derivatives. Founder of TBIL.co STATX Fund.