Adigital library (also called anonline library, aninternet library, adigital repository, a library without walls, or adigital collection) is anonline database of digital objects that can include text, still images, audio, video,digital documents, or otherdigital media formats or alibrary accessible through theinternet. Objects can consist ofdigitized content likeprint orphotographs, as well asoriginally produced digital content likeword processor files orsocial media posts. In addition to storing content, digital libraries provide means for organizing, searching, andretrieving the content contained in the collection. Digital libraries can vary immensely in size and scope, and can be maintained by individuals or organizations.[1] The digital content may be stored locally, or accessed remotely via computer networks. These information retrieval systems are able to exchange information with each other throughinteroperability andsustainability.[2]
The early history of digital libraries is not well documented, but several key thinkers are connected to the emergence of the concept.[3] Predecessors includePaul Otlet andHenri La Fontaine'sMundaneum, an attempt begun in 1895 to gather and systematically catalogue the world's knowledge, with the hope of bringing about world peace.[4] The visions of the digital library were largely realized a century later during the great expansion of the Internet.[5]
Vannevar Bush andJ.C.R. Licklider are two contributors that advanced this idea into then current technology. Bush had supported research that led to the bomb that was dropped onHiroshima. After seeing the disaster, he wanted to create a machine that would show how technology can lead to understanding instead of destruction. This machine would include a desk with two screens, switches and buttons, and a keyboard.[6] He named this the "Memex". This way individuals would be able to access stored books and files at a rapid speed. In 1956,Ford Foundation funded Licklider to analyze how libraries could be improved with technology. Almost a decade later, his book entitled "Libraries of the Future" included his vision. He wanted to create a system that would use computers and networks so human knowledge would be accessible for human needs and feedback would be automatic for machine purposes. This system contained three components, the corpus of knowledge, the question, and the answer. Licklider called it a procognitive system.
In 1980 the role of the library in an electronic society was the focus of a clinic on library applications ofdata processing. Participants includedFrederick Wilfrid Lancaster,Derek De Solla Price,Gerard Salton, andMichael Gorman).[7]
Early projects centered on the creation of an electronic card catalogue known asOnline Public Access Catalog (OPAC). By the 1980s, the success of these endeavors resulted in OPAC replacing the traditionalcard catalog in many academic, public and special libraries. This permitted libraries to undertake additional rewarding co-operative efforts to support resource sharing and expand access to library materials beyond an individual library.
An early example of a digital library is theEducation Resources Information Center (ERIC), a database of education citations, abstracts and texts that was created in 1964 and made available online throughDIALOG in 1969.[8]
In 1994, digital libraries became widely visible in the research community due to a $24.4 millionNSF managed program supported jointly byDARPA's Intelligent Integration of Information (I3) program,NASA, and NSF itself.[9] Successful research proposals came from six U.S. universities.[10] The universities includedCarnegie Mellon University,University of California-Berkeley,University of Michigan,University of Illinois,University of California-Santa Barbara, andStanford University. Articles from the projects summarized their progress at their halfway point in May 1996.[11] Stanford research, bySergey Brin andLarry Page, led to the founding ofGoogle.
Early attempts at creating a model for digital libraries included the DELOSDigital Library Reference Model[12][13] and the 5S Framework.[14][15]
The termdigital library was first popularized by theNSF/DARPA/NASA Digital Libraries Initiative in 1994.[16] With the availability of the computer networks the information resources are expected to stay distributed and accessed as needed, whereas inVannevar Bush's essayAs We May Think (1945) they were to be collected and kept within the researcher'sMemex.
The termvirtual library was initially used interchangeably withdigital library, but is now primarily used for libraries that are virtual in other senses (such as libraries which aggregate distributed content). In the early days of digital libraries, there was discussion of the similarities and differences among the termsdigital,virtual, andelectronic.[17]
A distinction is often made between content that was created in a digital format, known asborn-digital, and information that has been converted from a physical medium, e.g. paper, throughdigitization. Not all electronic content is indigital data format. The termhybrid library is sometimes used for libraries that have both physical collections and electronic collections. For example,American Memory is a digital library within theLibrary of Congress.
Some important digital libraries also serve as long term archives, such asarXiv and theInternet Archive. Others, such as theDigital Public Library of America, seek to make digital information from various institutions widely accessible online.[18]
Many academic libraries are actively involved in building repositories of their institution's books, papers, theses, and other works that can be digitized or were 'born digital'. Many of these repositories are made available to the general public with few restrictions, in accordance with the goals ofopen access, in contrast to the publication of research in commercial journals, where the publishers usually limit access rights. Irrespective of access rights, institutional, truly free, and corporate repositories can be referred to as digital libraries.Institutional repository software is designed for archiving, organizing, and searching a library's content. Popular open-source solutions includeDSpace,Greenstone Digital Library (GSDL),EPrints,Digital Commons, and theFedora Commons-based systemsIslandora andSamvera.[19]
Legal deposit is often covered bycopyright legislation and sometimes by laws specific to legal deposit, and requires that one or more copies of all material published in a country should be submitted for preservation in an institution, typically thenational library. Since the advent ofelectronic documents, legislation has had to be amended to cover the new formats, such as the 2016 amendment to theCopyright Act 1968 in Australia.[20][21][22]
Since then various types of electronic depositories have been built. TheBritish Library's Publisher Submission Portal and the German model at theDeutsche Nationalbibliothek have one deposit point for a network of libraries, but public access is only available in the reading rooms in the libraries. The AustralianNational edeposit system has the same features, but also allows for remote access by the general public for most of the content.[23]
Physicalarchives differ from physical libraries in several ways. Traditionally, archives are defined as:
The technology used to create digital libraries is even more revolutionary for archives since it breaks down the second and third of these general rules. In other words, "digital archives" or "online archives" will still generally contain primary sources, but they are likely to be described individually rather than (or in addition to) in groups or collections. Further, because they are digital, their contents are easily reproducible and may indeed have been reproduced from elsewhere. TheOxford Text Archive is generally considered to be the oldest digital archive of academic physical primary source materials.
Archives differ from libraries in the nature of the materials held. Libraries collect individual published books and serials, or bounded sets of individual items. The books and journals held by libraries are not unique, since multiple copies exist and any given copy will generally prove as satisfactory as any other copy. The material in archives and manuscript libraries are "the unique records of corporate bodies and the papers of individuals and families".[24]
A fundamental characteristic of archives is that they have to keep the context in which their records have been created and the network of relationships between them in order to preserve their informative content and provide understandable and useful information over time. The fundamental characteristic of archives resides in their hierarchical organization expressing the context by means of thearchival bond.
Archival descriptions are the fundamental means to describe, understand, retrieve and access archival material. At the digital level, archival descriptions are usually encoded by means of theEncoded Archival Description XML format. The EAD is a standardized electronic representation of archival description which makes it possible to provide union access to detailed archival descriptions and resources in repositories distributed throughout the world.
Given the importance of archives, a dedicated formal model, called NEsted SeTs for Object Hierarchies (NESTOR),[25] built around their peculiar constituents, has been defined. NESTOR is based on the idea of expressing the hierarchical relationships between objects through the inclusion property between sets, in contrast to the binary relation between nodes exploited by the tree. NESTOR has been used to formally extend the 5S model to define a digital archive as a specific case of digital library able to take into consideration the peculiar features of archives.
Acomputer-aided design library or CAD library is acloud basedrepository of 3D models or parts forcomputer-aided design (CAD),computer-aided engineering (CAE),computer-aided manufacturing (CAM), orBuilding information modeling (BIM). Examples of CAD libraries areGrabCAD,Sketchup 3D Warehouse,Sketchfab,McMaster-Carr,TurboSquid,Chaos Cosmos,[26] andThingiverse.[27][spam link?] The models can be free andopen source orproprietary and have to pay asubscription to have access to the CAD library 3D models.Generative Ai CAD libraries are being developed usinglinkedopen data ofschematics anddiagrams.[28]
CAD libraries can have assets such as3D models, materials/textures,bump maps, trees/plants,HDRIs, and differentComputer graphics lighting sources to berendered.[29][spam link?]
A 2D graphics repository/library arevector graphics orraster graphics images/icons that can befree use orproprietary.[30][spam link?]
The advantages of digital libraries as a means of easily and rapidly accessing books, archives and images of various types are now widely recognized by commercial interests and public bodies alike.[31]
Traditional libraries are limited by storage space; digital libraries have the potential to store much more information, simply because digital information requires very little physical space to contain it.[32] As such, the cost of maintaining a digital library can be much lower than that of a traditional library. A physical library must spend large sums of money paying for staff, book maintenance, rent, and additional books. Digital libraries may reduce or, in some instances, do away with these fees. Both types of library require cataloging input to allow users to locate and retrieve material. Digital libraries may be more willing to adopt innovations in technology providing users with improvements in electronic and audio book technology as well as presenting new forms of communication such as wikis and blogs; conventional libraries may consider that providing online access to their OP AC catalog is sufficient. An important advantage to digital conversion is increased accessibility to users. They also increase availability to individuals who may not be traditional patrons of a library, due to geographic location or organizational affiliation.
Digital libraries offer a variety of software packages, including those tailored forkids' educational games.[34] Institutional repository software, which focuses primarily on ingest, preservation and access of locally produced documents, particularly locally produced academic outputs, can be found inInstitutional repository software. This software may be proprietary, as is the case with the Library of Congress which uses Digiboard and CTS to manage digital content.[35]
The design and implementation in digital libraries are constructed so computer systems and software can make use of the information when it is exchanged. These are referred to as semantic digital libraries. Semantic libraries are also used to socialize with different communities from a mass of social networks.[36] DjDL is a type of semantic digital library. Keywords-based and semantic search are the two main types of searches. A tool is provided in the semantic search that create a group for augmentation and refinement for keywords-based search. Conceptual knowledge used in DjDL is centered around two forms; the subjectontology and the set ofconcept search patterns based on the ontology. The three type of ontologies that are associated to this search arebibliographic ontologies, community-aware ontologies, and subject ontologies.
In traditional libraries, the ability to find works of interest is directly related to how well they were cataloged. While cataloging electronic works digitized from a library's existing holding may be as simple as copying or moving a record from the print to the electronic form, complex and born-digital works require substantially more effort. To handle the growing volume of electronic publications, new tools and technologies have to be designed to allow effective automated semantic classification and searching. Whilefull-text search can be used for some items, there are many common catalog searches which cannot be performed using full text, including:
Most digital libraries provide a search interface which allows resources to be found. These resources are typicallydeep web (or invisible web) resources since they frequently cannot be located bysearch enginecrawlers. Some digital libraries create special pages orsitemaps to allow search engines to find all their resources. Digital libraries frequently use theOpen Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) to expose their metadata to other digital libraries, and search engines likeGoogle Scholar,Yahoo! andScirus can also use OAI-PMH to find these deep web resources.[37] As with physical libraries, very relatively little is known about how users actually select books.[38]
There are two general strategies for searching afederation of digital libraries: distributed searching and searching previously harvestedmetadata.
Distributed searching typically involves a client sending multiple search requests in parallel to a number of servers in the federation. The results are gathered, duplicates are eliminated or clustered, and the remaining items are sorted and presented back to the client. Protocols likeZ39.50 are frequently used in distributed searching. A benefit to this approach is that the resource-intensive tasks of indexing and storage are left to the respective servers in the federation. A drawback to this approach is that the search mechanism is limited by the different indexing and ranking capabilities of each database; therefore, making it difficult to assemble a combined result consisting of the most relevant found items.
Searching over previously harvested metadata involves searching a locally storedindex of information that has previously been collected from the libraries in the federation. When a search is performed, the search mechanism does not need to make connections with the digital libraries it is searching—it already has a local representation of the information. This approach requires the creation of an indexing and harvesting mechanism which operates regularly, connecting to all the digital libraries and querying the whole collection in order to discover new and updated resources.OAI-PMH is frequently used by digital libraries for allowing metadata to be harvested. A benefit to this approach is that the search mechanism has full control over indexing and ranking algorithms, possibly allowing more consistent results. A drawback is that harvesting and indexing systems are more resource-intensive and therefore expensive.
Digital preservation aims to ensure that digital media and information systems are still interpretable into the indefinite future.[39] Each necessary component of this must be migrated, preserved oremulated.[40] Typically lower levels of systems (floppy disks for example) are emulated, bit-streams (the actual files stored in the disks) are preserved and operating systems are emulated as avirtual machine. Only where the meaning and content of digital media and information systems are well understood is migration possible, as is the case for office documents.[40][41][42] However, at least one organization, the Wider Net Project, has created an offline digital library, theeGranary, by reproducing materials on a 6TBhard drive. Instead of a bit-stream environment, the digital library contains a built-inproxy server andsearch engine so the digital materials can be accessed using aweb browser.[43] Also, the materials are not preserved for the future. The eGranary is intended for use in places or situations where Internet connectivity is very slow, non-existent, unreliable, unsuitable or too expensive.
In the past few years, procedures fordigitizing books at high speed and comparatively low cost have improved considerably with the result that it is now possible to digitize millions of books per year.[44] The Google book-scanning project is also working with libraries to offer digitize books pushing forward on the digitize book realm.
Digital libraries are hampered bycopyright law because, unlike with traditional printed works, the laws of digital copyright are still being formed. The republication of material on the web by libraries may require permission from rights holders, and there is a conflict of interest between libraries and the publishers who may wish to create online versions of their acquired content for commercial purposes. In 2010, it was estimated that twenty-three percent of books in existence were created before 1923 and thus out of copyright. Of those printed after this date, only five percent were still in print as of 2010.[update] Thus, approximately seventy-two percent of books were not available to the public.[45]
There is a dilution of responsibility that occurs as a result of the distributed nature of digital resources. Complex intellectual property matters may become involved since digital material is not always owned by a library.[46] The content is, in many cases,public domain or self-generated content only. Some digital libraries, such asProject Gutenberg, work to digitize out-of-copyright works and make them freely available to the public. An estimate of the number of distinct books still existent in library catalogues from 2000 BC to 1960, has been made.[47][48]
TheFair Use Provisions(17 USC § 107) under theCopyright Act of 1976 provide specific guidelines under which circumstances libraries are allowed to copy digital resources. Four factors that constitute fair use are "Purpose of the use, Nature of the work, Amount or substantiality used and Market impact".[49]
Some digital libraries acquire a license to lend their resources. This may involve the restriction of lending out only one copy at a time for each license, and applying a system ofdigital rights management for this purpose.
TheDigital Millennium Copyright Act of 1998 was an act created in the United States to attempt to deal with the introduction of digital works. This Act incorporates two treaties from the year 1996. It criminalizes the attempt to circumvent measures which limit access to copyrighted materials. It also criminalizes the act of attempting to circumvent access control.[50] This act provides an exemption for nonprofit libraries and archives which allows up to three copies to be made, one of which may be digital. This may not be made public or distributed on the web, however. Further, it allows libraries and archives to copy a work if its format becomes obsolete.[50]
Copyright issues persist. As such, proposals have been put forward suggesting that digital libraries be exempt from copyright law. Although this would be very beneficial to the public, it may have a negative economic effect and authors may be less inclined to create new works.[51]
Another issue that complicates matters is the desire of some publishing houses to restrict the use of digit materials such as e-books purchased by libraries. Whereas with printed books, the library owns the book until it can no longer be circulated, publishers want to limit the number of times an e-book can be checked out before the library would need to repurchase that book. "[HarperCollins] began licensing use of each e-book copy for a maximum of 26 loans. This affects only the most popular titles and has no practical effect on others. After the limit is reached, the library can repurchase access rights at a lower cost than the original price."[52] While from a publishing perspective, this sounds like a good balance of library lending and protecting themselves from a feared decrease in book sales, libraries are not set up to monitor their collections as such. They acknowledge the increased demand of digital materials available to patrons and the desire of a digital library to become expanded to include best sellers, but publisher licensing may hinder the process.
Many digital libraries offerrecommender systems to reduceinformation overload and help their users discovering relevant literature. Some examples of digital libraries offering recommender systems areIEEE Xplore,Europeana, andGESIS Sowiport. The recommender systems work mostly based oncontent-based filtering but also other approaches are used such ascollaborative filtering and citation-based recommendations.[53] Beel et al. report that there are more than 90 different recommendation approaches for digital libraries, presented in more than 200research articles.[53]
Typically, digital libraries develop and maintain their own recommender systems based on existing search and recommendation frameworks such asApache Lucene orApache Mahout.
Digital libraries, or at least their digital collections, also have brought their own problems and challenges in areas such as:
There are many large scale digitisation projects that perpetuate these problems.
Large scale digitization projects are underway atGoogle, theMillion Book Project, andInternet Archive. With continued improvements in book handling and presentation technologies such asoptical character recognition and development of alternative depositories and business models, digital libraries are rapidly growing in popularity. Just as libraries have ventured into audio and video collections, so have digital libraries such as the Internet Archive. In 2016,Google Books project received a court victory on proceeding with their book-scanning project that was halted by the Authors' Guild.[55] This helped open the road for libraries to work with Google to better reach patrons who are accustomed to computerized information.
According to Larry Lannom, Director of Information Management Technology at the nonprofitCorporation for National Research Initiatives (CNRI), "all the problems associated with digital libraries are wrapped up in archiving". He goes on to state, "If in 100 years people can still read your article, we'll have solved the problem."Daniel Akst, author ofThe Webster Chronicle, proposes that "the future of libraries—and of information—is digital".Peter Lyman andHal Variant, information scientists at theUniversity of California, Berkeley, estimate that "the world's total yearly production of print, film, optical, and magnetic content would require roughly 1.5 billion gigabytes of storage". Therefore, they believe that "soon it will be technologically possible for an average person to access virtually all recorded information".[56]
Digital archives are an evolving medium and they develop under various circumstances. Alongside large scale repositories, other digital archiving projects have also evolved in response to needs in research andresearch communication on various institutional levels. For example, during theCOVID-19 pandemic,libraries and higher education institutions have launched digital archiving projects to document life during the pandemic, thus creating a digital, cultural record ofcollective memories from the period.[57] Researchers have also utilized digital archiving to create specializedresearch databases. These databases compile digital records for use on international and interdisciplinary levels. COVID CORPUS, launched in October 2020, is an example of such a database, built in response to scientific communication needs in light of the pandemic.[58] Beyond academia, digital collections have also recently been developed to appeal to a more general audience, as is the case with the Selected General Audience Content of the Internet-First University Press developed by Cornell University. This general-audience database contains specialized research information but is digitally organized for accessibility.[59] The establishment of these archives has facilitated specialized forms of digital recordkeeping to fulfill various niches in online,research-based communication.
This is a field with an incredibly rich, and, as yet, poorly chronicled pre-history and early history. There is a stream of work and ideas that reaches back to at least the turn of the 20th century, and includes such thinkers as H.G. Wells and Paul Otlet; later contributors to the pre-history of visions of new, technologically-enabled means of knowledge organization, access and distribution also include Vannevar Bush and J.C.R. Licklider.
Actually it was 1895 when Paul Otlet together with Henry La Fontaine, who was later awarded the Nobel Peace Prize, started a project –Mundaneum – that was initiated and driven by their idea that, if they would be able to collect all human knowledge and make it accessible to everybody worldwide, then this would bring about peace on Earth.
1696 Milestone – DIALOG, with the ERIC database, provided the first instance of extensive availability of abstracts online for search output.
Special Issue 14th International Conference on Open Repositories 2019 – All The User Needs
| Types of library | |
|---|---|
| Types oflibrarian | |
| Library science |
|
| History | |
| Lists | |
