Artificial Intelligence for Content and Context Metadata Retrieval in Photographs and Image Groups

Fornaro, Peter; Chiquet, Vera (2020). Artificial Intelligence for Content and Context Metadata Retrieval in Photographs and Image Groups Archiving Conference, 17(1), pp. 79-82. Society for Imaging Sciences and Technology 10.2352/issn.2168-3204.2020.1.0.79

Text ARCHIVING_2020_art00016_Peter-Fornaro.pdf - Published Version Restricted to registered users only Available under License Publisher holds Copyright. Download (263kB) | Request a copy

Digitization projects of analog photographic collections are still growing in number, and therefore such assets of images become bigger continuously. Also, there is a strong trend towards open data and interfaces to access and reuse the image resources (FAIR data). To be able to search and find images in a repository, metadata of a certain depth must be existing. Typically, indexing and valorization, done by experts that know the (photographic) collections, is necessary to achieve such meta-information. There are various metadata standards based on different concepts for the description of collections. Some, like ISAD(G), are more related to the physical structure of archives, others, like CIDOC-CRM, take into account the content of the images in detail. Enhancing the depth of indexing increases the time necessary drastically. It is also a task that is not easily scalable because specific content related knowledge is necessary. With the assistance of artificial intelligence, historic photographic collections could potentially be enhanced with metadata semi-automatically. For the successful application of machine learning, it is essential to have robust training sets. In the presented paper, we show our observations in monitoring participants indexing historic collections of photographs. In the observations of workshops of people working with photographic heritage, it was monitored how single photographs but also image groups are described. Based on that knowledge, machine learning components can be trained and optimized for that particular type of source material. The demonstrated approach has the potential to support the work of valorization substantially. In addition, the approach has, to some extent, the potential to preserve the fundamental structures of knowledge of contemporary witnesses.

Item Type:	Journal Article (Original Article)
Division/Institute:	Bern Academy of the Arts Bern Academy of the Arts > Institute of Design Research
Name:	Fornaro, Peter and Chiquet, Vera
Subjects:	A General Works > AC Collections. Series. Collected works A General Works > AS Academies and learned societies (General) A General Works > AZ History of Scholarship The Humanities H Social Sciences > H Social Sciences (General) H Social Sciences > HM Sociology H Social Sciences > HT Communities. Classes. Races T Technology > TR Photography
ISSN:	2161-8798
Publisher:	Society for Imaging Sciences and Technology
Language:	English
Submitter:	Vera Chiquet
Date Deposited:	08 Nov 2023 10:34
Last Modified:	17 Nov 2023 11:10
Publisher DOI:	10.2352/issn.2168-3204.2020.1.0.79
ARBOR DOI:	10.24451/arbor.20343
URI:	https://arbor.bfh.ch/id/eprint/20343