Evaluation and enrichments

Europeana Tech
Expected timeframe: 27 January 2015 to:   31 October 2015

Automatic enrichments can be very beneficial for enabling retrieval across languages and adding context to resources accessible via Europeana.

Task Force outcomes

Initial objectives and charter

Main report

The report presents the work carried out over seven months in 2015, during which our group has:

  • inventorized relevant semantic enrichment work in the Europeana Network in the past years. We have tried to do this in way that we hope will facilitate identification and use of services relevant for the application that need them. This includes general considerations on the diversity of the processes at hand, and a focus on interoperability issues.

  • further developed criteria to select datasets for semantic enrichment and illustrate with a thorough analysis of selected examples

  • explored methodological issues for the evaluation of semantic enrichment services

  • performed a quantitative and qualitative evaluation of seven enrichment services on a same subset of the Europeana dataset, containing 17.300 records.

This report, together with its two companion documents and a data space on the Europeana Assembla, presents all this. We have also included, as a conclusion, a number of lessons learnt we think should be considered for the design and enhancement of enrichment services as well as for their evaluation.

- Final report from the TaskForce

- Selecting target datasets for semantic enrichment

- Comparative evaluation of semantic enrichments

- Inventory of enrichment efforts and tools initiated in the context of the Europeana Network

Contributors

  • Aitor Soroa (Univ. Basque Country)
  • Cécile Devarenne (Europeana Foundation Data Partners services)
  • Cesare Concordia (ISTI)
  • Daniel Vila Suero (UPM)
  • David Haskiya (Europeana Foundation Product Development)
  • Dimitris Gavrilis (ATHENA research center)
  • Eetu Mäkelä (Aalto)
  • Maarten Brinkerink (Netherlands Institute for Sound and Vision)
  • Marie-Claire Dangerfield (Europeana Foundation Data Partners services)
  • Nikos Simou (NTUA)
  • Nuno Freire (The European Library)
  • Rainer Simon (AIT Austrian Institute of Technology)
  • Rodolphe Bailly (Cité de la Musique)
  • Roxanne Wyns (LIBIS)
  • Ruben Verborgh (ULB)
  • Seth van Hooland (ULB)
  • Vivien Petras (Humboldt-Universität zu Berlin)
  • Vladimir Alexiev (Ontotext)
  • Yorgos Mamakis (EF Dev team)

Editors

  • Antoine Isaac (Europeana Foundation R&D)
  • Hugo Manguinhas (Europeana Foundation R&D)
  • Juliane Stiller (Max Planck Institute for the History of Science)
  • Valentine Charles (Europeana Foundation R&D)