Evaluation and enrichments
Automatic enrichments can be very beneficial for enabling retrieval across languages and adding context to resources accessible via Europeana.
Initial objectives and charter
The report presents the work carried out over seven months in 2015, during which our group has:
- inventoried relevant semantic enrichment work in the Europeana Network in the past years. We have tried to do this in a way that we hope will facilitate identification and use of services relevant to the application that needs them. This includes general considerations on the diversity of the processes at hand and a focus on interoperability issues.
- further developed criteria to select datasets for semantic enrichment and illustrate with a thorough analysis of selected examples
- explored methodological issues for the evaluation of semantic enrichment services
- performed a quantitative and qualitative evaluation of seven enrichment services on a same subset of the Europeana dataset, containing 17.300 records.
This report, together with its two companion documents and a data space on the Europeana Assembla, presents all this. We have also included, as a conclusion, a number of lessons learned we think should be considered for the design and enhancement of enrichment services as well as for their evaluation.