This presentation is part of the WikiSym + OpenSym 2013 program.

Florian Marienfeld; Ina Schieferdecker; Evanela Lapi; Nikolay Tcholtchev

A key challenge for open data portals is the aggregation of metadata from various data catalogs (on different administrative level or from different application fields) also knownas metadata harvesting.  This paper describes harvesting at the pilot of the German open government portal Gov-Data.de, which is scheduled to become the data portal forall German public administration levels. At the launch of the pilot portal in February 2013, eleven federal, state and local data catalogs where integrated and produced about 2,000 open data sets. In the meantime, the data sets were increased to over 3,100 data sets mainly due to improved harvesting capabilities of the portal. This paper discusses the central meta data schema and experiences with the different harvesting techniques that are in use at Gov-Data.de: CKAN-Harvest, CKAN-API, CSW-Harvest and JSON-Dump.

A PDF file will be made available on August 5, 2013, through the WikiSym + OpenSym 2013 conference proceedings.