The Delving Platform: The Big Picture

Step 1

The process starts with XML. This can come from a propriety system as an XML dump or from an OAI-PMH harvest, it does not matter. The only thing that matters is that the XML is encoded in UTF-8 and that there is a clear record structure.

Step 2

Load the XML into the Delving SIP-Creator. Here the XML is analyzed and statistics are generated to give a very clear picture of the data.

The process of mapping - in its simplest form - is a matter of pointing and clicking. Click on a field in the source data and then point to a corresponding field in the output structure. More complex mappings are also possible. For example: combining several input fields to one output field, or splitting the data of one input field into multiple output fields. Another common use-case is adding string constants (perhaps for generating URL's to images) or reformatting dates. Once the mapping is complete and validated, it is ready to be upload to the Culture-Hub.

Step 3

The Culture-Hub is where the uploaded data (now called a Dataset) is managed. A Dataset definition is first created containing its basic information. Then the source data and the mapping is uploaded from the SIP-Creator to the Culture-Hub. Multiple Datasets can be uploaded and managed and there is even the possibility to create Virtual Collections from queries combining different Datasets.

From this point onwards there are several options. The Culture-Hub can be used as a front-end for the Datasets where they can be browsed and searched online. The Datasets can also be accessed remotely from another website via the Search API. For this last option there is also the Delving Instant: a javascript/css library which quickly and easily gives access to the API and has all the display and pagination functionality for the search results built-in. Another option is making the Datasets available for OAI-PMH harvesting by large aggregators such as Europeana.

Request more info