ODK Central includes an OData endpoint that can be accessed by tools and languages that support RESTful web services. Both Tableau and PowerBI support OData, allowing users to download survey submissions for immediate analysis. But what about other scenarios? A common requirement is to retrieve ODK submissions, extract the survey data and load it into a data portal or a relational database. ODK Central supports this use case as well.
The goal of this post is to show how survey data can be processed using an open source data integration tool (Kettle). We retrieve submissions from a survey hosted on the ODK Central sandbox server, transform the JSON document into a set of rows, then load the rows into a dataset stored in a CKAN data portal. The workflow is implemented using a small number of Kettle steps and can be freely modified by anyone in the open source community. Additional scenarios are discussed and documentation links are provided at the end.
The complete post can be found at https://github.com/schemetrica/automating-data-delivery-odk-central.