Wiki API Connector - Simplifying ETL workflows from open APIs to Wikidata/Commons
2021-10-30, 18:50–19:15 (UTC), Room 2

Wiki API Connector aims to simplify the extract-transform-load (ETL) process of metadata to Wikimedia projects without requiring complicated coding or software development. It was originally created as a tool to facilitate the import of Smithsonian Institution images and metadata to Commons and Wikidata (as a Wikibase-aware analog of GLAM Wiki Toolset or Pattypan). With the main core written in Python, the use of a familiar YAML configuration file to map an API's JSON fields to Wikidata properties and items might be a general solution useful for other GLAM entities or partner organizations. This session describes the early work done so far and seeks feedback on how it might be useful for other users and applications.


What will the participants take away from this session?

Participants will understand the possible applications for a tool for helping to do Wikidata and Commons data ingestion without coding. They will also be able to provide feedback on the design as well as describe and request features they'd like to see in future iterations.

Language

English

Recording

Yes

Other links

Lightning talk version from WikiConference North America 2021, though this talk for WikidataCon would be much more expanded and include discussion - https://docs.google.com/presentation/d/1Xmba-8xwB3qyIMew_dY3SFSFndRP03fHwcFAe7FazTI/edit#slide=id.g35f391192_00

Link to notes

https://etherpad.wikimedia.org/p/WikidataCon2021-WikiAPIConnectorSimplifyingETL

Link to slides

https://docs.google.com/presentation/d/1Fbynx_9hDWoiEURn4KoqMl6Rm4ymYl0BShe_tlS7jBA/edit#slide=id.g35f391192_00

Andrew Lih is Wikimedian at Large for the Smithsonian Institution in the United States and the Wikimedia Strategist for The Met Museum in New York City.

This speaker also appears in: