Extract, Transfer, Load (ETL) projects – Compass Mentis – Coen de Groot
Summary
Having done a number of ETL projects, I’ve had to deal with: • Learning new APIs, including Amazon MWS, AppFigures, Square, TicketSocket Enterprise and Premiere, HubSpot and Google BigQuery • For each API, handling authentication and authorisation, and testing using a sandbox environment (if possible) or on live data (if necessary) • Tracking what is already transferred, in case of failure or to facilitate a regular process • Extracting what still needs transferring. Somewhat surprisingly, this is not always well catered for • Running and controlling the ETL process, for instance as a Flask application or a Singer Tap Some of my ETL projects have come from the UpWork contract market place and can be seen on my UpWork profile. These all gained a 5 star review and some very positive feedback. He is proactive, reads requirements thoroughly, investigates challenges, and has excellent communication habits and skills. He was able to build out a tool that we needed for months in about a week” Contact me if you’ve got some data that needs moving