Marketing Data Collection And Visualization

This is an ongoing project where we have set up background jobs to collect data on a daily basis and update the database that powers the marketing reports. 

The objective is to connect with and extract data from several ad-serving platforms like Google Ads, Facebook, Snapchat, Bing Ads, Spotify, etc. and extract data about the ads as required by Scale Marketing. This data is then cleaned up, formatted and stored in CSV files on S3. From here, the data is then pushed to AWS Athena and on to Tableau to power the daily marketing reports.

One challenging aspect in this project is that not all services offer an API. We are required to be innovative to figure out how to get data out of these services.