Repo that contains code to automate data ingestion(upstream gdrive,Website,SqlDB) to Downstream(Bigquery) Visualization in Looker
I've written a code using Google APIs to automate the ingestion of data from APIs,Google Drive to GCS. Dataflow to loaddata from GS to BQ.
If you're working on cloud function, use requirements_cloud.txt. The code has a couple of changes similarly. Highly recommend working locally since it takes about 6 mins for every run of a cloud function.If you're working on your local machine, use requirements_local.txt. To install this file, use pip install -r requirements_local.txt
.
##Figma Design of the Dashboard
##Actual Dashboard in Looker Admin_Dashboard 2022-12-13T1526.pdf