Google Sheets to BigQuery (Nightly)
Every night, reads a Google Sheets tab and loads its rows into a BigQuery table through the BigQuery API, so your reports use one data warehouse. Rows are sent with a unique key so a re-run does not create duplicates.
Steps in this flow
- Sunday to Thursday 23:00
- Google Sheets: read the rows
- Shape the rows for BigQuery
- BigQuery: insert the rows
- Loaded without errors?
- Email the data owner: load problem
- Record the load