Google Sheets to BigQuery (Nightly)

Every night, reads a Google Sheets tab and loads its rows into a BigQuery table through the BigQuery API, so your reports use one data warehouse. Rows are sent with a unique key so a re-run does not create duplicates.

Steps in this flow

  1. Sunday to Thursday 23:00
  2. Google Sheets: read the rows
  3. Shape the rows for BigQuery
  4. BigQuery: insert the rows
  5. Loaded without errors?
  6. Email the data owner: load problem
  7. Record the load

All templates