BigQuery
Introduction
BigQuery is Google Cloud’s fully managed, serverless data warehouse that enables fast SQL-based analysis of large datasets. As a data warehouse destiantion, BigQuery can serves as the central data foundation, where raw customer data from multiple sources (e.g., CRM systems, web analytics, transactions, marketing tools) is collected, cleaned, and unified.
Getting started
- Google Cloud Project ID
- BigQuery Dataset
- Access Key (Google Service Account JSON for BigQuery)
Service account configuration
A Service Account is a special account with an id that looks like [email protected]. The account can have a key (or several keys) which is represented by JSON.
Please note, to use Service Account as an authorization mechanism, the resource (google doc, analytics account, add account etc) should be shared with that account.
The easiest way to create Service Account is through Google Cloud Console: go to Navigation ("burger" at top right corner) → IAM & Admin → Service account. Create service account and download key JSON.
There a few other ways (including console utils), please see documentation
The Service Account key can be referred to in a few different ways when setting up BigQuery as a Chord CDP Destination:
auth:
service_account_key: {
"type": "service_account",
"project_id": "<PROJECT_ID>",
"private_key_id": "<PK_ID>",
"private_key": "<PRIVATE_KEY>",
"client_email": "<EMAIL>",
"client_id": "CID",
"auth_uri": "https://accounts.google.com/o/oauth2/auth",
"token_uri": "https://oauth2.googleapis.com/token",
"auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
"client_x509_cert_url": "<CERT_URL>"
}Connecting to the BigQuery CDP destination
- Log into the Chord data platform.
- Navigate to the CDP.
- Click the "Add" button next to Destinations.
- Select BigQuery from the destination catalog.
- Enter in the destination name and these required credentials:
- Project ID
- Dataset
- Access Key
- Click "Create" to connect.
Before connecting destinations in the Chord CDP, please verify with all Destination owners that all non-Chord CDP configured destinations are disabled. Running external destinations alongside configured Chord CDP destinations can result in duplicate events downstream.