How to Connect to Google BigQuery in Precog
Set up Google BigQuery as a Precog destination
This guide explains how to configure Google BigQuery as a destination in Precog. Google BigQuery is a fully managed, serverless data warehouse on Google Cloud. To connect Precog, you’ll need credentials created in the Google Cloud Console, which requires your organization’s billing details.
Step 1: Create a BigQuery project
- Go to Google Cloud Console.
- If this is your first time using Cloud Console, select your country and accept the terms of service.
- If this is your first time using Cloud Console, select your country and accept the terms of service.
- Open the Navigation menu (☰ on the top left), and select BigQuery.
- Or, type BigQuery in the search bar.
- Or, type BigQuery in the search bar.
- At the top of the page, open the Project Selector (directly to the right of the words “Google Cloud”).
- If this is your first project, click Create Project.
- If this is your first project, click Create Project.
- Name the project “precog” (or another meaningful name). Choose your organization if prompted, then click Create.
- Enable billing for the project.
- If this is your first project, enter your billing information, click Enable Billing, then Set Account.
- If this is your first project, enter your billing information, click Enable Billing, then Set Account.
- Confirm your new project is selected in the Project Selector at the top of the page.
Step 2: Create a service account
- From the Navigation menu, go to IAM & Admin > Service Accounts.
- Or, search for Service Accounts in the search bar.
- Or, search for Service Accounts in the search bar.
- Click Create Service Account.
- Enter a name (e.g., precog) and description, then click Create and continue.
- The Service Account ID will autofill.
- The Service Account ID will autofill.
- Under Select a role, choose Basic > Owner.
- Click Done.
- The new service account will have an email address using both the service account and project name, similar to precog@precog-demo.iam.gserviceaccount.com.
- The new service account will have an email address using both the service account and project name, similar to precog@precog-demo.iam.gserviceaccount.com.
Step 3: Generate and download a key
- Open your new service account by clicking its email address.
- Go to the Keys tab.
- Click Add Key > Create new key.
- Choose JSON as the key type.
- A JSON key file will download automatically, named with your project (e.g., precog-demo-693acd220d7c.json).
- A JSON key file will download automatically, named with your project (e.g., precog-demo-693acd220d7c.json).
- Save this key file in a secure location.
Step 4: Connect Precog
- In the Precog destination configuration form, upload the JSON key file as the Google service account key file.