Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added docs for quota project #6054

Draft
wants to merge 5 commits into
base: current
Choose a base branch
from
Draft

Added docs for quota project #6054

Changes from 3 commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
41aabd8
Added docs for quota project
jcarpenter12 Sep 11, 2024
78c5405
Updated wording
jcarpenter12 Sep 13, 2024
6970cc4
Merge branch 'current' into feature/add-quota-project-option
runleonarun Sep 19, 2024
cdfe6f8
Apply suggestions from code review
matthewshaver Sep 19, 2024
a5a24f9
Merge branch 'current' into feature/add-quota-project-option
matthewshaver Sep 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions website/docs/docs/core/connect-data-platform/bigquery-setup.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -388,6 +388,26 @@ my-profile:
execution_project: buck-stops-here-456
```

### Quota project

By default, dbt will use the `quota_project_id` set within credentials of the account you are using to authenticate to BigQuery
matthewshaver marked this conversation as resolved.
Show resolved Hide resolved

Optionally, you may specify `quota_project` to bill for query execution, instead of the default quota project specified for the account from the environment.
matthewshaver marked this conversation as resolved.
Show resolved Hide resolved

This can sometimes be required when impersonating service accounts that do not have the BigQuery API enabled within the project they are defined in. Without overriding the quota project it will fail to connect.
matthewshaver marked this conversation as resolved.
Show resolved Hide resolved

```yaml
my-profile:
target: dev
outputs:
dev:
type: bigquery
method: oauth
project: abc-123
dataset: my_dataset
quota_project: my-bg-quota-project
```

### Running Python models on Dataproc

To run dbt Python models on GCP, dbt uses companion services, Dataproc and Cloud Storage, that offer tight integrations with BigQuery. You may use an existing Dataproc cluster and Cloud Storage bucket, or create new ones:
Expand Down
Loading