Skip to content

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

License

Notifications You must be signed in to change notification settings

mescanne/bigquery-utils

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

BigQuery Utils

BigQuery is a serverless, highly-scalable, and cost-effective cloud data warehouse with an in-memory BI Engine and machine learning built in. This repository provides useful utilities to assist you in migration and usage of BigQuery.

Open in Cloud Shell

Getting Started

This repository is broken up into:

  • Scripts - Python, Shell, & SQL scripts
  • UDFs - User-defined functions for common usage as well as migration
    • community - Community contributed user-defined functions
    • teradata - UDFs which mimic the behavior of proprietary functions in Teradata
  • Views - Views over system tables such as audit logs or the INFORMATION_SCHEMA
    • query_audit - View to simplify querying the audit logs which can be used to power dashboards (example).

Public UDFs

All UDFs within this repository will be automatically created under the bqutil project under publicly shared datasets. Queries can then reference the shared UDFs via bqutil.<dataset>.<function>().

Alt text

Contributing

See the contributing instructions to get started contributing.

License

All solutions within this repository are provided under the Apache 2.0 license. Please see the LICENSE file for more detailed terms and conditions.

Disclaimer

This repository and its contents are not an official Google Product.

About

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TSQL 79.6%
  • Shell 20.4%