Analytical – Honest – Passionate
A short guide on installing and authorising gcloud on ubuntu 26.04 LTS. gcloud is a command line tool that allows you to interact with Google Cloud Platform services such as …
Recently I attended Measurecamp Melbourne and gave an introductory talk about data testing. In it I covered the different types of “bad data” and some tools and approaches to test …
A previous post showed how to set a ‘daily query usage‘ quota in BigQuery, and what that quota should be to stay within the free tier of BigQuery. Well, what …
In BigQuery there is a free tier for querying data. As long as less than 1 tebibyte of data is queried in a month there are no charges associated with …
If a particular user has been added read access to a table these permissions can be removed using the REVOKE keyword in SQL:
A code snippet to add a user as read only on a BigQuery table. To add different permissions, other BigQuery roles can be seen in the Google documentation.
When creating or building a BigQuery Machine Learning model, the model itself is stored inside a BigQuery dataset. The code snippet below shows how to move a model from one …
A code snippet showing how to trigger a DAG in Cloud Composer (managed Airflow) using the gcloud command line tool.
In BigQuery when running a query, the costs associated with doing so include a “scan” of the data that may be processed as part of executing the query. For example, …
A code sample to create a random forest machine learning model in BigQuery and make predictions all using SQL.