An introduction to data testing – a presentation
Recently I attended Measurecamp Melbourne and gave an introductory talk about data testing. In it I covered the different types of “bad data” and some tools and approaches to test …
Analytical – Honest – Passionate
Recently I attended Measurecamp Melbourne and gave an introductory talk about data testing. In it I covered the different types of “bad data” and some tools and approaches to test …
When using SQLfluff to format sql files it is possible to set certain formatting rules that should be followed when formatting the the files. These rules can be specified in …
SQL is a very flexible language when it comes to formatting. As long as the commands and syntax are in the right order then the SQL query will work. Whitespace …
A previous post showed how to set a ‘daily query usage‘ quota in BigQuery, and what that quota should be to stay within the free tier of BigQuery. Well, what …
In BigQuery there is a free tier for querying data. As long as less than 1 tebibyte of data is queried in a month there are no charges associated with …
SQLite is a great choice for doing data analytics locally. SQLite is a robust database that has been battle tested for over a decade. It is a single file which …
If a particular user has been added read access to a table these permissions can be removed using the REVOKE keyword in SQL:
A code snippet to add a user as read only on a BigQuery table. To add different permissions, other BigQuery roles can be seen in the Google documentation.
A collection of video resources to on using and understanding SQLite. SQLite case study SQLite with Python SQLite for beginners …although some of the topics don’t seem like beginner topics …
In BigQuery when running a query, the costs associated with doing so include a “scan” of the data that may be processed as part of executing the query. For example, …