MarquinSmith

Analytical – Honest – Passionate

  • Home
  • Services
  • Mini Projects
    • Data Analytics Helper Tools
    • Bitcoin Price Dashboard
    • Journey to data engineering
    • Tarantino Film Dashboard
    • Woolworths stock price tracker
    • How to reason and argue
  • Reference
    • The BookShelf
    • SQL Cheat Sheet
    • Dockerfile Cheat Sheet
  • Health, fitness and wellbeing
    • Crossfit Workouts
    • Gymnastics
    • Strength and fitness masterclass
    • Nutrition Course
    • Workout Stats
    • Physical Activity Stats
    • 6 week pre season soccer fitness plan
  • About

Category: Data Analysis

Data Analysis

Export BigQuery table to Google Cloud Storage

10th October 202415th October 2024 M SmithLeave a comment

A code example for how to write BigQuery SQL to export a table to Google Cloud Storage in csv and parquet file formats. Parquet CSV

Read More ›
Business

Data Ops Crash Course

8th October 202415th October 2024 M SmithLeave a comment

Data Ops, AKA Dev Ops for data. Essential content for learning about improving the velocity of development and effective maintenance of data products (products produced by data teams). Christopher Bergh …

Read More ›
Data Analysis

Pandas for data analysis – Video mega guide

7th October 20246th October 2024 M SmithLeave a comment

Pandas is the go to library in Python for analysing and manipulating data. This post lists some useful video resources for learning this package. Brandon Rhodes – Pandas From The …

Read More ›
Data Analysis

Using SQL in Google Sheets

11th August 202410th August 2024 M SmithLeave a comment

SQL is a great language for analysing and slicing and dicing data. The folks at Google who build Google Sheets appreciate this too. So much so that they have built …

Read More ›
Data Analysis

Execute queries in BigQuery in parallel using python

10th August 202410th August 2024 M SmithLeave a comment

An example of how to run multiple queries in parallel.

Read More ›
Data Analysis

Copying BigQuery tables to a new dataset with bq command line tool

28th July 202428th July 2024 M SmithLeave a comment

With the bq command line tool moving multiple tables at a time from one BigQuery dataset to another can be done with a few lines of code. The tool can …

Read More ›
Data Analysis

Simple logging to SQLite database from python

5th July 20245th July 2024 M SmithLeave a comment

A lightweight example of saving some logs to an SQLite database in a python script.

Read More ›
Data Analysis

From email to data warehouse – Google Edition

4th July 20246th July 2024 M SmithLeave a comment

Use the Google technology stack to automatically load csv files received over email into BigQuery. In the data world, sending data over email is something that has been around for …

Read More ›
Data Analysis

Running SQL Queries on a schedule in BigQuery | Part 1: Scheduled Queries

28th June 202428th June 2024 M SmithLeave a comment

A short walkthrough guide of setting up a scheduled query in BigQuery. The Google documentation for scheduled queries is here. Step 1: Create a query in the bigQuery interface that …

Read More ›
Data Analysis

Query Google Sheets from BigQuery

31st March 202431st March 2024 M SmithLeave a comment

Important and valuable data is often kept in Google Sheets. Learn how to make use of this data from within BigQuery in this post. Google sheets is a very useful …

Read More ›

Posts pagination

1 2 3 4 5 6

Recent Posts

  • Learn Hard Concepts by Colin Galen
  • Self improvement inspired by the founders – Art of Manliness
  • Python script to send an email with Sendgrid API
  • gitleaks – a tool for detecting secrets
  • All roads lead to SQLite

Categories

  • Automation
  • Business
  • cybersecurity
  • Data Analysis
  • Finance
  • Personal Development
  • Python
  • Uncategorised
  • Web Analytics

Archives

Copyright © 2025 MarquinSmith.
Theme Easthill by ThemeMunk. Powered by WordPress.