MarquinSmith

Analytical – Honest – Passionate

  • Home
  • Services
  • Mini Projects
    • Data Analytics Helper Tools
    • Bitcoin Price Dashboard
    • Journey to data engineering
    • Tarantino Film Dashboard
    • Woolworths stock price tracker
    • How to reason and argue
  • Reference
    • The BookShelf
    • SQL Cheat Sheet
    • Dockerfile Cheat Sheet
  • Health, fitness and wellbeing
    • Crossfit Workouts
    • Gymnastics
    • Strength and fitness masterclass
    • Nutrition Course
    • Workout Stats
    • Physical Activity Stats
    • 6 week pre season soccer fitness plan
  • About

Tag: bash

Automation

Archive (tar + gzip) a folder using bash

24th July 202523rd July 2025 M SmithLeave a comment

The following command will create a gzipped (compressed) tar file (many files into one file) for a folder called “Downloads”. In other words all the files and folders in the …

Read More ›
Automation

Copy a BigQuery model into another dataset using bq command line tool

27th June 202527th June 2025 M SmithLeave a comment

When creating or building a BigQuery Machine Learning model, the model itself is stored inside a BigQuery dataset. The code snippet below shows how to move a model from one …

Read More ›
Automation

Trigger an Airflow DAG in Google Cloud Composer using gcloud command line tool

25th June 2025 M SmithLeave a comment

A code snippet showing how to trigger a DAG in Cloud Composer (managed Airflow) using the gcloud command line tool.

Read More ›
Automation

Loading data into SQLite

23rd June 202523rd June 2025 M SmithLeave a comment

Different approaches to load data into a SQLite database using the following Python libraries: Pandas Using the pandas library (alongside click, and uv) to load a csv file into a …

Read More ›
Automation

A command line tool to get csv summaries using Sweetviz

22nd June 2025 M SmithLeave a comment

Working with data involves handling a lot of data files, most commonly CSV files. It can be very helpful to do some exploratory data analysis on the CSV file to …

Read More ›
Automation

List users who have access to a dataset in BigQuery

18th June 202518th June 2025 M SmithLeave a comment

Use the bq command line tool to list the users who have access to a particular dataset in BigQuery

Read More ›
Automation

Set expiration table on existing Bigquery tables

11th June 202511th June 2025 M SmithLeave a comment
Read More ›
Automation

Running Python scripts using UV

6th March 20256th March 2025 M SmithLeave a comment

In case you haven’t heard, UV is a relatively new python package and project manager. UV allows for you to define package dependencies and the Python version to run the …

Read More ›
Data Analysis

Copying BigQuery tables to a new dataset with bq command line tool

28th July 202428th July 2024 M SmithLeave a comment

With the bq command line tool moving multiple tables at a time from one BigQuery dataset to another can be done with a few lines of code. The tool can …

Read More ›
Data Analysis

Loop through lines in a file BASH

13th August 202316th September 2023 M SmithLeave a comment
Read More ›

Posts pagination

1 2

Recent Posts

  • Archive (tar + gzip) a folder using bash
  • Set a daily query usage quota in BigQuery
  • Learn Hard Concepts by Colin Galen
  • Self improvement inspired by the founders – Art of Manliness
  • Python script to send an email with Sendgrid API

Categories

  • Automation
  • Business
  • cybersecurity
  • Data Analysis
  • Finance
  • Personal Development
  • Python
  • Uncategorised
  • Web Analytics

Archives

Copyright © 2025 MarquinSmith.
Theme Easthill by ThemeMunk. Powered by WordPress.