MarquinSmith

Analytical – Honest – Passionate

  • Home
  • Services
  • Mini Projects
    • Data Analytics Helper Tools
    • Bitcoin Price Dashboard
    • Journey to data engineering
    • Tarantino Film Dashboard
    • Woolworths stock price tracker
    • How to reason and argue
  • Reference
    • The BookShelf
    • SQL Cheat Sheet
    • Dockerfile Cheat Sheet
  • Health, fitness and wellbeing
    • Crossfit Workouts
    • Gymnastics
    • Strength and fitness masterclass
    • Nutrition Course
    • Workout Stats
    • Physical Activity Stats
    • 6 week pre season soccer fitness plan
  • About

Category: Automation

Automation

A command line tool to compare 2 different csv files – sweetviz edition

4th November 20254th November 2025 M SmithLeave a comment

In a previous post we used sweetviz to make a summary of a csv file, and ydata profiling to compare 2 different csv files. Well Sweetviz can also be used …

Read More ›
Automation

A `.sqlfluff` settings file I like

26th October 202526th October 2025 M SmithLeave a comment

When using SQLfluff to format sql files it is possible to set certain formatting rules that should be followed when formatting the the files. These rules can be specified in …

Read More ›
Automation

Setting up sqlfluff as a pre commit hook using UV

23rd October 202523rd October 2025 M SmithLeave a comment

SQL is a very flexible language when it comes to formatting. As long as the commands and syntax are in the right order then the SQL query will work. Whitespace …

Read More ›
Automation

A command line tool to compare 2 different csv files

20th September 202520th September 2025 M SmithLeave a comment

Below is a python script that uses the ydata-profiling library to create a report that compares two csv files. This is proving useful in verifying the similarity between original and …

Read More ›
Automation

Pre commit hooks in git YouTube resources

3rd September 2025 M SmithLeave a comment

A collection of YouTube videos I have found useful in learning about hooks in Git. In no particular order:

Read More ›
Automation

Archive (tar + gzip) a folder using bash

24th July 202523rd July 2025 M SmithLeave a comment

The following command will create a gzipped (compressed) tar file (many files into one file) for a folder called “Downloads”. In other words all the files and folders in the …

Read More ›
Automation

Python script to send an email with Sendgrid API

5th July 2025 M SmithLeave a comment

A short python script that uses the Sendgrid API to send a basic email.

Read More ›
Automation

gitleaks – a tool for detecting secrets

2nd July 2025 M SmithLeave a comment

I came across this great tool today called gitleaks. This tool will search through directories and git repos (all locally) to see if it can find any secrets, API keys, …

Read More ›
Automation

How to revoke read access to a single table in BigQuery using SQL

29th June 202528th June 2025 M SmithLeave a comment

If a particular user has been added read access to a table these permissions can be removed using the REVOKE keyword in SQL:

Read More ›
Automation

Copy a BigQuery model into another dataset using bq command line tool

27th June 202527th June 2025 M SmithLeave a comment

When creating or building a BigQuery Machine Learning model, the model itself is stored inside a BigQuery dataset. The code snippet below shows how to move a model from one …

Read More ›

Posts pagination

1 2

Recent Posts

  • A command line tool to compare 2 different csv files – sweetviz edition
  • Bots arrive on marquinsmith.com
  • Physical Health Tracker – October 2025
  • Jeff Booth conversation on Simply Bitcoin
  • A `.sqlfluff` settings file I like

Categories

  • Automation
  • Business
  • cybersecurity
  • Data Analysis
  • Finance
  • Personal Development
  • Python
  • Uncategorised
  • Web Analytics

Archives

Copyright © 2025 MarquinSmith.
Theme Easthill by ThemeMunk. Powered by WordPress.