MarquinSmith

Analytical – Honest – Passionate

  • Home
  • Services
  • Mini Projects
    • Data Analytics Helper Tools
    • Bitcoin Price Dashboard
    • Journey to data engineering
    • Tarantino Film Dashboard
    • Woolworths stock price tracker
    • How to reason and argue
  • Reference
    • The BookShelf
    • SQL Cheat Sheet
    • Dockerfile Cheat Sheet
  • Health, fitness and wellbeing
    • Crossfit Workouts
    • Gymnastics
    • Strength and fitness masterclass
    • Nutrition Course
    • Workout Stats
    • Physical Activity Stats
    • 6 week pre season soccer fitness plan
  • About

Tag: bash

Automation

Loading data into SQLite

23rd June 202523rd June 2025 M SmithLeave a comment

Different approaches to load data into a SQLite database using the following Python libraries: Pandas Using the pandas library (alongside click, and uv) to load a csv file into a …

Read More ›
Automation

A command line tool to get csv summaries using Sweetviz

22nd June 2025 M SmithLeave a comment

Working with data involves handling a lot of data files, most commonly CSV files. It can be very helpful to do some exploratory data analysis on the CSV file to …

Read More ›
Automation

List users who have access to a dataset in BigQuery

18th June 202518th June 2025 M SmithLeave a comment

Use the bq command line tool to list the users who have access to a particular dataset in BigQuery

Read More ›
Automation

Set expiration table on existing Bigquery tables

11th June 202511th June 2025 M SmithLeave a comment
Read More ›
Automation

Running Python scripts using UV

6th March 20256th March 2025 M SmithLeave a comment

In case you haven’t heard, UV is a relatively new python package and project manager. UV allows for you to define package dependencies and the Python version to run the …

Read More ›
Data Analysis

Copying BigQuery tables to a new dataset with bq command line tool

28th July 202428th July 2024 M SmithLeave a comment

With the bq command line tool moving multiple tables at a time from one BigQuery dataset to another can be done with a few lines of code. The tool can …

Read More ›
Data Analysis

Loop through lines in a file BASH

13th August 202316th September 2023 M SmithLeave a comment
Read More ›
Python

Scheduling cron jobs with python in virtual environments

2nd November 2017 M Smith9 Comments

Recently I spent an embarrassingly long time trying to figure out how to set up a cron job to run a python script I had recently created. Before you snicker …

Read More ›

Recent Posts

  • Loading data into SQLite
  • A command line tool to get csv summaries using Sweetviz
  • Sample data from a BigQuery table
  • Create a Random Forest ML model in Bigquery and use it to make predictions
  • Load data into a BigQuery table from Google Cloud Storage using SQL

Categories

  • Automation
  • Business
  • cybersecurity
  • Data Analysis
  • Finance
  • Personal Development
  • Python
  • Uncategorised
  • Web Analytics

Archives

Copyright © 2025 MarquinSmith.
Theme Easthill by ThemeMunk. Powered by WordPress.