Preface 📖 Disclaimer: This article assumes you have a proficient level of Python programming knowledge. …

SOLID principles are a set of principles that guide the software engineering process aiming to make code easier to read, test and maintain. This is a concept coming from Object Oriented Programming that was made popular by Robert Martin (commonly referred to as Uncle Bob by the software engineering community). What SOLID stands for …

I’m in a hurry, where is the code? Here: https://github.com/TJaniF/airflow-elt-blueprint Are you a data professional who knows their way around Python code, and wants to get started with Airflow without reading a tutorial or having to install any packages? Or maybe you’ve used Airflow before and want to explore new…

The Query Acceleration Service (QAS) is now generally available to all Snowflake Accounts — Enterprise edition and up. It is a feature that allows Snowflake virtual warehouses to have essentially boundless amount of resources as it needs to accelerate parts of queries. What is Query Acceleration Service? It’s a common situation where a virtual warehouse…

Take your efficiency to the next level with these Pandas and Python Tricks! — Motivation This blog regroups all the Pandas and Python tricks & tips I share on a basis on my LinkedIn page. I have decided to centralize them into a single blog to help you make the most out of your learning process by easily finding what you are looking for. The…

Discover the 3 Data Lineage categories we defined from our state-of-the-art exploration — During my Data Engineering internship at Back Market, I focused on the design and integration of a data lineage platform for our internal data consumers. This article gathers the key lessons I learned about how to identify the different types of Data Lineage quickly. …

Pure SQL and SQL within Python In this post, we will explore some SQL code using the SQLite3 flavour. We will also code the same SQLite3 flavour in Python with Python3 and SQLite3. By the end of this post you will be able to: Create a local database on your machine Add tables to your database …

A comparison between different topic modeling strategies including practical Python examples — Table of contents Introduction Topic Modeling Strategies 2.1 Introduction 2.2 Latent Semantic Analysis (LSA) 2.3 Probabilistic Latent Semantic Analysis (pLSA) 2.4 Latent Dirichlet Allocation (LDA) 2.5 Non-negative Matrix Factorization (NMF) 2.6 BERTopic and Top2Vec Comparison Additional remarks 4.1 A topic is not (necessarily) what we think it is 4.2 Topics are not easy to…

Snowsight Overview Since last year the Snowflake team has added large improvements to its user interface including improvements such as auto-complete, a minimalistic visualization layer, and even dashboarding capabilities. With this, it creates the perfect solution to easily be able to add additional monitoring capabilities on top of the ACCOUNT_USAGE schema that’s…