Streamline Snowflake Queries: Filter Columns with ILIKE Patterns

The post discusses the challenges of querying large data tables, particularly with similarly named columns. It introduces the ILIKE keyword in Snowflake for case-insensitive searches to simplify SQL queries. The author provides a practical SQL example using weather data, highlighting the efficiency of ILIKE in reducing query costs by targeting specific column patterns.

Foundational Principles in Data Engineering: Staying Grounded Amidst Tech Trends

As I scroll through social media – LinkedIn, X, Reddit, and even Facebook, I see many posts and advertisements for various solutions in the data space. Some are for entirely new data solutions such as Snowflake, Databricks, and BigQuery. Others are for ETL/ELT tools offering to solve an age-old problem – collecting data in one place. Still,Continue reading “Foundational Principles in Data Engineering: Staying Grounded Amidst Tech Trends”

Python Byte: Loading Data to Snowflake from SQL Server

For a recent proof of concept, I needed to transfer data from five or six relatively small tables from SQL Server to Snowflake. Normally, I would go through all the steps to set up an ingestion pipeline in Snowflake; however, for a POC, that all seemed like overkill. I simply needed to copy the dataContinue reading “Python Byte: Loading Data to Snowflake from SQL Server”