Data Engineering

Data quality culture

Focuses on Data Quality and building a data-driven culture, creators of Airflow.

Modern Data Stack center

Defines the Analytics Engineer role, applying software engineering rigor to SQL; the cultural center of the Modern Data Stack.

Data plumbing focus

Focuses on the plumbing—Kafka, Hadoop, Spark—and moving data reliably.

Data industry strategy

Strategic thinking on data analysis and the data industry.

Independent data analysis

Independent data news and analysis.

Visual data storytelling

Visual data storytelling and charts.

Vendor hype critique

Brutally honest critique of vendor hype, advocating for boring, reliable technology.

Kafka & data in motion

The home of Kafka, explaining the shift from Data at Rest to Data in Motion.

E2E portfolio projects

Creates massive, end-to-end portfolio projects building complete pipelines.

Data science news & trends

Data science news, trends, and resources.

Tool creator interviews

Deep dives with tool creators exploring the why behind design decisions.

Data systems heavy lifting

Covers the heavy lifting of data systems: moving terabytes, managing Kafka streams, and optimizing Snowflake costs.

Pandas authority

Authority on Python's data stack, particularly Pandas for transformations.

Lakehouse paradigm

The Lakehouse Leader detailing how to unify streaming/batch data and govern data for AI.

Lakehouse paradigm

Essential for understanding the Lakehouse paradigm.

Technical DE deep dives

Zach Wilson's technical deep dives into data engineering.

Airflow & Spark deep

Community favorite for deep technical tutorials on Airflow and Spark.

DE fundamentals insights

Rants and insights on data engineering fundamentals.

Airflow operations

Focuses on the operational side, with tutorials on Airflow and containers.

Data project ideation

Focuses on career and project ideation, often involving significant data engineering.

Data team organization

Focuses on the organization of data teams, Analytics Engineering roles, and career ladders.

Data catalogs & governance

Data catalogs, governance, and metadata management.

Data observability focus

Focuses on observability and reliability in data stacks.

Data career advice

Data career advice and tech insights.

MDS business value

Evaluates the Modern Data Stack based on business value and ROI.

Data tool selection focus

Focuses on value delivery and tool selection (e.g., Airflow vs. Prefect) for the Data Consultant.

DE entry roadmap

Offers a structured roadmap for entering the field and necessary skills.

Data sharing & governance

Focuses on data sharing, governance, and running Python/AI directly inside the warehouse.

Platform deep dives

Provides deep dives into their platform capabilities and storage layer.

MDS critique & ROI

Consultant view critiquing the Modern Data Stack and focusing on Data ROI.

Petabyte-scale reality

Discusses the reality of petabyte-scale data and actual engineering needs.