dagctl blog

Technical guides for production data teams

Deep dives on running SQLMesh and dbt-core at scale — infrastructure, CI/CD, scheduling, and the sharp edges nobody warns you about.

Subscribe via RSS

Latest Vision

Data Engineering, Industrialized

Data engineering is still a craft — bespoke pipelines, artisanal deployments, and heroic on-call rotations. That's not a talent problem. It's a production system problem. Here's what the industrial era looks like.

Scotty Pate Mar 16, 2026 3 min read

Engineering

SQLMesh for dbt Users: The Mental Model Shifts That Matter

A practical guide for experienced dbt users evaluating or migrating to SQLMesh — covering the real differences in how environments, deployments, state, and incremental models work.

Feb 27, 2026 11 min read

Engineering

Operating SQLMesh in Production: State, Scheduling, and Observability

How SQLMesh state works under the hood, how to set up scheduling with the built-in scheduler or external orchestration, and what to monitor in a running production system.

Feb 20, 2026 12 min read

Engineering

Running SQLMesh in Production: Infrastructure, CI/CD, and Deployment

How to containerize SQLMesh, set up CI/CD pipelines with the plan workflow, configure multi-environment deployments, and avoid the infrastructure mistakes that bite teams in production.

Feb 13, 2026 14 min read