Archive - Data Engineering Central

1TB of Parquet files. Single Node Benchmark. (DuckDB style)

Haters gonna hate.

13 hrs ago • Daniel Beach

8 Data Engineering Principals

for the analytics expert

Dec 26 • Daniel Beach

Building a DuckLake ... Open Source Style.

Dec 22 • Daniel Beach

Scott Haines on the Future of Data Engineering

OSS, Lakehouses & Real-World War Stories

Dec 17 • Daniel Beach

1:50:59

Apache Arrow is Eating the World.

... the data world

Dec 15 • Daniel Beach

LLMs for {PDF} Data Pipelines

a Brave New World

Dec 9 • Daniel Beach

LakeKeeper: Iceberg REST Catalog

... another catalog for the mix

Dec 8 • Daniel Beach

Building Agentic AI ... Fancy.

how about a simple SQL Agent?

Dec 5 • Daniel Beach

Data Mesh Theology. Dead or Alive?

dying on the vine?

Dec 2 • Daniel Beach

JSON in a Lake House World

Delta Lake style

Dec 1 • Daniel Beach

November 2025

Revisiting Data Quality

Nov 25 • Daniel Beach

too scared to ask?

Nov 24 • Daniel Beach

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts