Subscribe
Sign in
Home
Podcast
Work With Me
Merch
Data Engineering Consulting
Archive
About
1TB of Parquet files. Single Node Benchmark. (DuckDB style)
Haters gonna hate.
11 hrs ago
•
Daniel Beach
20
2
1
8 Data Engineering Principals
for the analytics expert
Dec 26
•
Daniel Beach
13
2
Building a DuckLake ... Open Source Style.
behold
Dec 22
•
Daniel Beach
23
1
6
Most Popular
View all
650GB of Data (Delta Lake on S3). Polars vs DuckDB vs Daft vs Spark.
Nov 12
•
Daniel Beach
85
16
9
Goodbye Spark. Hello Polars + Delta Lake.
Oct 2, 2023
•
Daniel Beach
42
8
1
Spark vs Polars. Real-life Test Case.
Nov 9, 2023
•
Daniel Beach
40
2
4
Delta Lake vs Apache Iceberg. The Lake House Squabble.
Dec 11, 2024
•
Daniel Beach
36
4
4
The Truth about Prefect, Mage, and Airflow.
Apr 10, 2023
•
Daniel Beach
36
13
2
How to write better PySpark code.
Jan 6
•
Daniel Beach
26
2
Latest
Top
Discussions
Scott Haines on the Future of Data Engineering
OSS, Lakehouses & Real-World War Stories
Dec 17
•
Daniel Beach
13
1
1
1:50:59
Apache Arrow is Eating the World.
... the data world
Dec 15
•
Daniel Beach
11
1
LLMs for {PDF} Data Pipelines
a Brave New World
Dec 9
•
Daniel Beach
25
3
LakeKeeper: Iceberg REST Catalog
... another catalog for the mix
Dec 8
•
Daniel Beach
5
1
Building Agentic AI ... Fancy.
how about a simple SQL Agent?
Dec 5
•
Daniel Beach
25
5
4
Data Mesh Theology. Dead or Alive?
dying on the vine?
Dec 2
•
Daniel Beach
17
1
2
JSON in a Lake House World
Delta Lake style
Dec 1
•
Daniel Beach
4
2
See all
Data Engineering Central
Long Live the Data Engineer. No holds barred.
Subscribe
Recommendations
View all 20
Stat Significant
Daniel Parris
💎DiamantAI
Nir Diamant
The VC Corner
Ruben Dominguez
Prairie Meditations
Daniel Beach
Blog | luminousmen
luminousmen
Data Engineering Central
Subscribe
About
Archive
Recommendations
Sitemap
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
