designed_to_flowfile-formats-and-partitioning.mdx
● 28 lessons · freealexkazos.com ↗

File formats & partitioning

Why is the same query an hour on one copy of the data and a blink on another?

⏱ 9 min☰ 10 steps▶ playground
Data
1 year
Rows
63 B
Size
4 TB
CSV files1 year · 400 sensorsQueryavg speed, S-12, todayrows as storeddaysensor_idtsspeedplate11-19S-1208:14:0352KXN48211-19S-0708:14:0561TPA11911-18S-1217:40:1147BKM30111-19S-3108:14:1270ZHT77711-19S-1208:14:2055AIK90211-18S-0717:41:0258LMC220
CSV filesQueryrows as storeddaysensor_idtsspeedplate11-19S-1208:14:0352KXN48211-19S-0708:14:0561TPA11911-18S-1217:40:1147BKM30111-19S-3108:14:1270ZHT77711-19S-1208:14:2055AIK90211-18S-0717:41:0258LMC220
  • bytes read
  • changed in this step