Apache DataFusion SQL Query Engine
Commits on main
writing table to parquet followed by read and schema check (#21444)
5ba06ac RIchard Baah committed 7 months ago
fix: preserve subquery structure when unparsing SubqueryAlias over Ag… (#21099)
cdddd76 Yonatan Striem Amit committed 7 months ago
Follow-up: remove interleave panic recovery after Arrow 58.1.0 (#21436)
603bfb4 xudong.w committed 7 months ago
feat: Propagate orderings through struct-producing projections (#21218)
944bac2 Rohan Krishnaswamy committed 7 months ago
Estimate aggregate output rows using existing NDV statistics (#20926)
c74ed91 Burak Şen committed 7 months ago
perf: optimize object store requests when reading JSON (#20823)
8a48a87 Ariel Miculas-Trif committed 7 months ago
test: Add `datafusion.format.*` configs test coverage (#21355)
7c3b22c Eren Avsarogullari committed 7 months ago
chore(deps): bump taiki-e/install-action from 2.70.3 to 2.74.0 (#21434)
94c7bc2 dependabot[bot] committed 7 months ago
chore(deps): bump the all-other-cargo-deps group with 4 updates (#21435)
7eccbb9 dependabot[bot] committed 7 months ago
feat: make sort pushdown BufferExec capacity configurable, default 1GB (#21426)
727022d Qi Zhu committed 7 months ago
fix: preserve source field metadata in TryCast expressions (#21390)
a32c4b2 Adrian Garcia Badaracco committed 7 months ago
fix(datasource): keep stats absent when collect_stats is false (#21149)
0b8c4c5 Kumar Ujjawal committed 7 months ago
feat: Set NDV to Exact(1) for numeric equality filter predicates (#21077)
a4b945e Alessandro Solimando committed 7 months ago
feat: sort file groups by statistics during sort pushdown (Sort pushdown phase 2) (#21182)
cdfade5 Qi Zhu committed 7 months ago
Minor: add tests for regexp_replace and capture groups (#21413)
8a2d758 Andrew Lamb committed 7 months ago
refactor(pruning): remove column param from PruningStatistics::row_counts (#21369)
206ac6b Adrian Garcia Badaracco committed 7 months ago
feat: add support for parquet content defined chunking options (#21110)
a51971b Krisztián Szűcs committed 7 months ago
fix(sql): fix a bug when planning semi- or antijoins (#20990)
9ab5291 Alexander Alexandrov committed 7 months ago
feat: make DataFrame::create_physical_plan take &self instead of self (#20562)
b3b721f Xander committed 7 months ago
Use ParquetMetaDataPushDecoder instead of ParquetMetaDataReader (#21357)
422129c Daniël Heres committed 7 months ago
feat: support GroupsAccumulator for first_value and last_value with string/binary types (#21090)
587f4c0 UBarney committed 7 months ago
Skip probe-side consumption when hash join build side is empty (#21068)
6c5e241 kosiew committed 7 months ago
fix: use spill writer's schema instead of the first batch schema for spill files (#21293)
78cfc15 Marko Grujic committed 7 months ago