Releases: databendlabs/databend
Releases · databendlabs/databend
Release list
v1.2.941-nightly
What's Changed
Exciting New Features âĻ
- feat(query): support batched materialized view refresh by @sundy-li in #20469
- feat: rewrite decimal stats on metadata-only alter by @youngsofun in #20446
Thoughtful Bug Fix ð§
- fix(query): support expressions in bracket accessors by @KKould in #20449
- fix(storage): preserve Parquet schema annotations by @youngsofun in #20424
- fix(query): preserve nullable reflexive equality filters by @youngsofun in #20390
- fix(query): use lazy partitions for initial materialized view refresh by @dqhl76 in #20467
- fix(storage): preserve change tracking correctness across counter resets by @zhyass in #20481
Code Refactor ð
- refactor(storage): reduce clustering information metadata overhead by @zhyass in #20465
- refactor(query): remove proxy table engine by @sundy-li in #20441
- refactor: remove Lance unload support by @youngsofun in #20463
Build/Testing/CI Infra Changes ð
- ci(query): cover cross-type nullable correlated joins by @youngsofun in #20409
Others ð
- chore: meta: upgrade server and client to adjust logging level by @drmingdrmer in #20471
Full Changelog: v1.2.940-nightly...v1.2.941-nightly
v1.2.940-nightly
What's Changed
Exciting New Features âĻ
- feat(query): unify vacuum commands and execution by @SkyFan2002 in #20428
Thoughtful Bug Fix ð§
- fix(query): support Databend Arrow types in WASM UDFs by @youngsofun in #20456
- fix(planner): honor query settings in folding and statistics by @forsaken628 in #20448
- fix(storage): avoid collecting vacuum2 result files by @dantengsky in #20419
- fix(storage): read virtual columns when prewhere keeps no rows of a block by @zhang2014 in #20470
Others ð
Full Changelog: v1.2.939-nightly...v1.2.940-nightly
v1.2.939-nightly
What's Changed
Exciting New Features âĻ
Thoughtful Bug Fix ð§
- fix(query): add partition write regression tests by @KKould in #20426
- fix(query): correct date interval arithmetic and bounds (#20416) by @TCeason in #20425
- fix(query): avoid outer join error panic by @sundy-li in #20452
- fix(query): prevent hash exchange hangs after early receiver closure by @dqhl76 in #20450
- fix(query): disable join selectivity backoff and align propagation by @forsaken628 in #20453
Build/Testing/CI Infra Changes ð
Others ð
- chore(query): remove Aggregating Index by @b41sh in #20447
- chore: Improve Virtual Column Block Meta Generation by @b41sh in #20348
Full Changelog: v1.2.938-nightly...v1.2.939-nightly
v1.2.938-nightly
What's Changed
Exciting New Features âĻ
- feat(query): push aggregate rank limit boundaries into fuse scan by @dqhl76 in #20406
- feat(storage): support concurrent recluster tasks by @zhyass in #20413
- feat(query): combine multi-condition join estimates with exponential backoff by @forsaken628 in #20414
Thoughtful Bug Fix ð§
- fix(query): avoid UTF-8 boundary panic in datetime domain folding by @TCeason in #20430
- fix(storage): speed up ngram index building by @KKould in #20435
- fix(storage): avoid overflow in block thresholds by @zhang2014 in #20439
Code Refactor ð
- refactor(storage): scale clustering information diagnostics by @zhyass in #20411
- refactor(storage): prepare range index domains once by @zhang2014 in #20438
- refactor(query): bound merge and replace block mutation workers by @zhang2014 in #20440
Others ð
- chore(storage): bump OpenDAL to 0.55 and Remove Hive catalog by @b41sh in #20434
- chore: meta: upgrade databend-meta to v260629.3.0, drop tonic 0.13 by @drmingdrmer in #20431
- chore(sqllogic): cover Databend Cloud tutorial SQL by @TCeason in #20433
Full Changelog: v1.2.937-nightly...v1.2.938-nightly
v1.2.937-nightly
What's Changed
Exciting New Features âĻ
- feat(storage): optimize ngram bloom index building by @KKould in #20410
- feat(query): Inverted Index support Japanese language tokenizer by @b41sh in #20412
- feat(query): support cost-based MV scan routing by @sundy-li in #20422
- feat(fuse): support Hilbert reclustering by @zhyass in #20313
Thoughtful Bug Fix ð§
- fix(query): cache materialized view rewrites by @sundy-li in #20415
- fix(query): avoid default context in outer join rewrite by @dantengsky in #20292
- fix(query): preserve provider storage for data shares by @SkyFan2002 in #20429
Code Refactor ð
- refactor(storage): stream vacuum2 block gc by @dantengsky in #20402
Full Changelog: v1.2.936-nightly...v1.2.937-nightly
v1.2.925-patch-13
v1.2.936-nightly
What's Changed
Exciting New Features âĻ
- feat(sql): use typed bounds for histogram statistics by @forsaken628 in #20317
- feat: support data sharing by @SkyFan2002 in #20053
- feat(query): support cascading hierarchical grouping sets by @forsaken628 in #20249
- feat(query): choose materialized views by rewrite cost by @sundy-li in #20337
Thoughtful Bug Fix ð§
- fix(query): fix distributed grouping sets with materialized CTEs by @forsaken628 in #20328
- fix(query): track common hashtable allocator memory by @dqhl76 in #20321
- fix(storage): stream small parquet file batches by @youngsofun in #20356
- fix(query): make number string casts deterministic by @forsaken628 in #20352
- fix: avoid mechanically removing Exchange operators by @SkyFan2002 in #20371
- fix(query): skip hash join probe when build is empty by @dqhl76 in #20355
- fix(query): accelerate multi-key hash shuffle by @dantengsky in #20331
- fix(query): use structural keys for evaluator CSE by @KKould in #20374
- fix(query): preserve cast comparison operand order by @youngsofun in #20375
- fix(query): match empty LIKE patterns exactly by @KKould in #20363
- fix(query): re-sort re-aggregated MV blocks before recluster serialization by @zhang2014 in #20378
- fix(query): avoid decimal join keys for integer-to-string casts by @dantengsky in #20333
- fix(query): record early client close as LogType::Closed by @youngsofun in #20376
- fix(query): count result_rows when produced, not when consumed by @youngsofun in #20377
- fix(query): canonicalize keys before deriving join stats by @youngsofun in #20393
- fix(meta): avoid embedded service port races by @forsaken628 in #20391
- fix: reduce vacuum2 memory during gc by @dantengsky in #20394
- fix(storage): bound parquet row group bytes by @dqhl76 in #20387
- fix(runner): cloud build workflow remove spot instance by @hantmac in #20401
- fix(query): flatten lambdas in correlated subqueries by @youngsofun in #20389
- fix(query): preserve null validity in correlated joins by @sundy-li in #20354
- fix(query): expose unpivot columns in query block by @KKould in #20396
- fix(query): avoid parsing WASM UDF code as UTF-8 by @youngsofun in #20404
Code Refactor ð
- refactor(query): skip unnecessary CTE column scan by @KKould in #20344
- refactor(query): avoid repeated subquery traversal by @KKould in #20334
- refactor(storage): avoid materializing recluster endpoints by @KKould in #20372
- refactor(query): avoid redundant optimizer expression clones by @KKould in #20346
- refactor(query): consume expressions in constant folder by @KKould in #20373
- refactor(query): avoid eager collection in hot paths by @KKould in #20384
Others ð
- chore(ci): Change the metachaos notification from a failure-style alert to a warning-style alert by @TCeason in #20388
Full Changelog: v1.2.935-nightly...v1.2.936-nightly
v1.2.935-nightly
What's Changed
Exciting New Features âĻ
- feat(query): add enable_materialized_view_rewrite setting by @sundy-li in #20336
- feat(query): reaggregate aggregate MV blocks on compact by @sundy-li in #20340
Thoughtful Bug Fix ð§
- fix(storage): disable automatic HTTP decompression by @youngsofun in #20339
- fix(query): spill window partitions during output by @dqhl76 in #20343
- fix(query): quote nested SQL in procedure expressions with SQL rules by @forsaken628 in #20338
- fix(query): ignore system sources in lineage by @youngsofun in #20349
- fix(query): refresh ATTACH table schema in system.columns/statistics by @TCeason in #19966
- fix(storage): restore node-global memory budget for recluster by @zhyass in #20360
Code Refactor ð
- refactor(query): carry scalar function return types by @KKould in #20320
- refactor(query): optimize column collection and replacement by @KKould in #20345
- refactor: stage decompressor split output. by @youngsofun in #20341
Full Changelog: v1.2.934-nightly...v1.2.935-nightly
v1.2.934-nightly
What's Changed
Exciting New Features âĻ
- feat(query): materialized view support rewrite rule by @b41sh in #20302
- feat(query): refresh lineage for existing views by @youngsofun in #20315
- feat(query): materialized view support set|unset table option and comment by @TCeason in #20306
- feat(query): add partial evaluation policy by @sundy-li in #20318
- feat(query): configure lineage independently by @youngsofun in #20322
- feat(query): extract explicit materialized CTE lineage by @youngsofun in #20327
Thoughtful Bug Fix ð§
- fix(query): skip inactive rows in vectorized LIKE by @dantengsky in #20211
- fix(query): propagate suppressed row errors to is_not_error through nested calls by @junli1026 in #20305
- fix(query): avoid oversized row output buffer allocations by @dqhl76 in #20325
- fix(query): accelerate runtime bloom filter checks by @dantengsky in #20323
- fix(stage): improve Parquet unload compatibility with older readers by @youngsofun in #20326
Code Refactor ð
- refactor(sql): move join statistics tests to SQL goldens by @forsaken628 in #20293
- refactor(query): move lambda detection out of parser by @KKould in #20295
- refactor(query): split datetime helpers by responsibility by @forsaken628 in #20190
Full Changelog: v1.2.933-nightly...v1.2.934-nightly
v1.2.933-nightly
What's Changed
Exciting New Features âĻ
- feat(query): extract query lineage from plans by @youngsofun in #20201
- feat(query): add history-based data lineage by @youngsofun in #20235
- feat(query): add aggregate state merge combinators by @sundy-li in #20257
- feat(query): add json_path_transform lambda function by @zhang2014 in #20281
- feat(query): extend eliminate_self_join to support table-scan with pushed predicates by @junli1026 in #20284
- feat(query): Materialized View support hybrid reads by @b41sh in #20276
- feat(query): add materialized view DDL and maintenance lifecycle by @TCeason in #20266
- feat(fuse): add Hilbert clustering metadata and statistics by @zhyass in #20291
- feat(query): add direct lineage neighbor lookup by @youngsofun in #20300
- feat(query): support catalog and view table fields by @youngsofun in #20304
- feat(query): retain lineage history by default by @youngsofun in #20311
- feat: benchmark: consolidate the meta benchmarks into one harness by @drmingdrmer in #20314
- feat(query): extend runtime filters to single-column probe expressions by @SkyFan2002 in #20301
Thoughtful Bug Fix ð§
- fix(storage): map missing NO_CHECK snapshot 404 to TableHistoricalDataNotFound by @dantengsky in #20265
- fix(query): skip task cleanup on unassigned nodes by @KKould in #20263
- fix(sql): preserve async function determinism by @KKould in #19718
- fix(query): preserve parquet small-file compression ratio by @dqhl76 in #20283
- fix(storage): coalesce partitioned hash writes by @KKould in #20275
- fix(query): atomically enable stream change tracking by @zhyass in #20272
- fix(query): avoid repeated recluster vacuum by @zhyass in #20285
- fix(query): avoid cache population in mutation row fetch by @sundy-li in #20288
- fix(query): route mutations with internal columns through table scans by @zhyass in #20269
- fix(query): normalize procedure signatures in RBAC lookups by @TCeason in #20297
- fix(query): use current time for selectivity estimation by @dantengsky in #20298
- fix(iceberg): refresh expiring table credentials by @sundy-li in #20303
- fix(query): bound final aggregate finish memory by @dqhl76 in #20316
- fix(fuse): recheck runtime TopN during block reads by @zhang2014 in #20309
Code Refactor ð
- refactor(query): reduce expression analysis allocation by @KKould in #20256
- refactor(query): reshape lineage history metadata by @youngsofun in #20289
- refactor(query): clarify get lineage object output by @youngsofun in #20296
Documentation ð
Others ð
- chore(query): Add
fuse_virtual_column_buildtable function by @b41sh in #20299 - chore: Enable Materialized View Features for Enterprise Edition by @b41sh in #20307
Full Changelog: v1.2.932-nightly...v1.2.933-nightly