iceberg_compaction_* session settings

These settings are available in system.settings and are autogenerated from source.

iceberg_compaction_commit_batch_size

Number of merged data files that background Iceberg compaction accumulates before publishing them in a new snapshot.

Compaction results are published in any case once there are no candidates left to compact, so this setting only bounds how long already merged files stay unpublished while compaction keeps finding new work. 0 restores the old behaviour of publishing only when compaction runs out of candidates - a state that is never reached while the table keeps receiving new data files, so every merged output is then written to object storage and never referenced by a snapshot.

iceberg_compaction_data_cleanup

The time after which the data will be deleted.

iceberg_compaction_delay_bias

Minimum time of delay between 2 background compaction operations.

iceberg_compaction_max_bytes_in_data_file

Max bytes of an iceberg parquet data file produced by compaction. Defaults to the maximum so that compaction merges eligible files into as few output files as possible.

iceberg_compaction_max_rows_in_data_file

Max rows of an iceberg parquet data file produced by compaction. Defaults to the maximum so that compaction merges eligible files into as few output files as possible. Keeping this above the size compaction can actually produce would make every output file stay below iceberg_data_file_size_lower_threshold_compaction and be re-selected forever.