diff --git a/Antalya.md b/Antalya.md index a3fe087e69ad..0d02ff8432c5 100644 --- a/Antalya.md +++ b/Antalya.md @@ -1,30 +1,20 @@ | Feature | Altinity PR | First Altinity Release | upstream PR | First upstream Release | |----------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------:|:----------------------:| :---: | :---: | -| < **SECURITY** > | | || -| Token-based authentication and authorization | https://github.com/Altinity/ClickHouse/pull/1078 | 25.8.12 || +|:arrow_forward: SECURITY| | || +| Token-based authentication and authorization |https://github.com/Altinity/ClickHouse/pull/1078| 25.8.12 || | --- | -| < **PERFORMANCE** > | | || -| Distributed execution: better split tasks by row groups IDs | https://github.com/Altinity/ClickHouse/pull/1237 | 25.8.12 |https://github.com/ClickHouse/ClickHouse/pull/87508|25.11.1|| Support writing parquet enum as byte array|https://github.com/Altinity/ClickHouse/pull/989|25.6.5|https://github.com/ClickHouse/ClickHouse/pull/81090|25.7.1 -| Enable parquet reader v3 by default | https://github.com/Altinity/ClickHouse/pull/1232 | 25.8.12 |https://github.com/ClickHouse/ClickHouse/pull/88827|25.11.1| -| Set max message size on parquet v3 reader | https://github.com/Altinity/ClickHouse/pull/1198 | 25.8.12 |https://github.com/ClickHouse/ClickHouse/pull/91737|25.12.1 -| AWS S3 authentication with an explicitly provided IAM role | https://github.com/Altinity/ClickHouse/pull/986 | 25.6.5 |https://github.com/ClickHouse/ClickHouse/pull/84011|25.8.1 -| Iceberg table pruning in cluster requests | https://github.com/Altinity/ClickHouse/pull/770 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/82131|25.7.1| -| ListObjectsV2 cache | https://github.com/Altinity/ClickHouse/pull/743 | 25.2.2 || -| Improve performance of hive path parsing | https://github.com/Altinity/ClickHouse/pull/734 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/79067|25.5.1 -| Lazy load metadata for metadata for DataLake | https://github.com/Altinity/ClickHouse/pull/742 | 25.2.2 || -| Iceberg metadata files cache | https://github.com/Altinity/ClickHouse/pull/733 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/77156 |25.5.1 -| Support MinMax index for Iceberg | https://github.com/Altinity/ClickHouse/pull/733 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/78242|25.4.1 -| Parquet file metadata caching: clear cache | https://github.com/Altinity/ClickHouse/pull/713 | 25.2.2 || -| Parquet: bloom filters support | same as upstream => | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/62966|24.10.1 -| Parquet: page header v2 support on native reader | same as upstream => | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/70807|24.10.1 -| Parquet: boolean support on native reader | same as upstream => | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71055|24.11.1 -| Parquet: merge bloom filter and min/max evaluation | https://github.com/Altinity/ClickHouse/pull/590 | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71383|25.2.1 -| Parquet: Int logical type support on native reader | https://github.com/Altinity/ClickHouse/pull/589 | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/72105|25.1.1 -| Parquet file metadata caching | https://github.com/Altinity/ClickHouse/pull/586 | 24.12.2 || -| Parquet file metadata caching: use cache for parquetmetadata format | https://github.com/Altinity/ClickHouse/pull/636 | 24.12.2 || +|:arrow_forward: PERFORMANCE| | || +| Distributed execution: better split tasks by row groups IDs |https://github.com/Altinity/ClickHouse/pull/1237 | 25.8.12 |https://github.com/ClickHouse/ClickHouse/pull/87508|25.11.1| +| Enable parquet reader v3 by default |https://github.com/Altinity/ClickHouse/pull/1232 | 25.8.12 |https://github.com/ClickHouse/ClickHouse/pull/88827|25.11.1| +| Set max message size on parquet v3 reader |https://github.com/Altinity/ClickHouse/pull/1198 | 25.8.12 |https://github.com/ClickHouse/ClickHouse/pull/91737|25.12.1| +| ListObjectsV2 cache |https://github.com/Altinity/ClickHouse/pull/743 | 25.2.2 || +| Lazy load metadata for metadata for DataLake |https://github.com/Altinity/ClickHouse/pull/742 | 25.2.2 || +| Parquet file metadata caching: clear cache |https://github.com/Altinity/ClickHouse/pull/713 | 25.2.2 || +| Parquet file metadata caching |https://github.com/Altinity/ClickHouse/pull/586 | 24.12.2 || +| Parquet file metadata caching: use cache for parquetmetadata format |https://github.com/Altinity/ClickHouse/pull/636 | 24.12.2 || | Parquet file metadata caching: turn cache on by default |https://github.com/Altinity/ClickHouse/pull/669, https://github.com/Altinity/ClickHouse/pull/674| 24.12.2 || | --- | -| < **SWARMS** > | | || +|:arrow_forward: SWARMS| | || |Profile events for task distribution in ObjectStorageCluster requests|https://github.com/Altinity/ClickHouse/pull/1172|25.8.12|| | SYSTEM STOP SWARM MODE command for graceful shutdown of swarm node|https://github.com/Altinity/ClickHouse/pull/1014|25.6.5|| | JOIN with *Cluster table functions and swarm queries|https://github.com/Altinity/ClickHouse/pull/972|25.6.5|| @@ -32,16 +22,12 @@ | Add iceberg_metadata_file_path to query when send it to swarm nodes|https://github.com/Altinity/ClickHouse/pull/898|25.3.3|| | Setting `lock_object_storage_task_distribution_ms` to improve cache locality with swarm cluster|https://github.com/Altinity/ClickHouse/pull/866|25.3.3|| | Setting object_storage_max_nodes | https://github.com/Altinity/ClickHouse/pull/677 | 25.2.2 || -| Rendezvous hashing filesystem cache | https://github.com/Altinity/ClickHouse/pull/709 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/77326|25.5.1 | Convert functions with object_storage_cluster setting to cluster functions | https://github.com/Altinity/ClickHouse/pull/712 | 25.2.2 || -| Auxiliary autodiscovery | https://github.com/Altinity/ClickHouse/pull/531 | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71911|24.11.1 -| Fix remote call of s3Cluster function | https://github.com/Altinity/ClickHouse/pull/583 | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/72625| -| Cluster auto discovery | https://github.com/Altinity/ClickHouse/pull/629 | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/76001|25.3.1 -| Alternative syntax for object storage cluster functions | https://github.com/Altinity/ClickHouse/pull/592 | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/70659|25.3.1 +| Fix remote call of s3Cluster function | https://github.com/Altinity/ClickHouse/pull/583 | 24.12.2 || | Limit parsing threads for distributed case | https://github.com/Altinity/ClickHouse/pull/648 | 24.12.2 || | Distributed request to tables with Object Storage Engines | https://github.com/Altinity/ClickHouse/pull/615 | 24.12.2 || | --- | -| < **CATALOGS** > | | || +|:arrow_forward: CATALOGS| | || |Google cloud storage support for data lakes|https://github.com/Altinity/ClickHouse/pull/1318|25.8.14|https://github.com/ClickHouse/ClickHouse/pull/93866|26.1.1|| |Add metrics for Iceberg, S3, and Azure|https://github.com/Altinity/ClickHouse/pull/1123|25.8.9|https://github.com/ClickHouse/ClickHouse/pull/93332| |Add `icebergLocalCluster` table function to allow cluster reads from shared disk|https://github.com/Altinity/ClickHouse/pull/1120|25.8.9|https://github.com/ClickHouse/ClickHouse/pull/93323|26.1.1| @@ -49,19 +35,12 @@ |Allow to read Iceberg data from any location|https://github.com/Altinity/ClickHouse/pull/1092|25.8.9|| |Read optimization using Iceberg metadata|https://github.com/Altinity/ClickHouse/pull/1019|25.8.9|| |Lazy load metadata for metadata for DataLake|https://github.com/Altinity/ClickHouse/pull/742|25.8.9|| -|Allow key-value arguments in s3/s3cluster engine|https://github.com/Altinity/ClickHouse/pull/1028|25.6.5|https://github.com/ClickHouse/ClickHouse/pull/85134|25.8.1| -| Support compressed metadata in Iceberg|https://github.com/Altinity/ClickHouse/pull/1005|25.6.5|https://github.com/ClickHouse/ClickHouse/pull/81451|25.7.1 -| Support TimestampTZ in Glue catalog|https://github.com/Altinity/ClickHouse/pull/992|25.6.5|https://github.com/ClickHouse/ClickHouse/issues/83132|25.7.1 | Expose IcebergS3 table metainformation in system.tables|https://github.com/Altinity/ClickHouse/pull/959|25.6.5|| | Support different warehouses behind Iceberg REST catalog|https://github.com/Altinity/ClickHouse/pull/860|25.3.3|| -| Support for Iceberg partition pruning bucket transform|https://github.com/Altinity/ClickHouse/pull/786|25.3.3|https://github.com/ClickHouse/ClickHouse/pull/79262|25.5.1 -| Unity catalog integration | same as upstream => | 25.3.3 |https://github.com/ClickHouse/ClickHouse/pull/76988|25.3.1 -| Glue catalog integration | same as upstream => | 25.3.3 |https://github.com/ClickHouse/ClickHouse/pull/77257|25.3.1 -| General engine definition for Iceberg tables | https://github.com/Altinity/ClickHouse/pull/675 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/77125| +| General engine definition for Iceberg tables | https://github.com/Altinity/ClickHouse/pull/675 | 25.2.2 || | RBAC for S3 | https://github.com/Altinity/ClickHouse/pull/688 | 25.2.2 || -| Iceberg REST Catalog integration | same as upstream => | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71542|24.12.1 | --- | -| < **TIERED STORAGE** > | | || +|:arrow_forward: TIERED STORAGE| | || |Add query id to system.part_log, system_exports and system.replicated_partition_exports|https://github.com/Altinity/ClickHouse/pull/1330|25.8.14|| |Allow merge tree materialized / alias columns to be exported through part export|https://github.com/Altinity/ClickHouse/pull/1324|25.8.14|| |Accept table function as destination for part export|https://github.com/Altinity/ClickHouse/pull/1320|25.8.14|| @@ -75,12 +54,37 @@ |`Engine=hybrid` implementation|https://github.com/Altinity/ClickHouse/pull/1071|25.8.9|| |Add observability for EXPORT PART|https://github.com/Altinity/ClickHouse/pull/1017|25.6.5|| | Simple MergeTree part export to object storage|https://github.com/Altinity/ClickHouse/pull/1009|25.6.5|| -| Support for hive partition style reads and writes|https://github.com/Altinity/ClickHouse/pull/934|25.6.5|https://github.com/ClickHouse/ClickHouse/pull/76802|25.8.1 -| Better S3 URL parsing for Hive partitioning | https://github.com/Altinity/ClickHouse/pull/700 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/78185|25.5.1 | s3Cluster hive partitioning for old analyzer | https://github.com/Altinity/ClickHouse/pull/703 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/93284| -| Support partition pruning in DeltaLake engine | https://github.com/Altinity/ClickHouse/pull/733 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/78486|25.4.1 -| Iceberg time travel by snapshots | https://github.com/Altinity/ClickHouse/pull/733 | 25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/77439|25.4.1 | s3Cluster hive partitioning | https://github.com/Altinity/ClickHouse/pull/584 | 24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/73910| +| --- | +|:left_right_arrow: Feature parity in the latest Antalya release :left_right_arrow:||| +| --- | +| Allow key-value arguments in s3/s3cluster engine |https://github.com/Altinity/ClickHouse/pull/1028 |25.6.5|https://github.com/ClickHouse/ClickHouse/pull/85134|25.8.1| +| AWS S3 authentication with an explicitly provided IAM role |https://github.com/Altinity/ClickHouse/pull/986 |25.6.5 |https://github.com/ClickHouse/ClickHouse/pull/84011|25.8.1| +| Support for hive partition style reads and writes |https://github.com/Altinity/ClickHouse/pull/934 |25.6.5|https://github.com/ClickHouse/ClickHouse/pull/76802|25.8.1| +| Support compressed metadata in Iceberg |https://github.com/Altinity/ClickHouse/pull/1005 |25.6.5|https://github.com/ClickHouse/ClickHouse/pull/81451|25.7.1| +| Support TimestampTZ in Glue catalog |https://github.com/Altinity/ClickHouse/pull/992 |25.6.5|https://github.com/ClickHouse/ClickHouse/issues/83132|25.7.1| +| Support writing parquet enum as byte array |https://github.com/Altinity/ClickHouse/pull/989 |25.6.5 |https://github.com/ClickHouse/ClickHouse/pull/81090|25.7.1| +| Iceberg table pruning in cluster requests |https://github.com/Altinity/ClickHouse/pull/770 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/82131|25.7.1| +| Support for Iceberg partition pruning bucket transform |https://github.com/Altinity/ClickHouse/pull/786 |25.3.3|https://github.com/ClickHouse/ClickHouse/pull/79262|25.5.1| +| Improve performance of hive path parsing |https://github.com/Altinity/ClickHouse/pull/734 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/79067|25.5.1| +| Iceberg metadata files cache |https://github.com/Altinity/ClickHouse/pull/733 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/77156 |25.5.1| +| Rendezvous hashing filesystem cache |https://github.com/Altinity/ClickHouse/pull/709 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/77326|25.5.1| +| Better S3 URL parsing for Hive partitioning |https://github.com/Altinity/ClickHouse/pull/700 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/78185|25.5.1| +| Support MinMax index for Iceberg |https://github.com/Altinity/ClickHouse/pull/733 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/78242|25.4.1| +| Support partition pruning in DeltaLake engine |https://github.com/Altinity/ClickHouse/pull/733 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/78486|25.4.1| +| Iceberg time travel by snapshots |https://github.com/Altinity/ClickHouse/pull/733 |25.2.2 |https://github.com/ClickHouse/ClickHouse/pull/77439|25.4.1| +| Cluster auto discovery |https://github.com/Altinity/ClickHouse/pull/629 |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/76001|25.3.1| +| Alternative syntax for object storage cluster functions |https://github.com/Altinity/ClickHouse/pull/592 |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/70659|25.3.1| +| Unity catalog integration |same as upstream => |25.3.3 |https://github.com/ClickHouse/ClickHouse/pull/76988|25.3.1| +| Glue catalog integration |same as upstream => |25.3.3 |https://github.com/ClickHouse/ClickHouse/pull/77257|25.3.1| +| Parquet: merge bloom filter and min/max evaluation |https://github.com/Altinity/ClickHouse/pull/590 |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71383|25.2.1| +| Parquet: Int logical type support on native reader |https://github.com/Altinity/ClickHouse/pull/589 |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/72105|25.1.1| +| Iceberg REST Catalog integration |same as upstream => |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71542|24.12.1| +| Parquet: boolean support on native reader |same as upstream => |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71055|24.11.1| +| Auxiliary autodiscovery |https://github.com/Altinity/ClickHouse/pull/531 |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/71911|24.11.1| +| Parquet: bloom filters support |same as upstream => |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/62966|24.10.1| +| Parquet: page header v2 support on native reader |same as upstream => |24.12.2 |https://github.com/ClickHouse/ClickHouse/pull/70807|24.10.1|