Skip to content

[native_iceberg_compat] Add support for Parquet modular decryption #2339

@andygrove

Description

@andygrove

What is the problem the feature request solves?

Placeholder. Details TBD.

  • Comet needs native KMS provider that can call into Spark via JNI
    • Supprt AWS KMS
    • Support custom KMS (Spark InMemoryKMS)
  • Must support
    • Footer decryption
    • Data encryption per column
  • Spark SQL org.apache.spark.sql.hive.ParquetEncryptionSuite suite must pass

Describe the potential solution

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions