Skip to content

[Parquet] Reduce size of ParquetMetadata when encryption feature is enabled #8469

Closed

Description

@alamb

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

One thing I noticed while reviewing #8445 (review) with @etseidl was that the ParquetMetaData structure is substantially larger in memory when encryption is enabled.

Something else I noticed while working on #8340 is that the
file decryption properties are clone (dee-copied) around a lot.

Describe the solution you'd like

This is unnecessary and could be avoided by using Arc<FileDecryptionProperties> instead of FileDecryptionProperties directly.

Describe alternatives you've considered

Additional context

Activity

  1. self-assigned this
    on Sep 26, 2025
  2. changed the title [-]Reduce size of ParquetMetadata when encryption feature is enabled[/-] [+][parquet] Reduce size of ParquetMetadata when encryption feature is enabled[/+] on Sep 26, 2025
  3. changed the title [-][parquet] Reduce size of ParquetMetadata when encryption feature is enabled[/-] [+][Parquet] Reduce size of ParquetMetadata when encryption feature is enabled[/+] on Sep 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature/additionparquetChanges to the parquet crate

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions