Skip to content

Incorrect statistics read for struct array in parquet #10609

Open

Description

@NGA-TRAN

Describe the bug

I found this while adding tests #10608. The statistics of struct array returns nothing

To Reproduce

See test_struct in #10608

Expected behavior

Return some values for the statistics

Additional context

No response

Activity

  1. Lordworms commented on May 22, 2024

    @Lordworms
    Contributor

    take

  2. xinlifoobar commented on May 29, 2024

    @xinlifoobar
    Contributor

    #8334 Related. The current statistics for structs returns null.

  3. Lordworms commented on May 30, 2024

    @Lordworms
    Contributor

    The problem here is how to effectively deal with nested struct, I don't actually know whether all the columns related to one struct are totally stored in one row group or they would separate in different row groups

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions