Skip to content

Consider using with_skip_validation for shuffle file reading #1189

Closed
#1374
Closed
Consider using with_skip_validation for shuffle file reading#1189
#1374
Labels
enhancementNew feature or requestgood first issueGood for newcomers

Description

@milenkovicm
milenkovicm
opened on Feb 27, 2025

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Improve shuffle reading, with apache/arrow-rs#7120 merged consider using it for shuffle files.

Describe the solution you'd like

Change shuffle reader to utilise new api.

Describe alternatives you've considered

Keep everything as it is

Additional context

Activity

  1. milenkovicm
    added
    enhancementNew feature or request
    on Feb 27, 2025

  2. westhide commented on Mar 28, 2025

    @westhide
    westhide
    on Mar 28, 2025
    Contributor

    /take

  3. westhide commented on Mar 28, 2025

    @westhide
    westhide
    on Mar 28, 2025
    Contributor

    For references

    WIP Improve

    Base on arrow-rs

    Minimum arrow-rs release version 54.3.0 support with_skip_validation

  4. milenkovicm
    added
    good first issueGood for newcomers
    on Apr 18, 2025
  5. milenkovicm
    closed this as completedin #1374on Jan 17, 2026

  6. killzoner commented on Jan 20, 2026

    @killzoner
    killzoner
    on Jan 20, 2026
    Contributor

    I will have a look at #1316 (comment) in the following weeks if that's still relevant

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestgood first issueGood for newcomers

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions