Skip to content

select array_union([[null]], []) failing as not all bytes were consumed in RowConverter #19798

Closed

Description

@Jefffrey

Describe the bug

Running locally:

datafusion (main)$ cargo test --test sqllogictests array
    Finished `test` profile [unoptimized + debuginfo] target(s) in 0.61s
     Running bin/sqllogictests.rs (/Users/jeffrey/.cargo_target_cache/debug/deps/sqllogictests-a21d0d1e87978561)
Completed 7 test files in 2 seconds                                                                                                                                                                                   
External error: 1 errors in file /Users/jeffrey/Code/datafusion/datafusion/sqllogictest/test_files/array.slt

1. query failed: DataFusion error: Arrow error: Invalid argument error: Codecs [List(RowConverter { fields: [SortField { options: SortOptions { descending: false, nulls_first: true }, data_type: Null }], codecs: [Stateless] })] did not consume all bytes for row 0, remaining bytes: [1]
[SQL] select array_union([[null]], []);
at /Users/jeffrey/Code/datafusion/datafusion/sqllogictest/test_files/array.slt:4750



Error: Execution("1 failures")
error: test failed, to rerun pass `-p datafusion-sqllogictest --test sqllogictests`

Caused by:
  process didn't exit successfully: `/Users/jeffrey/.cargo_target_cache/debug/deps/sqllogictests-a21d0d1e87978561 array` (exit status: 1)

Related code in arrow-rs:

https://github.com/apache/arrow-rs/blob/f122d7786837d1fc6d93ad45c13067fbfe93eb3e/arrow-row/src/lib.rs#L936-L945

To Reproduce

No response

Expected behavior

No response

Additional context

No response

Activity

  1. added theissue type on Jan 14, 2026
  2. kumarUjjawal commented on Jan 14, 2026

    @kumarUjjawal
    Contributor

    Should the output be [[NULL]] (preserving the null element) or [[]] (treating null as empty)?

  3. Jefffrey commented on Jan 14, 2026

    @Jefffrey
    ContributorAuthor

    Should the output be [[NULL]] (preserving the null element) or [[]] (treating null as empty)?

    This test is an existing one so we should follow what the current (expected) output is

  4. kumarUjjawal commented on Jan 14, 2026

    @kumarUjjawal
    Contributor

    Thanks @Jefffrey

  5. kumarUjjawal commented on Jan 14, 2026

    @kumarUjjawal
    Contributor

    take

  6. Jefffrey commented on Jan 20, 2026

    @Jefffrey
    ContributorAuthor
  7. removed their assignment
    on Jan 28, 2026
  8. added a commit that references this issue on Apr 24, 2026
    fd093fb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingwaiting-on-upstreamPR is waiting on an upstream dependency to be updated

    Type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions