Skip to content

Code clean for new datafusion-cli streaming printing logic #14886

Description

@zhuqi-lucas

Is your feature request related to a problem or challenge?

This is a follow-up for:
#14877 (comment)

And we can do some code clean work including:

  1. Add streaming state struct and clean up print batch logic
  2. Remove older logics about max-rows
  3. Add more docs and remove confusing docs
  4. Etc

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

Activity

  1. changed the title [-]Code clean for new datafusion-cli streaming logic[/-] [+]Code clean for new datafusion-cli streaming printing logic[/+] on Feb 26, 2025
  2. alamb commented on Feb 26, 2025

    @alamb
    Contributor

    I think this is a nice first isuse for someone who wants to make the code nicer and it is currently tested and could be handled without deep datafusion knowledge

    It does require some non trivial rust / refactoring though so it probably isn't a great one for someone new to rust

  3. shruti2522 commented on Feb 28, 2025

    @shruti2522
    Contributor

    Hi @zhuqi-lucas , I would like to work on this issue.

  4. shruti2522 commented on Feb 28, 2025

    @shruti2522
    Contributor

    take

  5. zhuqi-lucas commented on Feb 28, 2025

    @zhuqi-lucas
    ContributorAuthor

    Sure @shruti2522 , thanks!

  6. alamb commented on Feb 28, 2025

    @alamb
    Contributor

    Thanks @shruti2522 -- can't wait to see what you come up with ❤

  7. THEAYUSHIMISHRA commented on Apr 8, 2025

    @THEAYUSHIMISHRA

    Hi @zhuqi-lucas , I would like to work on this issue

  8. alamb commented on Apr 10, 2025

    @alamb
    Contributor

    I think the current status is that the code for this feature was somewhat complicated and in fact caused a regression before the last release so we reverted it.

    @zhuqi-lucas has made a new PR with some more tests, but the code is still somewhat complex and thus hard to review. Perhaps you can help review / improve that pR?

  9. nssalian commented on Jul 20, 2025

    @nssalian

    take

  10. nssalian commented on Jul 21, 2025

    @nssalian

    @alamb, checking if my understanding of the issue is accurate since there are a few threads here. This is my first issue on the project, so I want to clarify prior to proceeding.
    The current code for printing tables in the CLI has a method with too many parameters, which makes debugging difficult, and the explain plans aren't displaying correctly.
    To solve this, one way is to create a struct that holds all the parameters instead of passing them individually. Thus, we are cleaning up some code and moving it to methods and creating the state struct.

  11. zhuqi-lucas commented on Jul 21, 2025

    @zhuqi-lucas
    ContributorAuthor

    @nssalian This ticket is invalid, i need to rework this:

    #14954

  12. alamb commented on Jul 21, 2025

    @alamb
    Contributor

    Closed -- thanks @nssalian and @zhuqi-lucas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions