You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
RFC: Ideas for what to include in a user tutorial #842
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
In addition to the information we already have in the online documentation, it would be helpful to write a tutorial guiding a user through the various portions of DataFusion and how to get started. This issue is to collect ideas for what people would like to see in such a tutorial
Describe the solution you'd like
Please comment with topics that should be covered.
Additional context
Things I would like to see (unsorted list)
Creating a small dataframe from a pyarrow array
Reading/Writing data from/to csv and parquet
Zero copy import of data from pyarrow
Transferring DataFrame to/from pandas/polars
Displaying data via show(), repr_html(), and great tables
Basic column selection, including indexing into fields and element for structs and arrays
Performing joins
Performing window and aggregate functions, including how default and custom window frames work
Activity
[-]RFC: Operations to include in a user tutorial[/-][+]RFC: Ideas for what to include in a user tutorial[/+]mesejo commentedon Aug 30, 2024
Great ideas!
I'm curious about:
Would this involve wrapping the rust UDF with PyO3?
I would also like to see how to read csv from HTTP directly
Some other ideas:
timsaucer commentedon Aug 30, 2024
Thanks! To answer your immediate question, I have a draft blog post about how you use rust UDFs here: https://github.com/timsaucer/datafusion-site/blob/tsaucer/python-udf-approaches/_posts/2024-08-06-datafusion-python-udf-comparisons.md I plan on publishing that soon-ish. I want to get a few things done with DF41 before we release it.
mesejo commentedon Aug 30, 2024
Thanks @timsaucer!
timsaucer commentedon Nov 22, 2024
There are a lot of suggestions in this twitter post from @ChristianCasazza
https://x.com/casazzany/status/1860002216389550489?s=46