Skip to content

Improve parquet MetadataFetch and AsyncFileReader docs - #6505

Merged
alamb merged 6 commits into
apache:masterfrom
alamb:alamb/reader_docs
Oct 6, 2024
Merged

alamb merged 6 commits into
apache:masterfrom
alamb:alamb/reader_docs

Conversation

@alamb

@alamb alamb commented Oct 3, 2024 •

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Part of #6504

Rationale for this change

While working on the example for using parquet metadata in a local cache (#6081) some of these traits and how to implement them were not clear to me

What changes are included in this PR?

Add additional documentation and explanations

Are there any user-facing changes?

Better documentation and examples. No functional changes

@alamb
alamb marked this pull request as ready for review October 3, 2024 13:15
/// Return a future that fetches the specified range of bytes asynchronously
///
/// Note the returned type is a boxed future, often created by
/// [FutureExt::boxed]. See the trait documentation for an example

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you are not familiar with rust futures BoxFuture is somewhat exotic. I will also make a PR upstream in futures to try and improve the docs there

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rust-lang/futures-rs#2887 -- we'll see what the maintainers say

Comment thread parquet/src/arrow/async_reader/metadata.rs Outdated
Comment thread parquet/src/arrow/async_reader/mod.rs Outdated
@alamb alamb changed the title Improve MetadataFetch and AsyncFileReader docs Improve parquet MetadataFetch and AsyncFileReader docs Oct 3, 2024
Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
@github-actions github-actions Bot added the parquet Changes to the parquet crate label Oct 3, 2024

@etseidl etseidl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. 👍 @mbrobbel found the only issues I did.

Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
Comment thread parquet/src/arrow/async_reader/metadata.rs Outdated
Comment thread parquet/src/file/metadata/reader.rs Outdated
alamb and others added 3 commits October 4, 2024 18:46
Co-authored-by: Val Lorentz <progval+github@progval.net>
Co-authored-by: Val Lorentz <progval+github@progval.net>
@alamb

alamb commented Oct 6, 2024

Copy link
Copy Markdown
Contributor Author

Thank you everyone for your suggestions and support.

@alamb
alamb deleted the alamb/reader_docs branch October 6, 2024 11:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants