Repository navigation

Support vectorized append and compare for multi group by - #12996

Merged

alamb merged 63 commits into

apache:mainfrom

Rachelint:vectorize-append-value

Nov 6, 2024

Merged

Support vectorized append and compare for multi group by#12996
alamb merged 63 commits into
apache:mainfrom
Rachelint:vectorize-append-value

Commits on Oct 16, 2024
- simple support vectorized append.
  Rachelint
  committed
  be6a67d
- fix tests.
  Rachelint
  committed
  2cdf05d
Commits on Oct 17, 2024
- some logs.
  Rachelint
  committed
  04ea2d2
Commits on Oct 19, 2024
- add `append_n` in `MaybeNullBufferBuilder`.
  Rachelint
  committed
  a83c2ea
- impl basic append_batch
  Rachelint
  committed
  3df75ac
- fix equal to.
  Rachelint
  committed
  13c9489
Commits on Oct 21, 2024
- define `GroupIndexContext`.
  Rachelint
  committed
  5fd63e8
- define the structs useful in vectorizing.
  Rachelint
  committed
  d4b5820
Commits on Oct 22, 2024
- re-define some structs for vectorized operations.
  Rachelint
  committed
  04f35bb
- impl some vectorized logics.
  Rachelint
  committed
  d215937
- impl chekcing hashmap stage.
  Rachelint
  committed
  2af6ff5
- fix compile.
  Rachelint
  committed
  473914a
- tmp
  Rachelint
  committed
  14f8881
- define and impl `vectorized_compare`.
  Rachelint
  committed
  ebbeb5a
- fix compile.
  Rachelint
  committed
  dad79c0
- impl `vectorized_equal_to`.
  Rachelint
  committed
  1a7c2eb
Commits on Oct 23, 2024
- impl `vectorized_append`.
  Rachelint
  committed
  d79b813
Commits on Oct 25, 2024
- finish the basic vectorized ops logic.
  Rachelint
  committed
  6edc646
Commits on Oct 26, 2024
- impl `take_n`.
  Rachelint
  committed
  150248f
Commits on Oct 27, 2024
- fix `renaming clear` and `groups fill`.
  Rachelint
  committed
  37d68e6
- fix death loop due to rehashing.
  Rachelint
  committed
  ebd9db9
- fix vectorized append.
  Rachelint
  committed
  71c45ce
- add counter.
  Rachelint
  committed
  2f272f2
- use extend rather than resize.
  Rachelint
  committed
  731723c
- remove dbg!.
  Rachelint
  committed
  a77f516
- remove reserve.
  Rachelint
  committed
  1830c1a
- refactor the codes to make simpler and more performant.
  Rachelint
  committed
  b6f2d00
- clear `scalarized_indices` in `intern` to avoid some corner case.
  Rachelint
  committed
  6375d93
Commits on Oct 28, 2024
- fix `scalarized_equal_to`.
  Rachelint
  committed
  7979f74
- fallback to total scalarized `GroupValuesColumn` in streaming aggregation.
  Rachelint
  committed
  86dcb11
Commits on Oct 29, 2024
- add unit test for `VectorizedGroupValuesColumn`.
  Rachelint
  committed
  197656b
Commits on Oct 30, 2024
- add unit test for emitting first n in `VectorizedGroupValuesColumn`.
  Rachelint
  committed
  cc96beb
- sort out tests codes in for group columns and add vectorized tests for primitives.
  Rachelint
  committed
  2c1ec19
- add vectorized test for byte builder.
  Rachelint
  committed
  fa6343c
- add vectorized test for byte view builder.
  Rachelint
  committed
  41ac655
- add test for the all nulls or not nulls branches in vectorized.
  Rachelint
  committed
  4f8924e
- Merge branch 'main' into vectorize-append-value
  Rachelint
  committed
  c9b147a
- fix clippy.
  Rachelint
  committed
  236b0bc
- fix fmt.
  Rachelint
  committed
  15aaab1
- fix compile in rust 1.79.
  Rachelint
  committed
  a0aa7b7
- improve comments.
  Rachelint
  committed
  c2088f7
- fix doc.
  Rachelint
  committed
  7acfef0
- add more comments to explain the really complex vectorized intern process.
  Rachelint
  committed
  7875d50
- add comments to explain why we still need origin `GroupValuesColumn`.
  Rachelint
  committed
  41f5f04
- remove some stale comments.
  Rachelint
  committed
  7efce58
- fix clippy.
  Rachelint
  committed
  5cbe3fa
- add comments for `vectorized_equal_to` and `vectorized_append`.
  Rachelint
  committed
  8b23ff3
- fix clippy.
  Rachelint
  committed
  df81f8f
- use zip to simplify codes.
  Rachelint
  committed
  81f99a8
Commits on Oct 31, 2024
- use izip to simplify codes.
  Rachelint
  committed
  b7a2443
- Update datafusion/physical-plan/src/aggregates/group_values/group_column.rs
  
  Rachelint
  and
  jayzhan211
  authored
  4b45708
- first_n attempt
  jayzhan211
  committed
  d1b879a
Commits on Nov 1, 2024
Commits on Nov 2, 2024
- define `VectorizedOperationBuffers` to hold buffers used in vectorized operations to make code clearer.
  Rachelint
  committed
  7a1ed90
- Merge branch 'main' into vectorize-append-value
  Rachelint
  committed
  e8c0aaa
Commits on Nov 4, 2024
- unify `VectorizedGroupValuesColumn` and `GroupValuesColumn`.
  Rachelint
  committed
  2d982a1
- fix fmt.
  Rachelint
  committed
  e4bd579
- fix comments.
  Rachelint
  committed
  14fffb8
- fix clippy.
  Rachelint
  committed
  d479cc2

Commits

Commits on Oct 16, 2024

Commits on Oct 17, 2024

Commits on Oct 19, 2024

Commits on Oct 21, 2024

Commits on Oct 22, 2024

Commits on Oct 23, 2024

Commits on Oct 25, 2024

Commits on Oct 26, 2024

Commits on Oct 27, 2024

Commits on Oct 28, 2024

Commits on Oct 29, 2024

Commits on Oct 30, 2024

Commits on Oct 31, 2024

Commits on Nov 1, 2024

Commits on Nov 2, 2024

Commits on Nov 4, 2024