Repository navigation

StatisticsV2: initial statistics framework redesign - #14699

Merged

ozankabak merged 100 commits into

apache:mainfrom

Fly-Style:feat/statistics_v2

Feb 24, 2025

Merged

StatisticsV2: initial statistics framework redesign#14699
ozankabak merged 100 commits into
apache:mainfrom
Fly-Style:feat/statistics_v2

Commits on Jan 8, 2025
- StatisticsV2: initial definition and validation method implementation
  
  Sasha Syrotenko
  authored and
  Fly-Style
  committed
  b4e8668
Commits on Jan 9, 2025
- Implement mean, median and standard deviation extraction for StatsV2
  Fly-Style
  committed
  992b3c0
Commits on Jan 11, 2025
- Move stats_v2 to `physical-expr` package
  Fly-Style
  committed
  e1d9395
Commits on Jan 12, 2025
- Introduce `ExprStatisticGraph` and `ExprStatisticGraphNode`
  Fly-Style
  committed
  1e27828
- Split the StatisticsV2 and statistics graph locations, prepare the infrastructure for stats top-down propagation and final bottom-up calculation
  Fly-Style
  committed
  674926f
Commits on Jan 14, 2025
- Merge branch 'apache_main' into feat/statistics_v2
  Fly-Style
  authored
  943b5f1
Commits on Jan 15, 2025
- Calculate variance instead of std_dev
  Fly-Style
  committed
  45f151e
- Create a skeleton for statistics bottom-up evaluation
  Fly-Style
  committed
  7329c03
Commits on Jan 16, 2025
Commits on Jan 17, 2025
- Introduce Bernoulli distribution to be used as result of comparisons and inequations distribution combinations
  Fly-Style
  committed
  81b756d
Commits on Jan 20, 2025
- Implement initial statistics propagation of Uniform and Unknown distributions with known ranges
  Fly-Style
  committed
  a35440b
Commits on Jan 21, 2025
- Implement evaluate_statistics for logical not and unary negation operator
  Fly-Style
  committed
  518d56c
Commits on Jan 25, 2025
- Fix and add tests; make fmt happy
  Fly-Style
  committed
  a1bbfce
Commits on Jan 26, 2025
- Add integration test, implement conversion into Bernoulli distribution for Eq and NotEq
  Fly-Style
  committed
  d9c2d83
Commits on Jan 27, 2025
- Finish test, small cleanup
  Fly-Style
  committed
  c3df2a6
Commits on Jan 29, 2025
- minor improvements
  berkaysynnada
  committed
  a00e382
- Update stats.rs
  berkaysynnada
  committed
  6245218
- Addressing review comments
  Fly-Style
  committed
  b8068b8
Commits on Jan 31, 2025
- Implement median colmputation for Gaussian-Gaussian pair
  Fly-Style
  committed
  140fb5e
Commits on Feb 1, 2025
- Update stats_v2.rs
  berkaysynnada
  committed
  5630ff9
Commits on Feb 2, 2025
- minor improvements
  berkaysynnada
  committed
  c3b96ed
- Addressing second review comments, part 1
  Fly-Style
  committed
  f4dd402
- Return true in other cases
  Fly-Style
  committed
  eac21f1
Commits on Feb 4, 2025
- Finish addressing review requrests, part 2
  Fly-Style
  committed
  10e187f
- final clean-up
  berkaysynnada
  committed
  ee4f7ab
- bug fix
  berkaysynnada
  committed
  4f190b8
- final clean-up
  berkaysynnada
  committed
  9d8baa5
- apply reverse logic in stats framework as well
  berkaysynnada
  committed
  1523ffc
- Merge branch 'feat/statistics_v2' of https://github.com/Fly-Style/datafusion into feat/statistics_v2
  berkaysynnada
  committed
  d78b19d
- Update cp_solver.rs
  berkaysynnada
  committed
  f78bb22
- revert data.parquet
  berkaysynnada
  committed
  29db57f
Commits on Feb 5, 2025
- Apply suggestions from code review
  ozankabak
  authored
  be61480
- Update datafusion/physical-expr-common/src/stats_v2.rs
  ozankabak
  authored
  2d108e3
- Update datafusion/physical-expr-common/src/stats_v2.rs
  ozankabak
  authored
  e6e35e9
- Apply suggestions from code review
  ozankabak
  authored
  19903c3
- Merge branch 'apache_main' into feat/statistics_v2
  Fly-Style
  committed
  ea94aae
- Fix compilation issue
  Fly-Style
  committed
  3c6f44b
- Fix mean/median formula for exponential distribution
  Fly-Style
  committed
  6305ebf
Commits on Feb 6, 2025
- casting + exp dir + remove opt's + is_valid refractor
  berkaysynnada
  committed
  ef87360
- Update stats_v2_graph.rs
  berkaysynnada
  committed
  7baa86f
- remove inner mod
  berkaysynnada
  committed
  8b82289
- last todo: bernoulli propagation
  berkaysynnada
  committed
  889376e
Commits on Feb 7, 2025
- Apply suggestions from code review
  ozankabak
  authored
  243fad8
- Apply suggestions from code review
  ozankabak
  authored
  cf965a4
Commits on Feb 9, 2025
- prop_stats in binary
  berkaysynnada
  committed
  48f2b5e
- Update binary.rs
  berkaysynnada
  committed
  8fddaba
- rename intervals
  berkaysynnada
  committed
  a18b0dd
Commits on Feb 10, 2025
- block explicit construction
  berkaysynnada
  committed
  bc4f7d4
- test updates
  berkaysynnada
  committed
  97f0408
- Update binary.rs
  berkaysynnada
  committed
  22ea336
- revert renaming
  berkaysynnada
  committed
  77b8f20
- impl range methods as well
  berkaysynnada
  committed
  7dca5ee
- Apply suggestions from code review
  ozankabak
  authored
  bcf2752
- Apply suggestions from code review
  ozankabak
  authored
  d390227
- Update datafusion/physical-expr-common/src/stats_v2.rs
  ozankabak
  authored
  9f54e94
- Update stats_v2.rs
  berkaysynnada
  committed
  b769daf
- fmt
  berkaysynnada
  committed
  aebe139
- fix bernoulli or eval
  berkaysynnada
  committed
  7d7dd92
- fmt
  berkaysynnada
  committed
  6b6ce31
- Review
  ozankabak
  committed
  42804c9
- Review Part 2
  ozankabak
  committed
  65cdc05
- not propagate
  berkaysynnada
  committed
  9b2a115
- clean-up
  berkaysynnada
  committed
  a8e0274
- Review Part 3
  ozankabak
  committed
  ba8126b
Commits on Feb 11, 2025
- Review Part 4
  ozankabak
  committed
  4f95d27
- Review Part 5
  ozankabak
  committed
  c75c782
- Review Part 6
  ozankabak
  committed
  7ebf43e
- Review Part 7
  ozankabak
  committed
  bab97d8
- Review Part 8
  ozankabak
  committed
  818eba4
- Review Part 9
  ozankabak
  committed
  da2ce64
- Review Part 10
  ozankabak
  committed
  0cc8a2d
- Review Part 11
  ozankabak
  committed
  eee36de
- Review Part 12
  ozankabak
  committed
  07a070f
- Review Part 13
  ozankabak
  committed
  320aeb6
- Review Part 14
  ozankabak
  committed
  9d2a6f3
Commits on Feb 12, 2025
- Review Part 15 | Fix equality comparisons between uniform distributions
  ozankabak
  committed
  712d936
- Review Part 16 | Remove unnecessary temporary file
  ozankabak
  committed
  2163c76
- Review Part 17 | Leave TODOs for real-valued summary statistics
  ozankabak
  committed
  c23974e
- Review Part 18
  ozankabak
  committed
  fee3023
- Review Part 19 | Fix variance calculations
  ozankabak
  committed
  2566c91
- Review Part 20 | Fix range calculations
  ozankabak
  committed
  195cd50
- Review Part 21
  ozankabak
  committed
  d753eeb
- Review Part 22
  ozankabak
  committed
  b081ea4
Commits on Feb 13, 2025
- Review Part 23
  ozankabak
  committed
  f8cade9
- Review Part 24 | Add default implementations for evaluate_statistics and propagate_statistics
  ozankabak
  committed
  44b6b64
Commits on Feb 14, 2025
- Review Part 25 | Improve docs, refactor statistics graph code
  ozankabak
  committed
  54030b8
- Review Part 26
  ozankabak
  committed
  940adbc
- Review Part 27
  ozankabak
  committed
  ad2c518
- Review Part 28 | Remove get_zero/get_one, simplify propagation in statistics graph
  ozankabak
  committed
  081e3f3
- Review Part 29
  ozankabak
  committed
  6d0e9e3
- Review Part 30 | Move statistics-combining functions to core module, polish tests
  ozankabak
  committed
  6854c68
- Review Part 31
  ozankabak
  committed
  3192eef
- Review Part 32 | Module reorganization
  ozankabak
  committed
  47dc8f7
- Review Part 33
  ozankabak
  committed
  d5741cd
Commits on Feb 16, 2025
- Add tests for bernoulli and gaussians combination
  Fly-Style
  committed
  cc99a9d
Commits on Feb 23, 2025
- Incorporate community feedback
  ozankabak
  committed
  3c0afec
- Merge branch 'main' into feat/statistics_v2
  ozankabak
  authored
  aa4b02e
- Fix merge issue
  ozankabak
  committed
  17d7a7a

Commits

Commits on Jan 8, 2025

Commits on Jan 9, 2025

Commits on Jan 11, 2025

Commits on Jan 12, 2025

Commits on Jan 14, 2025

Commits on Jan 15, 2025

Commits on Jan 16, 2025

Commits on Jan 17, 2025

Commits on Jan 20, 2025

Commits on Jan 21, 2025

Commits on Jan 25, 2025

Commits on Jan 26, 2025

Commits on Jan 27, 2025

Commits on Jan 29, 2025

Commits on Jan 31, 2025

Commits on Feb 1, 2025

Commits on Feb 2, 2025

Commits on Feb 4, 2025

Commits on Feb 5, 2025

Commits on Feb 6, 2025

Commits on Feb 7, 2025

Commits on Feb 9, 2025

Commits on Feb 10, 2025

Commits on Feb 11, 2025

Commits on Feb 12, 2025

Commits on Feb 13, 2025

Commits on Feb 14, 2025

Commits on Feb 16, 2025

Commits on Feb 23, 2025