Inmemory storage implementation - #82
Merged
Merged
Conversation
Arshdeep54
requested changes
Jun 10, 2026
4adex
added a commit
that referenced
this pull request
Jul 23, 2026
* feat: add batch insert and search (#74) Signed-off-by: Arshdeep54 <balarsh535@gmail.com> * Inmemory storage implementation (#82) * Implement in-memory storage engine * Wire in-memory storage through API snapshots * Add HTTP smoke coverage for in-memory storage * Handle in-memory storage errors in gRPC * Add in-memory checkpoint header * Add async Python client (#83) * Add async Python client * Deduplicate Python gRPC connection helpers * Benchmarking optimizations (#84) * Reduce in-memory checkpoint lock scope * Optimize HNSW distance calculations * Expose HNSW tuning parameters * Add Python batch vector client methods * Expose KD-tree rebuild tuning parameters * Update tui with new name and details (#79) * Support query-time HNSW ef * Async batch support (#85) * Update Python client to support batch insert and search * Add batch support to the async client * Add master test script for all usage example files Run linter on client/python * Add test for api parity between sync and async classes --------- Signed-off-by: Arshdeep54 <balarsh535@gmail.com> Co-authored-by: Arshdeep Singh <110114582+Arshdeep54@users.noreply.github.com> Co-authored-by: Khushal Agrawal <117133859+SK1PPR@users.noreply.github.com> Co-authored-by: Khushal Agrawal <dev@khushal.net> Co-authored-by: Prachet Patel <patelprachet@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
MemoryStoragefor theStorageEnginetrait using a lock-protectedBTreeMapStorageType::InMemorythrough API initialization and snapshot restoreCloses #36.
Testing
cargo fmtcargo test -p storagecargo test -p apicargo test -p httpcargo test -p grpccargo testdocker build -t vortexdb:inmemory-smoke .STORAGE_TYPE=inmemory:GET /healthPOST /pointsGET /points/{id}POST /points/searchDELETE /points/{id}GET /points/{id}returns 404 after delete