Skip to content

Add quantal#629

Open
PaytonWebber wants to merge 1 commit into
erikbern:mainfrom
PaytonWebber:add-quantal
Open

Add quantal#629
PaytonWebber wants to merge 1 commit into
erikbern:mainfrom
PaytonWebber:add-quantal

Conversation

@PaytonWebber

Copy link
Copy Markdown

This adds quantal, an embedded vector index with a Zig core: an HNSW-style graph routes over 1-bit SimHash codes, 3-bit TurboQuant codes score the candidate pool, and an exact pass (sq8 by default) settles the final order. Angular and dot metrics are supported.

Following the checklist in the README:

  • Python wrapper in module.py
  • Dockerfile (installs the published quantaldb wheel; dimensions the wheel does not bundle are compiled in the image with Zig, so runs never pay a compile)
  • Hyper-parameters in config.yml (ef_construction at build time, candidate-pool size m swept at query time)
  • Added to the CI matrix in .github/workflows/benchmarks.yml

Tested locally on random-xs-20-angular with --runs 2, both standard and --batch mode, plus plot.py over the results.

Disclosure: I am the author of quantal.

quantal is an embedded vector index that combines HNSW-style graph
routing over 1-bit SimHash codes with 3-bit TurboQuant scoring and an
exact rerank pass. Supports angular and dot metrics. Installed from
PyPI (quantaldb); dimensions the wheel does not bundle are compiled in
the Dockerfile with Zig.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant