Tracking Issue: Support vector search in KQIR

[Beihao-Zhou]

Search before asking

• I had searched in the issues and found no similar issues.

Motivation

This includes:

• Implementing vector indexing algorithm, i.e. HNSW & Adding vector indexing support for KQIR Indexer - feat(search): Add HNSW encoding index & insertion/deletion algorithm #2368
• Plan operator & executor for vector indexing - feat(search): Hnsw Vector Search Plan Operator & Executor #2434
• Supporting relevant syntax parsing in front-end languages (SQL, RediSearch query) - feat(search): implement vector query for sql/redisearch parser & transformer #2450
• Add Optimization Pass, including Index Selection & KnnExpr transformation - feat(search): Hnsw Vector Search Optimizaton Pass #2466
• Add command to support Hnsw index creation - feat(search): add support of HNSW vector fields for FT.CREATE #2477
• Documentation on Kvrocks Search - Update KVrocks search index encoding documentation kvrocks-website#241

Further Steps

• Improvement for HNSW construction - Avoid HnswIndex heavy construction because of mt19937 #2398
• Create a const version of HnswIndex that takes a const pointer to HnswVectorFieldMetadata - feat(search): Hnsw Vector Search Plan Operator & Executor #2434 (comment)
• Support Hybrid Query
• Improve consistency

Solution

• [Proposal] Vector Similarity Search Indexing #2287
• Vector Search HNSW Indexing Encoding #2316

Are you willing to submit a PR?

• I'm willing to submit a PR!

[PragmaTwice]

Would you like to add the encoding format of vector index to https://kvrocks.apache.org/community/kvrocks-search-index-encoding/ when you have time?