Move vector search from IndexInput to RandomAccessInput

[jpountz]

Description

Vector search currently loads vectors from disk by issuing a seek() followed by a readFloats(). We should instead:

• Add an absolute readFloats() method to RandomAccessInput
• Refactor the latest vector search file format to use RandomAccessInput instead of IndexInput to read vectors from disk.

[dungba88]

Hi, I'm learning Lucene KNN and this seems to be a workable PR for beginner. Just curious about the motivation behind this change. Is it only for cleaner code, or are we also suppose to make any latency improvement on the absolute readFloats method compare to the current seek() + readFloats()?

[msokolov]

I think this will be helpful since currently we cannot share these readers across threads -- they retain the state information about the current position. Not sure how much benefit that will be since they must still typically maintain some local temporary storage to retain the value that is read

[dungba88]

I think this will be helpful since currently we cannot share these readers across threads -- they retain the state information about the current position. Not sure how much benefit that will be since they must still typically maintain some local temporary storage to retain the value that is read

Gotcha, the current usage of seek + readFloats requires the Reader to keep the seek position. When we change to the RandomAccessInput, we expect the operation to have no side-effect to the Reader and thus they will be sharable.

[dungba88]

I looked at some implementation of RandomAccessInput, such as BufferedIndexInput. This particular class holds a single buffer for all reads, thus it cannot be shared. If we use temporary buffer (to make it shareable), then it kinda defeats the purpose of the single-buffer, which is to avoid excessive temporary buffers and GC. So it's unavoidable to have side-effects in read.

[dungba88]

@jpountz it's only a draft (I need to add tests), but can you give some feedbacks on #13981. I'm not sure if I have fully captured the intention of this change.