Skip to content

Simple image search engine, based on image-text-vector transformation.

License

Notifications You must be signed in to change notification settings

MarinaGorbacheva/image-search

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Credits

For images caption generation OFA-model is used (https://github.com/ofa-sys/ofa).

For word embedding - "all-distilroberta-v1" model (https://huggingface.co/sentence-transformers/all-distilroberta-v1).

Elasticsearch for indexing.

Project structure

The repository is missing modules "criterions", "data", "fairseq", "models", "tasks" and "utils" from the original OFA repository. Also it is missing directories "dataset" (should contain images to index) and "checkpoints" (in my case it cointains "Finetuned checkpoint for Caption on COCO" checkpoint from the original repository (https://github.com/OFA-Sys/OFA/blob/main/checkpoints.md)).

The presented GUI is incomplete.

About

Simple image search engine, based on image-text-vector transformation.

Topics

Resources

License

Stars

Watchers

Forks

Languages