How to reproduce the n shot VQA, OKVQA and GQA results from Table -1? No eval script is available

[sanyalsunny111]

Hey Authors,

Awesome work, could you please provide me with the fewshot/zeroshot eval script to reproduce your VQA/OKVQA/GQA results in Table-1? cc @benbrandt @countably1nfinite @sdtblck @Mayukhdeb.

[SamSoup]

Seconded! It would be very helpful to have the evaluation scripts.

[CoEich]

Hi,

currently the eval scripts are not in a releasable state. I might clean them up and add them at some point but can't promise.

We largely follow the implementation in https://github.com/GT-Vision-Lab/VQA/tree/master.

The rest of the details is in our paper https://arxiv.org/abs/2112.05253.

I hope this helps, if there are questions left feel free to ask :-)

Best,

Constantin