EgoVideo

Champion Solutions repository for EgoVis challenges in CVPR2024 workshop.

Techical report

📢News

(2022/06/27) 🚀We release the EgoVideo Backbone model and the feature extraction script.

(2024/06/25) 🔄The repository is created.

Catalog

• Codes for Feature Extractor
• Codes for Goalsteps and NLQ
• Codes for EK-100 Action Recognition
• Codes for EK-100 MIR
• Codes for STA
• Codes for LTA
• Codes for MQ

The EgoVideo Backbone model and Feature Extraction.

We provide the pretrained EgoVideo Backbone model and feature extraction script.

Model	Google Drive	Ek100 MIR mAP	Ek100 MIR nDCG
EgoVideo-4frames	Download	45.9	38.6

You can check more details in the backbone folder.

Downstream adaptation towards different tasks

We will gradually update the code and models for downstream adaptation on different tasks using our EgoVideo backbone.

🎓Citation

If this work is helpful for your research, please consider citing our technical report.

@article{pei2024egovideo,
  title={EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptation},
  author={Pei, Baoqi and Chen, Guo and Xu, Jilan and He, Yuping and Liu, Yicheng and Pan, Kanghua and Huang, Yifei and Wang, Yali and Lu, Tong and Wang, Limin and Qiao, Yu},
  journal={arXiv preprint arXiv:2406.18070 },
  year={2024}
}

@article{chen2022ego4d,
  title={InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challenges},
  author={Chen, Guo and Xing, Sen and Chen, Zhe and Wang, Yi and Li, Kunchang and Li, Yizhuo and Liu, Yi and Wang, Jiahao and Zheng, Yin-Dong and Huang, Bingkun and others},
  journal={arXiv preprint arXiv:2211.09529},
  year={2022}
}

Our previous eccv-2022 champion solutions can be found at eccv-2022