Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

low mAP on coco val2014 #513

Open
janetwise opened this issue May 27, 2020 · 10 comments
Open

low mAP on coco val2014 #513

janetwise opened this issue May 27, 2020 · 10 comments

Comments

@janetwise
Copy link

Has anyone been able to reproduce the mAP of ~55 by running:
python3 test.py --weights_path weights/yolov3.weights
I was only able to get mAP 50? I got mAP 53 by setting the image size to 608.

I just cloned the repo today and downloaded the yolov3 weights as shown in the script.

I got mAP 29 using the yolov3_tiny.weights. Is it in the right range?
Thank in advance!

@ThanhPham1987
Copy link

me too

2 similar comments
@jinlintansjtu
Copy link

me too

@lovedoubledan
Copy link

me too

@hank08tw
Copy link

me too I only got mAP: 0.5145196513137332 map

@yanxiaod123
Copy link

me too, why?

@LeungWaiHo
Copy link

me too, I think if it has contingency?

@Flova Flova mentioned this issue Mar 6, 2021
@qqsuhao
Copy link

qqsuhao commented Mar 31, 2021

I clone the code on 2020-03-31 and run the "test.py" with yolov3.weights, but I just get mAP: 0.3794739921856155.

@Flova
Copy link
Collaborator

Flova commented Apr 2, 2021

What confidence threshold did you use? The yolo paper uses afaik relatively low thresholds such as 0.001 combined with another test dataset called test-dev.

@yjy4231
Copy link

yjy4231 commented Apr 9, 2021

What confidence threshold did you use? The yolo paper uses afaik relatively low thresholds such as 0.001 combined with another test dataset called test-dev.

How can I get the test-dev ?

@Flova
Copy link
Collaborator

Flova commented Aug 2, 2021

Have a look at this list https://cocodataset.org/#download

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

10 participants