Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is the IOU_1 value higher than the paper? #21

Open
deepzzz123 opened this issue Mar 22, 2022 · 4 comments
Open

Is the IOU_1 value higher than the paper? #21

deepzzz123 opened this issue Mar 22, 2022 · 4 comments

Comments

@deepzzz123
Copy link

hi,I am using the pretrained model in the checkpoint file folder,then I run: sh scripts/eval.sh,
the result dispaly:
acc: 0.98980 miou: 0.90326 mf1: 0.94702 iou_0: 0.98931 iou_1: 0.81721 F1_0: 0.99463 F1_1: 0.89941 precision_0: 0.99440 precision_1: 0.90329 recall_0: 0.99485 recall_1: 0.89557
It seem that the result is different with the paper,is this result accuracy or something else wrong?Appreciate getting your reply.

@ghost
Copy link

ghost commented Mar 23, 2022

I want to ask the same question, in the paper any value of iou, F1, precision , recall has one value but when applying code there are two values for 0 and 1.
how to calculate the result in the paper? is it the average?

@HugoHann
Copy link

I want to ask the same question, in the paper any value of iou, F1, precision , recall has one value but when applying code there are two values for 0 and 1. how to calculate the result in the paper? is it the average?

I think these two values represent the scores of the two categories of areas without change and areas with changes, we focus on scores of areas with changes, which means focus on value XXX_1.

@Moonquakes0
Copy link

Hi, I have used the pretrained model in the checkpoint file folder, but I got poor results on the LEVIR-CD dataset. Can you tell me why this is so?

@yxzz1121
Copy link

yxzz1121 commented Dec 2, 2023

hi,I am using the pretrained model in the checkpoint file folder,then I run: sh scripts/eval.sh,
the result dispaly:
acc: 0.98980 miou: 0.90326 mf1: 0.94702 iou_0: 0.98931 iou_1: 0.81721 F1_0: 0.99463 F1_1: 0.89941 precision_0: 0.99440 precision_1: 0.90329 recall_0: 0.99485 recall_1: 0.89557
It seem that the result is different with the paper,is this result accuracy or something else wrong?Appreciate getting your reply.
i also got the same results with you. is exactly the same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants