Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About roll angle rectify after image flipping #50

Open
sunnyykk opened this issue Mar 5, 2024 · 3 comments
Open

About roll angle rectify after image flipping #50

sunnyykk opened this issue Mar 5, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@sunnyykk
Copy link

sunnyykk commented Mar 5, 2024

Hello,

I noticed that in line 159, you employed random flipping to augment the query and map images, and later, in line 164, the query image are rectified by setting the roll and pitch angles to zero. However, I'm wondering if a negative sign should be applied to the roll angle during the rectification process after the images have been flipped.

I'm quite new to this area, thank you for your attention to this detail!

@sunnyykk
Copy link
Author

sunnyykk commented Mar 6, 2024

To further elaborate on the issue mentioned above, some visualizations are provided:

  • The first image below is a training image after random_flip function, which includes mirrored Chinese characters;
  • The following image is after gravity correction using the process_image function; note that the lateral roll angle has become larger;
  • The third image is the result after I took the negative value of the roll angle and reprocess it;

Is it possible that there is a bug in the gravity correction process during training that might potential affect half of the augmented training samples?

@sarlinpe
Copy link
Collaborator

sarlinpe commented Mar 6, 2024

You are right, thank you investigating and reporting this! I likely missed it on visual inspection because most images of our dataset have zero roll. I still think that fixing it will improve the model. Could you submit a PR for it? I'll retrain the model once I find the time.

@sunnyykk
Copy link
Author

sunnyykk commented Mar 6, 2024

thanks! I will submit it~

@AlanSavio25 AlanSavio25 mentioned this issue Mar 22, 2024
@sarlinpe sarlinpe added the bug Something isn't working label Aug 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants