Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Camera calibration parameters #36

Open
diegotiozzo21 opened this issue Apr 30, 2024 · 0 comments
Open

Camera calibration parameters #36

diegotiozzo21 opened this issue Apr 30, 2024 · 0 comments

Comments

@diegotiozzo21
Copy link

I premise that I compiled the package by using "colcon build --packages-select isaac_ros_dope".
I'm facing some problems with this package while running on a NVIDIA Jetson Orin Nano.
More in detail, I think there could be some issues with the intrinsics of the camera.
I'm using the package with the images provided by an Intel RealSense d435i that is configured with "rgb_camera.profile:=640x480x30".
I'm quite sure that the node "dope_decoder_node" is loading the camera calibration parameters that I specified in the "dope_config.yaml" file.
The calibration parameters specified in the "dope_config.yaml" are the following: [605.6713256835938, 0, 329.4186706542969, 0, 605.2176513671875, 245.733154296875, 0, 0, 1]. These parameters are the same of those in the "camera_info" topic.
The package is running quite well in the Jetson Orin Nano but the estimated position of the object that I'm detecting (Campbell's Tomato soup) looks too close to the camera.
The object is approximately 20 cm far from the camera but DOPE is estimating a distance of something like 10 cm.
Moreover, I recorded a bag file with the following topics: images, camera_info, and poses. In my laptop, I converted the bag file to be used in ROS1 Noetic. Subsequently, I used the bag file to run DOPE (https://github.com/NVlabs/Deep_Object_Pose) and compare the results.
As you can see from the following image, the results provided by the isaac_ros_dope and the ROS1 DOPE are different.

dope_results_comparison

Thank you in advance for your help.

PS. In the Jetson Orin Nano, I'm using isaac_ros_dope with the weights converted in the ONNX format and with the "isaac_ros_dope_tensor_rt.launch.py" file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant