README.md

RoRD SLAM

Pretrained Models and dataset

1. Download models from Google Drive (73.9 MB) in the base directory.
2. Download dataset from Google Drive (97.8 MB)

Generating top view

1. Selects four points in the image in the Region of interest, whose top view is required:
   1. python getRealOneGazebo.py --rgb 'data/drone1/rgb/rgb000540.jpg' --depth 'data/drone1/depth/depth000540.npy' --camera_file configs/camera_gazebo_drone.txt

Caculating transformation

1. Inferring on gazebo dataset in orthographic view:
   1. cd demo
   2. python register.py --rgb1 <img1.jpg> --rgb2 <img2.jpg> --depth1 <depth1.npy> --depth2 <depth2.npy> --camera_file ../configs/camera_gazebo.txt --H ../configs/topH.npy --model_rord ../models/rord.pth --viz3d --save_trans
   3. If homography is different for the two images, then use --H and --H2 flags:
   python register.py --H <first_homography.npy> --H2 <second_homography.npy>

2. Converting RoRD transformations (in camera frame and in left handed system) to loop closure transformations (in odom frame and in right handed system):

   1. Getting static transform from ros, Tbase_camera or Camera wrt Base link

      1. rosrun tf tf_echo base_link camera_link

   2. Transformations for SE2 and SE3:

      1. SE2 Optimization:
         1. python cordTrans.py --static_trans ../configs/camWrtBase.txt --rord_trans ../demo/transLC.npy
      2. SE3 Optimization:
         1. python cordTrans.py --static_trans ../configs/camWrtBaseDrone.txt --rord_trans ../data/drone1/transLC212_2275.npy --se3

   3. Derivation of how transformations in cordTrans.py are dervied can be found here.

Optimizing pose graph

1. cd pose_graph
2. Generating odometry edges noise.g2o using gazebo's odometer output poses.txt.
   1. SE2 Optimization:
      1. python genG2o.py data5/poses.txt
   2. SE3 Optimization:
      1. python genG2oSE3.py drone1/poses.txt
3. Adding loop closure edges loop_pairs.txt to generated odometry edges noise.g2o to output noise_lc.g2o. Also optimizing odometry and loop closure edges stored in noise_lc.g2o to output opt.g2o.
   1. SE2 Optimization:
      1. python optimizePose.py data5/noise.g2o data5/loop_pairs.txt
   2. SE3 Optimization:
      1. python optimizePoseSE3.py drone1/noise.g2o drone1/loop_pairs.txt drone1/gt.g2o