Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sample data cannot be downloaded. #2807

Open
sktometometo opened this issue Nov 16, 2023 · 2 comments
Open

Sample data cannot be downloaded. #2807

sktometometo opened this issue Nov 16, 2023 · 2 comments

Comments

@sktometometo
Copy link
Contributor

Some sample data are not downloaded during catkin build.

And this seems to come from wkentaro/gdown#43

We have to find some workarounds about this problem (that we cannot download file which is downloaded many times) or think about another solution for storages about sample data.

	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1B1oC6C9ZrjOQTScmbWwR_Y91GAFIg4bu 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1B1oC6C9ZrjOQTScmbWwR_Y91GAFIg4bu 

[/home/sktometometo/.ros/data/jsk_perception/2020-11-11-15-58-47-d435-floor.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1f99gIK92EsGvVI5ahHAV5g8xoEHyQhtv 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1f99gIK92EsGvVI5ahHAV5g8xoEHyQhtv 

[/home/sktometometo/.ros/data/jsk_perception/insta360_air.bag.tgz] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1WKnd-gDgp3GCWOAPtwg1lkrPqBiIyB_l 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1WKnd-gDgp3GCWOAPtwg1lkrPqBiIyB_l 

[/home/sktometometo/.ros/data/jsk_perception/fisheye_stitcher_grid_xd_yd_3840x1920_fetch15.yml.gz] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1SZwyUT14uEDuKvBzv6K0iOcYJoIIbaI0 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1SZwyUT14uEDuKvBzv6K0iOcYJoIIbaI0 

[/home/sktometometo/.ros/data/jsk_perception/fisheye_stitcher_grid_xd_yd_3840x1920_fetch1075.yml.gz] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1VFK46da5CMIYaUaDw5DVy2ZQOTrOn-dO 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1VFK46da5CMIYaUaDw5DVy2ZQOTrOn-dO 

[/home/sktometometo/.ros/data/jsk_perception/fisheye_stitcher_grid_xd_yd_3840x1920_oem.yml.gz] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1cyXdDPrdOiee9xOE8fW-3TWDCbCuwLBP 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1cyXdDPrdOiee9xOE8fW-3TWDCbCuwLBP 

[/home/sktometometo/.ros/data/jsk_perception/2022-04-07-18-36-43_hand_pose_estimation_2d.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1f613TsYuPk1DWuGuUfkJVBbPv2-4Io69 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1f613TsYuPk1DWuGuUfkJVBbPv2-4Io69 

[/home/sktometometo/.ros/data/jsk_perception/sample_rect_array_in_panorama_to_bounding_box_array.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1DZ6W7gBzbu-7Z-NRw7y0WCGDRpsaYadI 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1DZ6W7gBzbu-7Z-NRw7y0WCGDRpsaYadI 

[/home/sktometometo/.ros/data/jsk_perception/sample_mask_rcnn_73b2_kitchen.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1Kfgj7rkuQB14o73t7FbkAee19oNKkYSt 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1Kfgj7rkuQB14o73t7FbkAee19oNKkYSt 

[/home/sktometometo/.ros/data/jsk_perception/sample_mask_rcnn_73b2_kitchen_japanese_label.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1QL_PqvdVtWBTTqiFGYzODayVXln3ee9w 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1QL_PqvdVtWBTTqiFGYzODayVXln3ee9w 

[/home/sktometometo/.ros/data/jsk_perception/fetch_go_to_kitchen.bag] could not download file. maximum download trial exceeded.
In file included from /home/sktometometo/ros/ws_jsk_ros_pkg/src/jsk_recognition/jsk_perception/include/jsk_perception/tabletop_color_difference_likelihood.h:44,
                 from /home/sktometometo/ros/ws_jsk_ros_pkg/src/jsk_recognition/jsk_perception/src/tabletop_color_difference_likelihood.cpp:40:
/home/sktometometo/ros/ws_jsk_ros_pkg/src/jsk_recognition/jsk_recognition_utils/include/jsk_recognition_utils/tf_listener_singleton.h: In member function ‘jsk_recognition_utils::TfListenerSingleton& jsk_recognition_utils::TfListenerSingleton::operator=(const jsk_recognition_utils::TfListenerSingleton&)’:
/home/sktometometo/ros/ws_jsk_ros_pkg/src/jsk_recognition/jsk_recognition_utils/include/jsk_recognition_utils/tf_listener_singleton.h:54:64: warning: no return statement in function returning non-void [-Wreturn-type]
   54 |     TfListenerSingleton& operator=(TfListenerSingleton const&){};
      |                                                                ^
      |                                                                return *this;
cd /home/sktometometo/ros/ws_jsk_ros_pkg/build/jsk_perception; catkin build --get-env jsk_perception | catkin env -si  /usr/bin/make --jobserver-auth=3,4; cd -

..................................................................................................................................................................................................................
Finished  <<< jsk_perception                         [ 8 minutes and 56.8 seconds ]                                                                                                                               
Starting  >>> jsk_pcl_ros_utils                                                                                                                                                                                   
__________________________________________________________________________________________________________________________________________________________________________________________________________________
Warnings   << jsk_pcl_ros_utils:cmake /home/sktometometo/ros/ws_jsk_ros_pkg/logs/jsk_pcl_ros_utils/build.cmake.000.log                                                                                            
** WARNING ** io features related to pcap will be disabled
** WARNING ** io features related to png will be disabled
** WARNING ** io features related to libusb-1.0 will be disabled
CMake Warning (dev) at CMakeLists.txt:62 (find_package):
  Policy CMP0074 is not set: find_package uses <PackageName>_ROOT variables.
  Run "cmake --help-policy CMP0074" for policy details.  Use the cmake_policy
  command to set the policy and suppress this warning.

  CMake variable PCL_ROOT is set to:

    /usr

  For compatibility, CMake is ignoring the variable.
This warning is for project developers.  Use -Wno-dev to suppress it.

cd /home/sktometometo/ros/ws_jsk_ros_pkg/build/jsk_pcl_ros_utils; catkin build --get-env jsk_pcl_ros_utils | catkin env -si  /usr/bin/cmake /home/sktometometo/ros/ws_jsk_ros_pkg/src/jsk_recognition/jsk_pcl_ros_utils --no-warn-unused-cli -DCATKIN_DEVEL_PREFIX=/home/sktometometo/ros/ws_jsk_ros_pkg/devel/.private/jsk_pcl_ros_utils -DCMAKE_INSTALL_PREFIX=/home/sktometometo/ros/ws_jsk_ros_pkg/install; cd -

..................................................................................................................................................................................................................
________________________________________________________________________________________________________ Warnings   << jsk_pcl_ros_utils:make /home/sktometometo/ros/ws_jsk_ros_pkg/logs/jsk_pcl_ros_utils/build.make.000.log

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=13SFY5aY6MgYVZhq3obll2DE5ns_Rmei2 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1thJxY4BJrU1ltxBoWstTaMEQfhFmsls4 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1RvpUWnPJogYw_n7IRfmt6ONpUD1ZETus 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1LhuGYlPNXEJW-G3dOwxD60z3k9KvYRxg 


 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=13SFY5aY6MgYVZhq3obll2DE5ns_Rmei2 

[/home/sktometometo/.ros/data/jsk_pcl_ros_utils/bunny_marker_array.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1LhuGYlPNXEJW-G3dOwxD60z3k9KvYRxg 

[/home/sktometometo/.ros/data/jsk_pcl_ros_utils/2017-02-05-16-11-09_shelf_bin.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1thJxY4BJrU1ltxBoWstTaMEQfhFmsls4 

[/home/sktometometo/.ros/data/jsk_pcl_ros_utils/arc2017_4objects.bag] could not download file. maximum download trial exceeded.

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1RvpUWnPJogYw_n7IRfmt6ONpUD1ZETus 

[/home/sktometometo/.ros/data/jsk_pcl_ros_utils/2019-11-03-hsr-multi-objects-in-shelf.bag] could not download file. maximum download trial exceeded.
@k-okada
Copy link
Member

k-okada commented Nov 16, 2023

Are you saying that the error is caused by google's bandwidth limitation? if so, how about preparing a file packed with sample data? For exampe, downloading https://drive.google.com/drive/u/1/folders/1uVlR00jbwYHgXPIfQ-yLsZN5d5yrjxpw and extracting it to your home direfctory? If there are missing sample data, please add that fie into tgz.

@sktometometo
Copy link
Contributor Author

Are you saying that the error is caused by google's bandwidth limitation?

The problems, according to wkentaro/gdown#43 (comment), there are some limitations for access without OAuth to Google Drive and gdown cannot resolve it.

if so, how about preparing a file packed with sample data?

This may not fundamentally resolve the problem because the same problem will happen if new file will be downloaded many times.

With current configuration, sample data will be downloaded automatically if it is built with catkin build. So I am suspecting there are some people in the world who run CI where jsk_recognition is downloaded, built and sample data is downloaded and download capacity is ran out.

If so we also need default configuration about catkin build of jsk_recognition so that sample data is not downloaded automatically. How do you think? @k-okada

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants