Skip to content

knsjoon/awesome-hand-pose-estimation

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome Hand Pose Estimation Awesome

A curated list of related resources for hand pose estimation. Feel free to contribute!

Contents

* indicates equal contribution

Evaluation

See folder evaluation to get more details about performance evaluation for hand pose estimation.

arXiv Papers

[arXiv:2104.14639] HandsFormer: Keypoint Transformer for Monocular 3D Pose Estimation ofHands and Object in Interaction. [PDF]

Shreyas Hampali, Sayan Deb Sarkar, Mahdi Rad, Vincent Lepetit

[arXiv:2104.11181] H2O: Two Hands Manipulating Objects for First Person Interaction Recognition. [PDF]

Taein Kwon, Bugra Tekin, Jan Stuhmer, Federica Bogo, Marc Pollefeys

[arXiv:2104.03304] Hand-Object Contact Consistency Reasoning for Human Grasps Generation. [PDF] [Project]

Hanwen Jiang, Shaowei Liu, Jiashun Wang, Xiaolong Wang

[arXiv:2102.09244] HandTailor: Towards High-Precision Monocular 3D Hand Recovery. [PDF] [Code]

Jun Lv, Wenqiang Xu, Lixin Yang, Sucheng Qian, Chongzhao Mao, Cewu Lu

[arXiv:2102.07067] FastHand: Fast Hand Pose Estimation From A Monocular Camera. [PDF]

Shan An, Xiajie Zhang, Dong Wei, Haogang Zhu, Jianyu Yang, Konstantinos A. Tsintotas

[arXiv:2012.11260] Unsupervised Domain Adaptation with Temporal-Consistent Self-Training for 3D Hand-Object Joint Reconstruction. [PDF]

Mengshi Qi, Edoardo Remelli, Mathieu Salzmann, Pascal Fua

[arXiv:2012.06475] EventHands: Real-Time Neural 3D Hand Reconstruction from an Event Stream. [PDF] [Project]

Viktor Rudnev, Vladislav Golyanik, Jiayi Wang, Hans-Peter Seidel, Franziska Mueller, Mohamed Elgharib, Christian Theobalt

[arXiv:2012.09856] Reconstructing Hand-Object Interactions in the Wild. [PDF] [Project]

Zhe Cao, Ilija Radosavovic, Angjoo Kanazawa, Jitendra Malik

[arXiv:2012.09760] End-to-End Human Pose and Mesh Reconstruction with Transformers. [PDF]

Kevin Lin, Lijuan Wang, Zicheng Liu

[arXiv:2012.00924] CPF: Learning a Contact Potential Field to Model the Hand-object Interaction. [PDF] [Code]

Lixin Yang, Xinyu Zhan, Kailin Li, Wenqiang Xu, Jiefeng Li, Cewu Lu

[arXiv:2008.08324] FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integration. [PDF] [Project]

Yu Rong, Takaaki Shiratori, Hanbyul Joo

[arXiv:2006.05927] Recent Advances in 3D Object and Hand Pose Estimation. [PDF]

Vincent Lepetit

[arXiv:2001.08047] Attention! A Lightweight 2D Hand Pose Estimation Approach. [PDF]

Nicholas Santavas, Ioannis Kansizoglou, Loukas Bampis, Evangelos Karakasis, Antonios Gasteratos

[arXiv:2001.00702] HandAugment: A Simple Data Augmentation Method for Depth-Based 3D Hand Pose Estimation. [PDF] [Code]

Zhaohui Zhang, Shipeng Xie, Mingxiu Chen, Haichao Zhu

[arXiv:1912.12436] Silhouette-Net: 3D Hand Pose Estimation from Silhouettes. [PDF]

Kuo-Wei Lee, Shih-Hung Liu, Hwann-Tzong Chen, Koichi Ito

[arXiv:1911.12501] An End-to-end Framework for Unconstrained Monocular 3D Hand Pose Estimation. [PDF]

Sanjeev Sharma, Shaoli Huang, Dacheng Tao

[arXiv:1912.01875] GraphPoseGAN: 3D Hand Pose Estimation from a Monocular RGB Image via Adversarial Learning on Graphs. [PDF]

Yiming He, Wei Hu, Siyuan Yang, Xiaochao Qu, Pengfei Wan, Zongming Guo

[arXiv:1911.07424] Capturing Hand Articulations using Recurrent Neural Network for 3D Hand Pose Estimation. [PDF]

Cheol-hwan Yoo, Seung-wook Kim, Seo-won Ji, Yong-goo Shin, Sung-jea Ko

[arXiv:1807.00898] Model-based Hand Pose Estimation for Generalized Hand Shape with Appearance Normalization. [PDF]

Jan Wöhlke, Shile Li, Dongheui Lee

[arXiv:1705.09606] End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data. [PDF]

Meysam Madadi, Sergio Escalera, Xavier Baro, Jordi Gonzalez

[arXiv:1704.02224] Hand3D: Hand Pose Estimation using 3D Neural Network. [PDF] [Project]

Xiaoming Deng*, Shuo Yang*, Yinda Zhang*, Ping Tan, Liang Chang, Hongan Wang

[arXiv:1612.00596] Learning to Search on Manifolds for 3D Pose Estimation of Articulated Objects. [PDF]

Yu Zhang, Chi Xu, Li Cheng

[back to top]

Journal Papers

TPAMI / IJCV

• [2020 TPAMI] 3D Hand Pose Estimation Using Synthetic Data and Weakly Labeled RGB Images. [PDF]

Yujun Cai, Liuhao Ge, Jianfei Cai, Nadia Magnenat-Thalmann, Junsong Yuan

• [2019 TPAMI] Generalized Feedback Loop for Joint Hand-Object Pose Estimation. [PDF] [Project]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

• [2019 TPAMI] Feature Boosting Network For 3D Pose Estimation. [PDF]

Jun Liu, Henghui Ding, Amir Shahroudy, Ling-Yu Duan, Xudong Jiang, Gang Wang, Alex C. Kot

• [2018 TPAMI] Opening the Black Box: Hierarchical Sampling Optimization for Hand Pose Estimation. [PDF]

Danhang Tang*, Qi Ye*, Shanxin Yuan, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton

• [2018 IJCV] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges. [PDF] [Project] [Code]

James Steven Supančič III, Grégory Rogez, Yi Yang, Jamie Shotton, Deva Ramanan

• [2018 TPAMI] Real-time 3D Hand Pose Estimation with 3D Convolutional Neural Networks. [PDF]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

• [2016 IJCV] Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups. [PDF] [Project]

Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng

• [2016 TPAMI] Latent Regression Forest: Structured Estimation of 3D Hand Poses. [PDF]

Danhang Tang, Hyung Chang, Alykhan Tejani, Tae-Kyun Kim

• [2016 IJCV] Capturing Hands in Action using Discriminative Salient Points and Physics Simulation. [PDF] [Project]

Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte, Marc Pollefeys, Juergen Gall

• [2015 IJCV] Estimate Hand Poses Efficiently from Single Depth Images. [PDF] [Project] [Code]

Chi Xu, Ashwin Nanjappa, Xiaowei Zhang, Li Cheng

[back to top]

Other Journals

• [2021 TIP] Hand Pose Understanding with Large-Scale Photo-Realistic Rendering Dataset. [PDF]

Xiaoming Deng, Yinda Zhang, Jian Shi, Yuying Zhu, Dachuan Cheng, Dexin Zuo, Zhaopeng Cui, Ping Tan, Liang Chang, Hongan Wang

• [2021 TIP] Joint Hand-object 3D Reconstruction from a Single Image with Cross-branch Feature Fusion. [PDF]

Yujin Chen, Zhigang Tu, Di Kang, Ruizhi Chen, Linchao Bao, Zhengyou Zhang, Junsong Yuan

• [2021 Neurocomputing] Spatial-aware Stacked Regression Network for Real-time 3D Hand Pose Estimation. [PDF]

Pengfei Ren, Haifeng Sun, Weiting Huang, Jiachang hao, Daixuan Cheng, Qi Qi, Jingyu Wang, Jianxin Liao

• [2021 TMM] Differentiable Spatial Regression: A Novel Method for 3D Hand Pose Estimation. [PDF] [Code]

Xingyuan Zhang, Fuhai Zhang

• [2020 TIP] Weakly-supervised Learning for Single Depth based Hand Shape Recovery. [PDF]

Xiaoming Deng, Yuying Zhu, Yinda Zhang, Zhaopeng Cui, Ping Tan, Wentian Qu, Cuixia Ma, Hongan Wang

• [2020 Signal Process Image Commun] Accurate 3D Hand Pose Estimation Network Utilizing Joints Information. [PDF]

Xiongquan Zhang; Shiliang Huang; Zhongfu Ye

• [2020 TCSVT] Improve Regression Network on Depth Hand Pose Estimation with Auxiliary Variable. [PDF]

Lu Xu, Chen Hu, Ji’an Tao, Jianru Xue, Kuizhi Mei

• [2020 TVCG] 3D Hand Tracking in the Presence of Excessive Motion Blur. [PDF]

Gabyong Park, Antonis Argyros, Juyoung Lee, Woontack Woo

• [2019 Computers & Graphics] Simple and effective deep hand shape and pose regression from a single depth image. [PDF]

Jameel Malik, Ahmed Elhayek, Fabrizio Nunnari, Didier Stricker

• [2019 TIP] SRHandNet: Real-time 2D Hand Pose Estimation with Simultaneous Region Localization. [PDF] [Project]

Yangang Wang, Baowen Zhang, Cong Peng

• [2019 Sensors] WHSP-Net: A Weakly-Supervised Approach for 3D Hand Shape and Pose Recovery from a Single Depth Image. [PDF]

Jameel Malik*, Ahmed Elhayek*, Didier Stricker

• [2019 RA-L] Variational Object-aware 3D Hand Pose from a Single RGB Image. [PDF] [Code]

Yafei Gao*, Yida Wang*, Pietro Falco, Nassir Navab, Federico Tombari

• [2018 PR] A Survey on 3D Hand Pose Estimation: Cameras, Methods, and Datasets. [PDF]

Rui Li, Zhenyu Liu, Jianrong Tan

• [2018 Neurocomputing] A CRNN module for hand pose estimation. [PDF]

Zhongxu Hu, Youmin Hu, Jie Liu, Bo Wu, Dongmin Han, Thomas Kurfess

• [2018 IVC] Large-scale Multiview 3D Hand Pose Dataset. [PDF] [Project]

Francisco Gomez-Donoso, Sergio Orts-Escolano and Miguel Cazorla

• [2018 TCSVT] Mask-pose Cascaded CNN for 2D Hand Pose Estimation from Single Color Image. [PDF] [Project] [Code]

Yangang Wang, Cong Peng and Yebin Liu

• [2018 IVC] Top-down model fitting for hand pose recovery in sequences of depth images. [PDF]

Meysam Madadi, Sergio Escalera, Alex Carruesco, Carlos Andujar, Xavier Baró, Jordi Gonzàlez

• [2018 TCYB] Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images. [PDF]

Yiming Wu, Wei Ji, Xi Li, Gang Wang, Jianwei Yin, Fei Wu

• [2018 IEEE Access] SHPR-Net: Deep Semantic Hand Pose Regression From Point Clouds. [PDF] [Project]

Xinghao Chen, Guijin Wang, Cairong Zhang, Tae-Kyun Kim, Xiangyang Ji

• [2018 Neurocomputing] Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation. [PDF] [Project] [Code]

Xinghao Chen, Guijin Wang, Hengkai Guo, Cairong Zhang

• [2018 PR] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]

Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu

• [2018 TIP] Robust 3D Hand Pose Estimation from Single Depth Images using Multi-View CNNs. [PDF]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

• [2018 JVCI] Region Ensemble Network: Towards Good Practices for Deep 3D Hand Pose Estimation. [PDF] [Code]

Guijin Wang, Xinghao Chen*, Hengkai Guo*, Cairong Zhang

• [2017 TCYB] Hough Forest with Optimized Leaves for Global Hand Pose Estimation with Arbitrary Postures. [PDF]

Hui Liang, Junsong Yuan, J. Lee, Liuhao Ge and Daniel Thalmann

• [2017 TCSVT] Robust RGB-D Hand Tracking Using Deep Learning Priors. [PDF]

Jordi Sanchez-Riera, Kathiravan Srinivasan, Kai-Lung Hua, Wen-Huang Cheng, M. Anwar Hossain, and Mohammed F. Alhamid

• [2017 CVIU] Hand Pose Estimation through Semi-Supervised and Weakly-Supervised Learning. [PDF]

Natalia Neverova, Christian Wolf, Florian Nebout, Graham Taylor

• [2017 Neurocomputing] Multi-task, Multi-domain Learning: application to semantic segmentation and pose regression. [PDF]

Damien Foururea, Rémi Emonet, Elisa Fromont, Damien Muselet, Natalia Neverova, Alain Trémeaua, Christian Wolf

• [2016 CVIU] Guided Optimisation through Classification and Regression for Hand Pose Estimation. [PDF] [Project]

Philip Krejov, Andrew Gilbert, Richard Bowden

• [2015 TCSVT] Resolving Ambiguous Hand Pose Predictions by Exploiting Part Correlations. [PDF]

Hui Liang, Junsong Yuan, Daniel Thalmann

• [2014 TMM] Parsing the Hand in Depth Images. [PDF] [Project] [Code]

Hui Liang, Junsong Yuan, Daniel Thalmann

[back to top]

Conference Papers

2021 CVPR

• DexYCB: A Benchmark for Capturing Hand Grasping of Objects. [PDF] [Project] [Code]

Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj S. Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox

• Body2Hands: Learning to Infer 3D Hands from Conversational Gesture Body Dynamics. [PDF] [Project]

Evonne Ng, Hanbyul Joo, Shiry Ginosar, Trevor Darrell

• Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration. [PDF]

Xingyu Chen, Yufeng Liu, Chongyang Ma, Jianlong Chang, Huayan Wang, Tian Chen, Xiaoyan Guo, Pengfei Wan, Wen Zheng

• Model-based 3D Hand Reconstruction via Self-Supervised Learning. [PDF]

Yujin Chen, Zhigang Tu, Di Kang, Linchao Bao, Ying Zhang, Xuefei Zhe, Ruizhi Chen, Junsong Yuan

• Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time. [PDF]

Shaowei Liu*, Hanwen Jiang*, Jiarui Xu, Sifei Liu, Xiaolong Wang

[back to top]

2021 Others

• [2021 SIGGRAPH] Single Depth View-Based Real-time Reconstruction of Hand-object Interactions. [PDF]

Hao Zhang, Yuxiao Zhou, Yifei Tian, Jun-Hai Yong, Feng Xu

• [2021 AAAI] Exploiting Learnable Joint Groups for Hand Pose Estimation. [PDF] [Code]

Moran Li, Yuan Gao, Nong Sang

• [2021 WACV] Active Learning for Bayesian 3D Hand Pose Estimation. [PDF] [Code]

Razvan Caramalau, Binod Bhattarai, Tae-Kyun Kim

• [2021 WACV] Two-hand Global 3D Pose Estimation Using Monocular RGB. [PDF] [Code]

Fanqing Lin, Connor Wilhelm, Tony Martinez

• [2021 WACV] MVHM: A Large-Scale Multi-View Hand Mesh Benchmark for Accurate 3D Hand Pose Estimation. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Xiaohui Xie

• [2021 WACV] Temporal-Aware Self-Supervised Learning for 3D Hand Pose and Mesh Estimation in Videos. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Xiaohui Xie

[back to top]

2020 ECCV

• GRAB: A Dataset of Whole-Body Human Grasping of Objects. [PDF] [Project] [Code]

Omid Taheri, Nima Ghorbani, Michael J. Black, Dimitrios Tzionas

• Monocular Expressive Body Regression through Body-Driven Attention. [PDF] [Project] [Code]

Vasileios Choutas, Georgios Pavlakos, Timo Bolkart, Dimitrios Tzionas , Michael J. Black

• The Phong Surface: Efficient 3D Model Fitting using Lifted Optimization. [PDF] (Oral)

Jingjing Shen, Thomas J. Cashman, Qi Ye, Tim Hutton, Toby Sharp, Federica Bogo, Andrew William Fitzgibbon, Jamie Shotton

• Whole-Body Human Pose Estimation in the Wild. [PDF] [Code]

Sheng Jin, Lumin Xu, Jin Xu, Can Wang, Wentao Liu, Chen Qian, Wanli Ouyang, Ping Luo

• Dual Grid Net: hand mesh vertex regression from single depth maps. [PDF]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• Hand-Transformer: Non-Autoregressive Structured Modeling for 3D Hand Pose Estimation. [PDF]

Lin Huang, Jianchao Tan, Ji Liu, and Junsong Yuan

• ContactPose: A Dataset of Grasps with Object Contact and Hand Pose. [PDF] [Project] [Code]

Samarth Brahmbhatt, Chengcheng Tang, Chris Twigg, Charles C. Kemp, and James Hays

• SeqHAND: RGB-Sequence-Based 3D Hand Pose and Shape Estimation. [PDF]

John Yang, Hyung Jin Chang, Seungeui Lee, Nojun Kwak

• HTML: A Parametric Hand Texture Model for 3D Hand Reconstruction and Personalizationm. [PDF] [Project]

Neng Qian, Jiayi Wang, Franziska Mueller, Florian Bernard, Vladislav Golyanik, Christian Theobalt

• JGR-P2O: Joint Graph Reasoning based Pixel-to-Offset Prediction Network for 3D Hand Pose Estimation from a Single Depth Image. [PDF] [Code] (Spotlight)

Linpu Fang, Xingyan Liu, Li Liu, Hang Xu, Wenxiong Kang

• Adaptive Computationally Efficient Network for Monocular 3D Hand Pose Estimation. [PDF] (Spotlight)

Zhipeng Fan, Jun Liu, Yao Wang

• Collaborative Learning of Gesture Recognition and 3D Hand Pose Estimation with Multi-Order Feature Analysis. [PDF] (Spotlight)

Siyuan Yang, Jun Liu, Shijian Lu, Meng Hwa Er, Alex C. Kot

• DeepHandMesh: Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modeling from a Single RGB Image. [PDF] [Project] (Oral)

Gyeongsik Moon, Takaaki Shiratori, Kyoung Mu Lee

• InterHand2.6M: A New Large-scale Dataset and Baseline for 3D Single and Interacting Hand Pose Estimation from a Single RGB Image. [PDF] [Project] [Code]

Gyeongsik Moon, Shoou-i Yu, He Wen, Takaaki Shiratori, Kyoung Mu Lee

• I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image. [PDF] [Code]

Gyeongsik Moon, Kyoung Mu Lee

• Weakly-Supervised 3D Hand Pose Estimation via Biomechanical Constraints. [PDF]

Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz

• Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interaction. [PDF] [Code]

Anil Armagan, Guillermo Garcia-Hernando, Seungryul Baek, Shreyas Hampali, Mahdi Rad, Zhaohui Zhang, Shipeng Xie, MingXiu Chen, Boshen Zhang, Fu Xiong, Yang Xiao, Zhiguo Cao, Junsong Yuan, Pengfei Ren, Weiting Huang, Haifeng Sun, Marek Hrúz, Jakub Kanis, Zdeněk Krňoul, Qingfu Wan, Shile Li, Linlin Yang, Dongheui Lee, Angela Yao, Weiguo Zhou, Sijia Mei, Yunhui Liu, Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Philippe Weinzaepfel, Romain Brégier, Gregory Rogez, Vincent Lepetit, Tae-Kyun Kim

[back to top]

2020 CVPR

• Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild. [PDF] [Project] (Oral) (Paper Award Nominees)

Dominik Kulon, Riza Alp Güler, Iasonas Kokkinos, Michael Bronstein, Stefanos Zafeiriou

• Weakly-supervised Domain Adaptation via GAN and Mesh Model for Estimating 3D Hand Poses Interacting Objects. [PDF] [Code] (Oral) (Paper Award Nominees)

Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

• GanHand: Predicting Human Grasp Affordances in Multi-Object Scenes. [PDF]

Enric Corona, Albert Pumarola, Guillem Alenya, Francesc Moreno-Noguer, Gregory Rogez

• Cross-Modal Variational Alignment of Latent Spaces. [PDF]

Thomas Theodoridis, Theocharis Chatzis, Vassilios Solachidis, Kosmas Dimitropoulos, Petros Daras

• HUMBI: A Large Multiview Dataset of Human Body Expressions. [PDF] [Project]

Zhixuan Yu*, Jae Shin Yoon*, Prashanth Venkatesh, Jaesik Park, Jihun Yu, Hyun Soo Park

• Epipolar Transformers. [PDF] [Code]

Yihui He*, Rui Yan*, Shoou-I Yu, Katerina Fragkiadaki

• HandVoxNet: Deep Voxel-Based Network for 3D Hand Shape and Pose Estimation from a Single Depth Map. [PDF]

Jameel Malik, Ibrahim Abdelaziz, Ahmed Elhayek, Soshi Shimada, Sk Aziz Ali, Vladislav Golyanik, Christian Theobalt, Didier Stricker

• Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge. [PDF]

Long Zhao, Xi Peng, Yuxiao Chen, Mubbasir Kapadia, Dimitris N. Metaxas

• Leveraging Photometric Consistency over Time for Sparsely Supervised Hand-Object Reconstruction. [PDF] [Project] [Code]

Yana Hasson, Bugra Tekin, Federica Bogo, Ivan Laptev, Marc Pollefeys, Cordelia Schmid

• Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data. [PDF] [Project] [Code]

Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu

• HOPE-Net: A Graph-based Model for Hand-Object Pose Estimation. [PDF] [Code]

Bardia Doosti, Shujon Naha, David Crandall, Majid Mirbagheri

• HOnnotate: A method for 3D Annotation of Hand and Objects Poses. [PDF] [Project] [Code]

Shreyas Hampali, Mahdi Rad, Markus Oberweger, Vincent Lepetit

[back to top]

2020 Others

• [2020 ISMAR] 3D Hand Pose Estimation with a Single Infrared Camera via Domain Transfer Learning. [PDF]

Gabyong Park, Tae-Kyun Kim, Woontack Woo

• [2020 ISMAR] Bare-hand Depth Inpainting for 3D Tracking of Hand Interacting with Object. [PDF]

Woojin Cho, Gabyong Park, Woontack Woo

• [2020 3DV] Grasping Field: Learning Implicit Representations for Human Grasps. [PDF] [Code] (Best Paper Award)

Korrawe Karunratanakul, Jinlong Yang, Yan Zhang, Michael Black, Krikamol Muandet, Siyu Tang

• [2020 UIST] DeepFisheye: Near-Surface Multi-Finger Tracking Technology Using Fisheye Camera. [PDF] [Project] [Code]

Keunwoo Park, Sunbum Kim, Youngwoo Yoon, Tae-Kyun Kim, Geehyuk Lee

• [2020 SIGGRAPH Asia] Constraining Dense Hand Surface Tracking With Elasticity. [PDF] [Project]

Breannan Smith, Chenglei Wu, He Wen, Patrick Peluse, Yaser Sheikh, Jessica Hodgins, Takaaki Shiratori

• [2020 SIGGRAPH Asia] RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video. [PDF] [Project]

Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli, Oleksandr Sotnychenko, Neng Qian, Miguel A. Otaduy, Dan Casas, and Christian Theobalt

• [2020 SIGGRAPH] MEgATrack: Monochrome Egocentric Articulated Hand-Tracking for Virtual Reality. [PDF]

Shangchen Han, Beibei Liu, Randi Cabezas, Christopher D. Twigg, Peizhao Zhang, Jeff Petkau, Tsz-Ho Yu, Chun-Jung Tai, Muzaffer Akbay, Zheng Wang, Asaf Nitzan, Gang Dong, Yuting Ye, Lingling Tao, Chengde Wan, Robert Wang

• [2020 MM] MM-Hand: 3D-Aware Multi-Modal Guided Hand Generation for 3D Hand Pose Synthesis. [PDF] [Code]

Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, Wei Fan

• [2020 MM] Adaptive Wasserstein Hourglass for Weakly Supervised Hand Pose Estimation from Monocular RGB. [PDF]

Yumeng Zhang, Li Chen, Yufeng Liu, Junhai Yong, Wen Zheng

• [2020 MM] HOT-Net: Non-Autoregressive Transformer for 3D Hand-Object Pose Estimation. [PDF]

Lin Huang, Jianchao Tan, Jingjing Meng, Ji Liu, and Junsong Yuan

• [2020 BMVC] PMD-Net: Privileged Modality Distillation Network for 3D Hand Pose Estimation from a Single RGB Image. [PDF]

Kewen Wang and Xilin Chen

• [2020 BMVC] SIA-GCN: A Spatial Information Aware Graph Neural Network with 2D Convolutions for Hand Pose Estimation. [PDF]

Deying Kong, Haoyu Ma and Xiaohui Xie

• [2020 BMVC] Explicit Knowledge Distillation for 3D Hand Pose Estimation from Monocular RGB. [PDF]

Yumeng Zhang, Li Chen, Yufeng Liu, Wen Zheng and JunHai Yong

• [2020 BMVC] BiHand: Recovering Hand Mesh with Multi-stage Bisected Hourglass Networks. [PDF] [Code]

Lixin Yang, Jiasen Li, Wenqiang Xu, Yiqun Diao, Cewu Lu

• [2020 Ubicomp] FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist. [PDF] (ECCV 2020 Demo Award Nominee)

Fang Hu, Peng He, Songlin Xu, Yin Li, Cheng Zhang

• [2020 FG] Hand tracking from monocular RGB with dense semantic labels. [PDF]

Peter Thompson, Aphrodite Galata

• [2020 FG] Generative Model-Based Loss to the Rescue: A Method to Overcome Annotation Errors for Depth-Based Hand Pose Estimation. [PDF]

Jiayi Wang, Franziska Mueller, Florian Bernard, Christian Theobalt

• [2020 IROS] Physics-Based Dexterous Manipulations with Estimated Hand Poses and Residual Reinforcement Learning. [PDF]

Guillermo Garcia-Hernando, Edward Johns, Tae-Kyun Kim

• [2020 CHI] Evaluation of Machine Learning Techniques for Hand Pose Estimation on Handheld Device with Proximity Sensor. [PDF]

Kazuyuki Arimatsu, Hideki Mori

• [2020 AAAI] AWR: Adaptive Weighting Regression for 3D Hand Pose Estimation. [PDF] [Code]

Weiting Huang, Pengfei Ren, Jingyu Wang, Qi Qi, Haifeng Sun

• [2020 WACV] Nonparametric Structure Regularization Machine for 2D Hand Pose Estimation. [PDF] [Code]

Yifei Chen*, Haoyu Ma*, Deying Kong, Xiangyi Yan, Jianbao Wu, Wei Fan, Xiaohui Xie

• [2020 WACV] 3D Hand Pose Estimation with Disentangled Cross-Modal Latent Space. [PDF]

Jiajun Gu, Zhiyong Wang, Wanli Ouyang, Weichen Zhang, Jiafeng Li, Li Zhuo

• [2020 WACV] DGGAN: Depth-image Guided Generative Adversarial Networks for Disentangling RGB and Depth Images in 3D Hand Pose Estimation. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Wei Fan, Xiaohui Xie

• [2020 WACV] Rotation-invariant Mixed Graphical Model Network for 2D Hand Pose Estimation. [PDF]

Deying Kong, Haoyu Ma, Yifei Chen, Xiaohui Xie

• [2020 ICASSP] Weakly Supervised Segmentation Guided Hand Pose Estimation During Interaction With Unknown Objects. [PDF]

Cairong Zhang, Guijin Wang, Xinghao Chen, Pengwei Xie, Toshihiko Yamasaki

• [2020 ICASSP] Hand-3D-Studio: A New Multi-view System for 3D Hand Reconstruction. [PDF] [Project]

Zhengyi Zhao, Tianyao Wang, Siyu Xia, Yangang Wang

[back to top]

2019 ICCV

• FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images. [PDF] [Project] [Code]

Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox

• A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation from a Single Depth Image. [PDF] [Code]

Fu Xiong*, Boshen Zhang*, Yang Xiao, Zhiguo Cao, Taidong Yu, Joey Tianyi Zhou, and Junsong Yuan

• Exploiting Spatial-temporal Relationships for 3D Pose Estimation via Graph Convolutional Networks. [PDF]

Yujun Cai, Liuhao Ge, Jun Liu, Jianfei Cai, Tat-Jen Cham, Junsong Yuan, and Nadia Magnenat Thalmann

• Resolving 3D Human Pose Ambiguities with 3D Scene Constraints. [PDF] [Project]

Mohamed Hassan, Vasileios Choutas, Dimitrios Tzionas and Michael J. Black

• SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation with Semi-supervised Learning. [PDF] [Code]

Yujin Chen, Zhigang Tu, Liuhao Ge, Dejun Zhang, Ruizhi Chen, Junsong Yuan

• End-to-end Hand Mesh Recovery from a Monocular RGB Image. [PDF] [Code]

Xiong Zhang*, Qiang Li*, Wenbo Zhang, Wen Zheng

• Aligning Latent Spaces for 3D Hand Pose Estimation. [PDF]

Linlin Yang*, Shile Li*, Dongheui Lee, Angela Yao

• [HANDS19 Workshop] Disentangling Pose from Appearance in Monochrome Hand Images. [PDF]

Yikang Li, Chris Twigg, Yuting Ye, Lingling Tao, Xiaogang Wang

• [HANDS19 Workshop] RGB-based 3D Hand Pose Estimation via Privileged Learning with Depth Images. [PDF]

Shanxin Yuan, Bjorn Stenger, Tae-Kyun Kim

• [HANDS19 Workshop] Explicit Pose Deformation Learning for Tracking Human Poses. [PDF]

Xiao Sun, Chuankang Li, Stephen Lin

• [HANDS19 Workshop] Hand Pose Ensemble Learning based on Grouping Features of Hand Point Sets. [PDF]

Tianqiang Zhu, Yi Sun, Xiaohong Ma, Xiangbo Lin

2019 CVPR

• Disentangling Latent Hands for Image Synthesis and Pose Estimation. [PDF]

Linlin Yang, Angela Yao

• Point-to-Pose Voting based Hand Pose Estimation using Residual Permutation Equivariant Layer. [PDF]

Shile Li, Dongheui Lee

• H•O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions. [PDF] (Oral)

Bugra Tekin, Federica Bogo, Marc Pollefeys

• Self supervised 3D hand pose estimation. [PDF] [Code] (Oral) (Best Paper Finalists)

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• CrossInfoNet: Multi-Task Information Sharing Based Hand Pose Estimation. [PDF] [Code]

Kuo Du, Xiangbo Lin, Yi Sun, Xiaohong Ma

• Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. [PDF] [Project] [Code] (Oral)

Georgios Pavlakos*, Vasileios Choutas*, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, Michael J. Black

• Learning joint reconstruction of hands and manipulated objects. [PDF] [Code] [Code] [Project]

Yana Hasson, Gül Varol, Dimitris Tzionas, Igor Kalevatykh, Michael J. Black, Ivan Laptev, and Cordelia Schmid

• 3D Hand Shape and Pose Estimation from a Single RGB Image. [PDF] [Project] [Code] (Oral)

Liuhao Ge, Zhou Ren, Yuncheng Li, Zehao Xue, Yingying Wang, Jianfei Cai, Junsong Yuan

• 3D Hand Shape and Pose from Images in the Wild. [PDF] [Code] (Oral)

Adnane Boukhayma, Rodrigo de Bem, Philip H.S. Torr

• Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Rendering. [PDF]

Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

• Monocular Total Capture: Posing Face, Body, and Hands in the Wild. [PDF] [Project] [Code] (Oral)

Donglai Xiang, Hanbyul Joo, Yaser Sheikh

[back to top]

2019 Others

• [2019 SIGGRAPH] Interactive Hand Pose Estimation using a Stretch-Sensing Soft Glove. [PDF] [Project]

Oliver Glauser, Shihao Wu, Daniele Panozzo, Otmar Hilliges, Olga Sorkine-Hornung

• [2019 SIGGRAPH] InteractionFusion: Real-time Reconstruction of Hand Poses and Deformable Objects in Hand-object Interactions. [PDF]

Hao Zhang, Zi-Hao Bo, Jun-Hai Yong, Feng Xu

• [2019 SIGGRAPH] Real-time pose and shape reconstruction of two interacting hands with a single depth camera. [PDF] [Project]

Franziska Mueller, Micah Davis, Florian Bernard, Oleksandr Sotnychenko, Mickeal Verschoor, Miguel A. Otaduy, Dan Casas, Christian Theobalt

• [2019 FG] Deep Conditional Variational Estimation for Depth-Based Hand Poses. [PDF]

Lu Xu, Chen Hu, Yinqi Li, Ji’an Tao, Jianru Xue, Kuizhi Mei

• [2019 BMVC] Unified 2D and 3D Hand Pose Estimation from a Single Visible or X-ray Image. [PDF]

Akila Pemasiri, Kien Nguyen Thanh, Sridha Sridharan, Clinton Fookes

• [2019 BMVC] TAGAN: Tonality Aligned Generative Adversarial Networks for Realistic HandPose Synthesis. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Hui Tang, Yufan Xue, Xiaohui Xie, Yen-Yu Lin, Wei Fan

• [2019 BMVC] Single Image 3D Hand Reconstruction with Mesh Convolutions. [PDF] [Code]

Dominik Kulon, Haoyang Wang, Riza Alp Güler, Michael Bronstein, Stefanos Zafeiriou

• [2019 BMVC] Adaptive Graphical Model Network for 2D Handpose Estimation. [PDF]

Deying Kong, Yifei Chen, Haoyu Ma, Xiangyi Yan, Xiaohui Xie

• [2019 BMVC] SRN: Stacked Regression Network for Real-time 3D Hand Pose Estimation. [PDF]

Pengfei Ren, Haifeng Sun, Jingyu Wang, Qi Qi, Weiting Huang

• [2019 BMVC] End-to-End 3D Hand Pose Estimation from Stereo Cameras. [PDF] (Oral)

Yuncheng Li, Zehao Xue, Yingying Wang, Liuhao Ge, Zhou Ren, Jonathan Rodriguez

• [2019 ACCV] Hand Pose Estimation Based on 3D Residual Network with Data Padding and Skeleton Steadying. [PDF]

Pai-Wen Ting, En-Te Chou, Ya-Hui Tang, Li-Chen Fu

• [2019 ICASSP] Cascaded Point Network for 3D Hand Pose Estimation. [PDF]

Yikun Dou, Xuguang Wang, Yuying Zhu, Xiaoming Deng, Cuixia Ma, Liang Chang, Hongan Wang

• [2019 ICASSP] A Novel Framework of Hand Localization and Hand Pose Estimation. [PDF]

Yunlong Che, Yuxiang Song, Yue Qi

• [2019 ICRA] Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network. [PDF] [Code]

Shuang Li*, Xiaojian Ma*, Hongzhuo Liang, Michael Görner, Philipp Ruppel, Bing Fang, Fuchun Sun, Jianwei Zhang

• [2019 WACV] MURAUER: Mapping Unlabeled Real Data for Label AUstERity. [PDF] [Project] [Code]

Georg Poier, Michael Opitz, David Schinagl and Horst Bischof

[back to top]

2018 ECCV

• HandMap: Robust Hand Pose Estimation via Intermediate Dense Guidance Map Supervision. [PDF] [Project] [Code]

Xiaokun Wu, Daniel Finnegan, Eamonn O'Neill, Yongliang Yang

• HBE: Hand Branch Ensemble network for real time 3D hand pose estimation. [PDF]

Yidan Zhou, Jian Lu, Kuo Du, Xiangbo Lin, Yi Sun, Xiaohong Ma

• Point-to-Point Regression PointNet for 3D Hand Pose Estimation. [PDF]

Liuhao Ge, Zhou Ren, Junsong Yuan

• Weakly-supervised 3D Hand Pose Estimation from Monocular RGB Images. [PDF] (Oral)

Yujun Cai, Liuhao Ge, Jianfei Cai, Junsong Yuan

• Joint 3D tracking of a deformable object in interaction with a hand. [PDF] [Project]

Aggeliki Tsoli, Antonis A. Argyros

• Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network. [PDF] (Oral)

Qi Ye, Tae-Kyun Kim

• Hand Pose Estimation via Latent 2.5D Heatmap Regression. [PDF]

Umar Iqbal, Pavlo Molchanov, Thomas Breuel, Juergen Gall, Jan Kautz

• [Hands18 Workshop] Adapting Egocentric Visual Hand Pose Estimation Towards a Robot-Controlled Exoskeleton. [PDF]

Gerald Baulig, Thomas Gulde, Cristobal Curio

• [Hands18 Workshop] Estimating 2D Multi-Hand Poses From Single Depth Images. [PDF]

Le Duan, Minmin Shen, Song Cui, Zhexiao Guo, Oliver Deussen

• [Hands18 Workshop] Task-Oriented Hand Motion Retargeting for Dexterous Manipulation Imitation. [PDF] [Project]

Dafni Antotsiou, Guillermo Garcia-Hernando, Tae-Kyun Kim

[back to top]

2018 CVPR

• First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations. [PDF] [Project] [Code]

Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim

• Learning Pose Specific Representations by Predicting Different Views. [PDF] [Project] [Code]

Georg Poier, David Schinagl, Horst Bischof

• Hand PointNet: 3D Hand Pose Estimation using Point Sets. [PDF] [Project] [Code] (Spotlight)

Liuhao Ge, Yujun Cai, Junwu Weng, Junsong Yuan

• Dense 3D Regression for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• Cross-modal Deep Variational Hand Pose Estimation. [PDF] [Project] [Code] (Spotlight)

Adrian Spurr, Jie Song, Seonwook Park, Otmar Hilliges

• Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images. [PDF] [Project]

Mahdi Rad, Markus Oberweger, Vincent Lepetit

• GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB. [PDF] [Supp] [Project] (Spotlight)

Franziska Mueller, Florian Bernard, Oleksandr Sotnychenko, Dushyant Mehta, Srinath Sridhar, Dan Casas, Christian Theobalt

• V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map. [PDF] [Code]

Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee

• Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF] (Spotlight)

Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee, Pavlo Molchanov, Jan Kautz, Sina Honari, Liuhao Ge, Junsong Yuan, Xinghao Chen, Guijin Wang, Fan Yang, Kai Akiyama, Yang Wu, Qingfu Wan, Meysam Madadi, Sergio Escalera, Shile Li, Dongheui Lee, Iason Oikonomidis, Antonis Argyros, Tae-Kyun Kim

• Augmented skeleton space transfer for depth-based hand pose estimation. [PDF] (Oral)

Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

[3D HUMANS Workshop] Monocular RGB Hand Pose Inference From Unsupervised Refinable Nets. [PDF]

Endri Dibra, Silvan Melchior, Ali Balkis, Thomas Wolf, Cengiz Oztireli, Markus Gross

[back to top]

2018 Others

• [2018 ISMAR] Hybrid 3D Hand Articulations Tracking Guided by Classification and Search Space Adaptation. [PDF]

Gabyong Park, Woontack Woo

• [2018 ACCV] Hand Pose Estimation based on 3D Residual Network with Data Padding and Skeleton Steadying. [PDF]

Pai-Wen Ting, En-Te Chou, Ya-Hui Tang, Li-Chen Fu

• [2018 ACCV] Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation. [PDF] [Project] (Oral)

Battushig Myanganbayar, Cristina Mata, Gil Dekel, Boris Katz, Guy Ben-Yosef, Andrei Barbu

• [2018 ACCV] Domain Transfer for 3D Pose Estimation from Color Images without Manual Annotations. [PDF] (Oral)

Mahdi Rad, Markus Oberweger, Vincent Lepetit

• [2018 PCM] Hand Pose Estimation with Attention-and-Sequence Network. [PDF]

Tianping Hu*, Wenhai Wang*, Tong Lu

• [2018 PCM] Mutiple Transfer Net with Region Ensemble for Deep Hand Pose Estimation. [PDF]

Haoqian Wang, Da Li, Xingzheng Wang

• [2018 ICPR] Local Regression Based Hourglass Network for Hand Pose Estimation from a Single Depth Image. [PDF]

Jia Li, Zengfu Wang

• [2018 ICPR] Dynamic Projected Segmentation Networks for Hand Pose Estimation. [PDF]

Yunlong Che, Yue Qi

• [2018 3DV] DeepHPS: End-to-end Estimation of 3D Hand Pose and Shape by Learning from Synthetic Depth. [PDF]

Jameel Malik, Ahmed Elhayek, Fabrizio Nunnari, Kiran Varanasi, Kiarash Tamaddon, Alexis Heloir, Didier Stricker

• [2018 ICIP] Networks Effectively Utilizing 2D Spatial Information for Accurate 3D Hand Pose Estimation. [PDF]

Baoen Liu, Shiliang Huang, Zhongfu Ye

• [2018 ICIP] On the Fusion of RGB and Depth Information For Hand Pose Estimation. [PDF] [Code]

Evangelos Kazakos, Christophoros Nikou, Ioannis Kakadiaris

• [2018 ICIP] Fast Lifting for 3D Hand Pose Estimation in AR/VR Applications. [PDF]

Onur Guleryuz, Christine Kaeser-Chen

• [2018 BMVC] Structure-Aware 3D Hourglass Network for Hand Pose Estimation from Single Depth Image. [PDF]

Fuyang Huang, Ailing Zeng, Minhao Liu, Jing Qin, Qiang Xu

• [2018 BMVC] 3D Hand Pose Estimation using Simulation and Partial-Supervision with a Shared Latent Space. [PDF] [Code] (Oral)

Masoud Abdi, Ehsan Abbasnejad, Chee Peng Lim, Saeid Nahavandi

• [2018 FG] Kinematic Constrained Cascaded Autoencoder for Real-time Hand Pose Estimation. [PDF]

Yushun Lin, Xiujuan Chai, Xilin Chen

• [2018 WACV] Using a single RGB frame for real time 3D hand pose estimation in the wild. [PDF] [Project] [Code]

Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros

[back to top]

2017 ICCV

• Learning to Estimate 3D Hand Pose from Single RGB Images. [PDF] [Project] [Code]

Christian Zimmermann, Thomas Brox

• Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor. [PDF] [Project]

Franziska Mueller, Dushyant Mehta, Oleksandr Sotnychenko, Srinath Sridhar, Dan Casas, Christian Theobalt

• Robust Hand Pose Estimation during the Interaction with an Unknown Object. [PDF] [Supp] [Project]

Chiho Choi, Sang Ho Yoon, Chin-Ning Chen, Karthik Ramani

• Learning Hand Articulations by Hallucinating Heat Distribution. [PDF] [Supp] [Project]

Chiho Choi, Sangpil Kim, Karthik Ramani

• Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization. [PDF] [Project] [Code]

Edoardo Remelli*, Anastasia Tkach*, Andrea Tagliasacchi, Mark Pauly

• [Hands17 Workshop] Back to RGB: 3D tracking of hands and hand-object interactions based on short-baseline stereo. [PDF]

Paschalis Panteleris, Antonis Argyros

• [Hands17 Workshop] DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation. [PDF] [Project] [Code]

Markus Oberweger and Vincent Lepetit

• [Hands17 Workshop] Hand Pose Estimation Using Deep Stereovision and Markov-chain Monte Carlo. [PDF]

Rilwan Remilekun Basaru, Chris Child, Eduardo Alonso, Greg Slabaugh

[back to top]

2017 CVPR

• Hand Keypoint Detection in Single Images using Multiview Bootstrapping. [PDF] [Project] [Code]

Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh

• Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis. [PDF]

Shanxin Yuan*, Qi Ye*, Bjorn Stenger, Siddhand Jain, Tae-Kyun Kim

• 3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images. [PDF] [Project]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

[back to top]

2017 Others

• [2017 3DV] Simultaneous Hand Pose and Skeleton Bone-Lengths Estimation from a Single Depth Image. [PDF]

Jameel Malik, Ahmed Elhayek, Didier Stricker

• [2017 3DV] How to Refine 3D Hand Pose Estimation from Unlabelled Depth Data? [PDF]

Endri Dibra*, Thomas Wolf*, Cengiz Öztireli, Markus Gross

• [2017 ICIP] Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation. [PDF] [Code]

Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang, Fei Qiao, Huazhong Yang

• [2017 ICIP] A Hand Pose Tracking Benchmark from Stereo Matching. [PDF] [Project]

Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang

• [2017 SIGGRAPH Asia] Articulated distance fields for ultra-fast tracking of hands interacting. [PDF]

Jonathan Taylor*, Vladimir Tankovich*, Danhang Tang*, Cem Keskin*, David Kim, Philip Davidson, Adarsh Kowdle, Shahram Izadi

• [2017 SIGGRAPH Asia] Online Generative Model Personalization for Hand Tracking. [PDF] [Project]

Anastasia Tkach*, Andrea Tagliasacchi*, Edoardo Remelli, Mark Pauly, Andrew Fitzgibbon

• [2017 SIGGRAPH Asia] Embodied Hands: Modeling and Capturing Hands and Bodies Together. [PDF] [Project]

Javier Romero*, Dimitrios Tzionas* and Michael J. Black

• [2017 BMVC] Hand Pose Learning: Combining Deep Learning and Hierarchical Refinement for 3D Hand Pose Estimation. [PDF]

Min-Yu Wu, Ya Hui Tang, Pai-Wei Ting and Li-Chen Fu

• [2017 BMVC] Generative 3D Hand Tracking with Spatially Constrained Pose Sampling. [PDF] [Project]

Konstantinos Roditakis, Alexandros Makris and Antonis Argyros

• [2017 ICRA] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]

Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu

• [2017 FG] Occlusion aware hand pose recovery from sequences of depth images. [PDF] [Slide]

Meysam Madadi, Sergio Escalera, Alex Carruesco Llorens, Carlos Andujar, Xavier Baro, Jordi Gonzalez

• [2017 FG] 3D Hand-Object Pose Estimation from Depth with Convolutional Neural Networks. [PDF] [Project]

Duncan Goudie, Aphrodite Galata

[back to top]

2016 ECCV

• Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation. [PDF] [Project]

Qi Ye*, Shanxin Yuan*, Tae-Kyun Kim

• Hand Pose Estimation from Local Surface Normals. [PDF]

Chengde Wan, Angela Yao, and Luc Van Gool

• Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input. [PDF] [Project]

Srinath Sridhar, Franziska Mueller, Michael Zollhöfer, Dan Casas, Antti Oulasvirta, Christian Theobalt

[back to top]

2016 CVPR

• Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs. [PDF] [Project] [Code]

Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann

• DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed With Deep Features. [PDF][Project]

Ayan Sinha*, Chiho Choi*, Karthik Ramani

• Efficiently Creating 3D Training Data for Fine Hand Pose Estimation. [PDF] [Project] [Code]

Markus Oberweger, Gernot Riegler, Paul Wohlhart, Vincent Lepetit

• Fits Like a Glove: Rapid and Reliable Hand Shape Personalization. [PDF] [Project]

David Joseph Tan, Thomas Cashman, Jonathan Taylor, Andrew Fitzgibbon, Daniel Tarlow, Sameh Khamis, Shahram Izadi, Jamie Shotton

[back to top]

2016 Others

• [2016 NIPS] DISCO Nets : Dissimilarity Coefficient Networks. [PDF] [Project] [Code]

Diane Bouchacourt, M. Pawan Kumar, Sebastian Nowozin

• [2016 ACCV] Hand Pose Regression via A Classification-guided Approach. [PDF]

Hongwei Yang, Juyong Zhang

• [2016 ICPR] Deep learning for integrated hand detection and pose estimation. [PDF]

Tzu-Yang Chen, Min-Yu Wu, Yu-Hsun Hsieh, Li-Chen Fu

• [2016 ICPR] Depth-based 3D hand pose tracking. [PDF]

Kha Gia Quach, Chi Nhan Duong, Khoa Luu, and Tien D. Bui.

• [2016 IJCAI] Model-based Deep Hand Pose Estimation. [PDF] [Project] [Code]

Xingyi Zhou, Qingfu Wan, Wei Zhang, Xiangyang Xue, Yichen Wei

• [2016 SIGGRAPH] Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. [PDF]

Jonathan Taylor et al.

• [2016 SIGGRAPH Asia] Sphere-Meshes for Real-Time Hand Modeling and Tracking. [PDF] [Project] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

[back to top]

2015 ICCV

• Training a Feedback Loop for Hand Pose Estimation. [PDF] [Project]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

• Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose. [PDF]

Danhang Tang, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton

• Depth-based hand pose estimation: data, methods, and challenges. [PDF] [Project] [Code]

James Supancic III, Deva Ramanan, Gregory Rogez, Yi Yang, Jamie Shotton

• 3D Hand Pose Estimation Using Randomized Decision Forest with Segmentation Index Points. [PDF]

Peiyi Li, Haibin Ling

• A collaborative filtering approach to real-time hand pose estimation. [PDF] [Project]

Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, Karthik Ramani

• Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions. [PDF]

Sven Bambach, Stefan Lee, David Crandall, Chen Yu

• Understanding Everyday Hands in Action from RGB-D Images. [PDF]

Gregory Rogez, James Supancic III, Deva Ramanan

[back to top]

2015 CVPR

• Cascaded Hand Pose Regression. [PDF]

Xiao Sun, Yichen Wei, Shuang Liang, Xiaoou Tang, and Jian Sun

• Fast and Robust Hand Tracking Using Detection-Guided Optimization. [PDF] [Project]

Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, Christian Theobalt

• Learning an Efficient Model of Hand Shape Variation from Depth Images. [PDF]

Sameh Khamis, Jonathan Taylor, Jamie Shotton, Cem Keskin, Shahram Izadi, Andrew Fitzgibbon

[back to top]

2015 Others

• [2015 BMVC] Hybrid One-Shot 3D Hand Pose Estimation by Exploiting Uncertainties. [PDF] [Project]

Georg Poier, Konstantinos Roditakis, Samuel Schulter, Damien Michel, Horst Bischof and Antonis A. Argyros

• [2015 BMVC] Rule of Thumb: Deep Derotation for Improved Fingertip Detection. [PDF] [Project]

Aaron Wetzler, Ron Slossberg and Ron Kimmel

• [2015 CHI] Accurate, Robust, and Flexible Real-time Hand Tracking. [PDF] [Project]

Toby Sharp, Cem Keskin, Duncan Robertson, Jonathan Taylor, Jamie Shotton, David Kim, Christoph Rhemann, Ido Leichter, Alon Vinnikov, Yichen Wei, Daniel Freedman, Pushmeet Kohli, Eyal Krupka, Andrew Fitzgibbon, Shahram Izadi

• [2015 CVWW] Hands Deep in Deep Learning for Hand Pose Estimation. [PDF] [Project] [Code]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

• [2015 FG] Combining Discriminative and Model Based Approaches for Hand Pose Estimation. [PDF] [Project]

Philip Krejov, Andrew Gilbert, Richard Bowden

• [2015 SGP] Robust Articulated-ICP for Real-Time Hand Tracking. [PDF] [Project] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

[back to top]

2014 CVPR

• Realtime and robust hand tracking from depth. [PDF] [Project]

Chen Qian, Xiao Sun, Yichen Wei, Xiaoou Tang and Jian Sun

• Latent regression forest: Structured estimation of 3d articulated hand posture. [PDF] [Project]

Danhang Tang, Hyung Jin Chang, Alykhan Tejani, T-K. Kim

• User-specific hand modeling from monocular depth sequences. [PDF] [Project]

Jonathan Taylor, Richard Stebbing, Varun Ramakrishna, Cem Keskin, Jamie Shotton, Shahram Izadi, Aaron Hertzmann, Andrew Fitzgibbon

• Evolutionary Quasi-random Search for Hand Articulations Tracking. [PDF] [Project]

Iason Oikonomidis, Manolis IA Lourakis, Antonis A Argyros

[back to top]

2014 Others & Before

• [2014 SIGGRAPH] Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks. [PDF] [Project]

Jonathan Tompson, Murphy Stein, Yann Lecun and Ken Perlin

• [2013 ICCV] Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forests. [PDF] [Project]

Danhang Tang, Tsz Ho Yu and T-K. Kim

• [2013 ICCV] Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data. [PDF] [Project]

Srinath Sridhar, Antti Oulasvirta, Christian Theobalt

• [2013 ICCV] Efficient Hand Pose Estimation from a Single Depth Image. [PDF] [Project]

Chi Xu, Li Cheng

• [2012 ECCV] Motion Capture of Hands in Action using Discriminative Salient Points. [PDF] [Project]

Ballan, L. and Taneja, A. and Gall, J. and van Gool, L. and Pollefeys, M.

• [2012 ECCV] Hand pose estimation and hand shape classification using multi-layered randomized decision forests.

Cem KeskinFurkan, KıraçYunus Emre, KaraLale Akarun

• [2011 CVPRW] Real Time Hand Pose Estimation using Depth Sensors. [PDF]

Cem Keskin, Furkan Kırac, Yunus Emre Kara, Lale Akarun

• [2011 BMVC] Efficient Model-based 3D Tracking of Hand Articulations using Kinect. [PDF] [Project] [Code]

Iason Oikonomidis, Nikolaos Kyriazis, Antonis A. Argyros

[back to top]

Theses

• [2020] Learning without Labeling for 3D Hand Pose Estimation. [PDF]

Georg Poier, Graz University of Technology

• [2018] Computational Learning for Hand Pose Estimation. [PDF]

Chiho Choi, Purdue University

• [2018] 3D hand pose estimation: methods, datasets, and challenges. [PDF]

Shanxin Yuan, Imperial College London

• [2018] 3D hand pose estimation using convolutional neural networks. [PDF]

Qi Ye, Imperial College London

• [2018] 3D Hand Pose Estimation from Images for Interactive Applications. [PDF]

Markus Oberweger, Graz University of Technology

• [2018] Articulated Human Pose Estimation in Unconstrained Images and Videos. [PDF]

Umar Iqbal, University of Bonn

• [2018] Real-Time Generative Hand Modeling and Tracking. [PDF]

Anastasia Tkach, EPFL

• [2018] Recovery of the 3D Virtual Human: Monocular Estimation of 3D Shape and Pose with Data Driven Priors. [PDF] [Project]

Endri Dibra, ETH Zürich

• [2017] Human Segmentation, Pose Estimation and Applications. [PDF] [Slides]

Meysam Madadi, Universitat Autònoma de Barcelonato

• [2017] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects. [PDF] [Project]

Dimitrios Tzionas, University of Bonn

• [2016] Tracking Hands in Action for Gesture-based Computer Input. [PDF]

Srinath Sridhar, Max Planck Institute for Informatics

• [2016] 3D hand pose regression with variants of decision forests. [PDF] [Project]

Danhang Tang, Imperial College London

• [2016] Deep Learning for Human Motion Analysis. [PDF] [Project]

Natalia Neverova, National Institut of Applied Science (INSA de Lyon), France

• [2016] Real time hand pose estimation for human computer interaction. [PDF] [Project]

Philip Krejov, University of Surrey

• [2015] Efficient Tracking of the 3D Articulated Motion of Human Hands. [PDF]

Iason Oikonomidis, University of Crete

• [2015] Vision-based hand pose estimation and gesture recognition. [PDF]

Hui Liang, Nanyang Technological University

• [2015] Localization of Humans in Images Using Convolutional Networks. [PDF]

Jonathan Tompson, New York University

[back to top]

Datasets

  • S/R: Synthetic (S) or Real (R) or Both (B)
  • C/D: Color (RGB) or Depth (D)
  • Obj: Interaction with objects or not
  • #J: No. of joints or Mesh (M)
  • V: view (3rd or egocentric)
  • #S: No. of subjects
  • #F: No. of frames (train/test)
  • Mesh: Mesh annotations

Depth

Dataset Year S/R Mesh Obj #J V #S #F Paper
NYU 2014 R 36 3rd 2 72k/8k SIGGRAPH 2014 [PDF]
ICVL 2014 R 16 3rd 10 331k/1.5k CVPR 2014 [PDF]
MSRA15 2015 R 21 3rd 9 76,375 CVPR 2015 [PDF]
BigHand2.2M 2017 R 21 3rd 10 2.2M CVPR 2017 [PDF]
SynHandEgo 2019 R - ego - - Computers & Graphics 2019 [PDF]
FHAD 2018 R 21 ego 6 100k CVPR 2018 [PDF]
SynHand5M 2018 S - M 3rd - 5M 3DV 2018 [PDF]
MSRC (FingerPaint) 2015 S 21 both 1 100k CHI 2015 [PDF]
HandNet 2015 R 6 3rd 10 202k/10k BMVC 2015 [PDF]
Hands in Action 2014 R - - 3rd - - IJCV 2016 [PDF]
MSRA14 2014 R 21 3rd 6 2,400 CVPR 2014 [PDF]
ASTAR 2013 R - 20 3rd 30 870 ICCV 2013 [PDF]

RGB+Depth

Dataset Year S/R Mesh Obj #J V #S #F Paper
ContactPose 2020 R 21 3rd 50 2.9M ECCV 2020 [PDF]
Ego3DHands 2020 S - 21 ego 1 50k/5k arXiv 2020 [PDF]
ObMan 2019 S - - - 150k CVPR 2019 [PDF]
EgoDexter 2017 R - 5 ego 4 1485 ICCV 2017 [PDF]
SynthHands 2017 S - Both 21 ego 2 63,530 ICCV 2017 [PDF]
RHD 2017 S - 21 3rd 20 41k/2.7k ICCV 2017 [PDF]
STB 2017 R - 21 3rd 1 18k ICIP 2017 [PDF]
Dexter+Object 2016 R - 5 3rd 2 3,014 ECCV 2016 [PDF]
UCI-EGO 2014 R - 26 ego 2 400 ECCVW 2014 [PDF]
Dexter1 2013 R - 6 3rd 1 2,137 ICCV 2013 [PDF]

RGB

Dataset Year S/R Mesh Obj #J V #S #F Paper
InterHand2.6M 2020 R 21 3rd 27 2.6M ECCV 2020 [PDF]
YouTube 3D Hands 2020 R - 3rd - 47,125/1525/1525 CVPR 2020 [PDF]
OneHand10K 2019 R - 21 3rd 1 10k/1.3k TCSVT 2019 [PDF]
FreiHAND 2019 R - 21 3rd - 130k/3960 ICCV 2019 [PDF]
GANerated Hands 2018 S - Both 21 ego - 330k CVPR 2018 [PDF]
CMU Panoptic HandDB 2017 B - 21 3rd - 14,817 CVPR 2017 [PDF]
MHP 2017 R - 21 3rd 9 80k IVC 2017 [PDF]

Credits:

  • [1] Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
  • [2] Depth-based hand pose estimation: methods, data, and challenges, ICCV 2015 Link
  • [3] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects, IJCV 2016 [PDF]
  • [4] MPI Hand Tracking Central

[back to top]

Workshops

[1] Workshops on Observing and Understanding Hands in Action:

HANDS 2019, In conjunction with ICCV 2019
HANDS 2018, In conjunction with ECCV 2018
  • HANDS18: Methods, Techniques and Applications for Hand Observation. [PDF]
HANDS 2017, In conjunction with ICCV 2017
  • Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF]
HANDS 2016, In conjunction with CVPR 2016
HANDS 2015, In conjunction with CVPR 2015

[2] Workshops on Capturing and modeling human bodies, faces and hands:

PeopleCap 2018, In conjunction with ECCV 2018
PeopleCap 2017, In conjunction with ICCV 2017

[back to top]

Challenges

HANDS 2019, ICCV 2019

HANDS 2017, ICCV 2017

[back to top]

Other Related Papers

[arXiv 2011.07252] Ego2Hands: A Dataset for Egocentric Two-hand Segmentation and Detection. [PDF] [Code]

Fanqing Lin, Tony Martinez

• [2020 IJCV] Learning Multi-Human Optical Flow. [PDF] [Project] [Code]

Anurag Ranjan, David T. Hoffmann, Dimitrios Tzionas, Siyu Tang, Javier Romero, and Michael J. Black

• [2019 ICCV] Contextual Attention for Hand Detection in the Wild. [PDF] [Project] [Code]

Supreeth Narasimhaswamy*, Zhengwei Wei*, Yang Wang, Justin Zhang, Minh Hoai

• [2018 SIGGRAPH] Online Optical Marker-based Hand Tracking with Deep Labels. [PDF] [Code]

Shangchen Han, Beibei Liu, Robert Wang, Yuting Ye, Christopher D. Twigg, Kenrick Kin

• [2018 CVPRW] HandyNet: A One-stop Solution to Detect, Segment, Localize & Analyze Driver Hands. [PDF] [Code]

Akshay Rangesh, Mohan M. Trivedi

• [2018 CVPR] DensePose: Dense Human Pose Estimation In The Wild. [PDF] [Project] [Code]

Rıza Alp Güler, Natalia Neverova, Iasonas Kokkinos

• [2018 CVPR] Analysis of Hand Segmentation in the Wild. [PDF] [Code]

Aisha Urooj Khan, Ali Borji

• [2018 CVPR] Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies. [PDF] [Project] (CVPR Best Student Paper Award)

Hanbyul Joo, Tomas Simon, Yaser Sheikh

• [2017 CVPR] SurfNet: Generating 3D shape surfaces using deep residual networks. [PDF]

Ayan Sinha, Asim Unmesh, Qixing Huang, Karthik Ramani

• [2017 CVPR] Learning from Simulated and Unsupervised Images through Adversarial Training. [PDF] [Project] [Code-Tensorflow] [Code-Keras] [Code-Tensorflow-NYU-Hand] (CVPR Best Paper Award)

Ashish Shrivastava, Tomas Pfister, Oncel Tuzel, Josh Susskind, Wenda Wang, Russ Webb

• [2016 3DV] Learning to Navigate the Energy Landscape. [PDF] [Project]

Julien Valentin, Angela Dai, Matthias Niessner, Pushmeet Kohli, Philip H.S. Torr, Shahram Izadi

• [2015 ICCV] 3D Object Reconstruction from Hand-Object Interactions. [PDF] [Project]

Dimitrios Tzionas and Juergen Gall

[back to top]

Contribute

Contributions welcome! Read the contribution guidelines first.

Please feel free to pull requests, open an issue or send me email ([email protected]) to add awesome papers.

License

CC0

To the extent possible under law, xinghaochen has waived all copyright and related or neighboring rights to this work.

About

Awesome work on hand pose estimation/tracking

Resources

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 81.3%
  • Shell 18.7%