Home > Research > Publications & Outputs > Meta Agent Teaming Active Learning for Pose Est...

Electronic data


Text available via DOI:

View graph of relations

Meta Agent Teaming Active Learning for Pose Estimation

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Publication date27/09/2022
Host publication2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Number of pages11
ISBN (electronic)9781665469463
ISBN (print)9781665469470
<mark>Original language</mark>English

Publication series

Name2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
ISSN (Print)1063-6919
ISSN (electronic)2575-7075


The existing pose estimation approaches often require a large number of annotated images to attain good estimation performance, which are laborious to acquire. To reduce the human efforts on pose annotations, we propose a novel Meta Agent Teaming Active Learning (MATAL) framework to actively select and label informative images for effective learning. Our MATAL formulates the image selection procedure as a Markov Decision Process and learns an optimal sampling policy that directly maximizes the performance of the pose estimator based on the reward. Our framework consists of a novel state-action representation as well as a multi-agent team to enable batch sampling in the active learning procedure. The framework could be effectively optimized via Meta-Optimization to accelerate the adaptation to the gradually expanded labeled data during deployment. Finally, we show experimental results on both human hand and body pose estimation benchmark datasets and demonstrate that our method significantly outperforms all baselines continuously under the same amount of annotation budget. Moreover, to obtain similar pose estimation accuracy, our MATAL framework can save around 40% labeling efforts on average compared to state-of-the-art active learning frameworks.