Convolutional Pose Machine

(CVPR 2016) - S.Wei, V.Ramakrishna, T.Kanade and Y. Sheikh .

Presented by-
Vivek
2016csb1064
1
What this paper is all about ?

● Human pose detection.

● CPM provide a sequential prediction framework for learning rich
implicit spatial models.
● Convolutional Network for articulated pose estimation.
● Sequential architecture composed of convolutional networks
● Demonstrated state-of-art performance on MPII, LSP, FLIC dataset.

2
Related Work

● Pictorial structure - M. Andriluka, S. Roth, and B. Schiele. Pictorial structures

revisited: People detection and articulated pose estimation. In CVPR

● Hierarchical Models - Y. Tian, C. L. Zitnick, and S. G. Narasimhan. Exploring the

spatial hierarchy of mixture models for human pose estimation. In ECCV. 2012

3
Motive of the paper
● Given p-th anatomical landmark position.

● Z is the set of all (u, v) locations in an image. Goal is to predict.

● Prediction

4
Architecture

Img source: Convolutional Pose Machine(CVPR 2016) 5

Analysis

● Fully differentiable and therefore can be trained in an end-to-end

fashion using backpropagation.

● Loss function

6
Continue...

● Overall loss function (decomposable).

● Addressing vanishing gradient- Enforcing supervision in intermediate

stages through the network.

7
 Continue…

Img source: Convolutional Pose Machine(CVPR 2016)

8
Results

Quantitative result
on MPII dataset.

Quantitative result
on LSP dataset.
9
Results

Quantitative Result on FLIC Qualitative Result on all three dataset

10
11
Conclusion

● CPM provide an end-to-end architecture for tackling structured

prediction problems in computer vision without the need for graphical-
model style inference.

● This approach achieves state of the art accuracy on all primary

benchmarks.

● However fails when multiple people in close proximity.

12
Thank You!

13