YASER AJMAL SHEIKH
Associate Professor, Robotics Institute (Carnegie Mellon University )
Office: EDSH 221 (Smith Hall), Phone: (412) 268-1138, Email: yaser@cs.cmu.edu
Director, Facebook Reality Lab, Pittsburgh
Email: yasers@fb.com
Publications | Students | Courses | Software/Data | Press | Sponsors | Short Bio | Miscellaneous
Yaser Sheikh is an Associate Professor at the Robotics Institute (on leave), Carnegie Mellon University, with appointments in the Mechanical Engineering Department. He founded and directs Facebook Reality Lab in Pittsburgh focused on pursuing "metric telepresence": remote interactions in AR/VR that are indistinguishable from reality. His research is focused on machine perception and rendering of social behavior, spanning sub-disciplines in computer vision, computer graphics, and machine learning. He has won Popular Science’s Best of What’s New Award, the Honda Initiation Award (2010), best paper awards at WACV (2012), SAP (2012), SCA (2010), and ICCV THEMIS (2009), and placed first in the MSCOCO Keypoint Challenge (2016); he received the Hillman Fellowship for Excellence in Computer Science Research (2004). Yaser has served as a senior committee member at leading conferences in computer vision, computer graphics, and robotics including SIGGRAPH (2013, 2014), CVPR (2014, 2015), ICRA (2014, 2016), ICCP (2011), and served as an Associate Editor of CVIU. His research is sponsored by various government research offices, including NSF and DARPA, and several industrial partners including the Intel Corporation, the Walt Disney Company, Nissan, Honda, Toyota, and the Samsung Group. His research has been featured by various media outlets including The New York Times, The Verge, Popular Science, BBC, MSNBC, New Scientist, slashdot, and WIRED. He received his PhD in 2006 from the University of Central Florida advised by Prof. Mubarak Shah, and completed a postdoctoral fellowship in 2008 at Carnegie Mellon University under the mentorship of Takeo Kanade. He received his BS degree from the Ghulam Ishaq Institute of Engineering Science and Technology in 2001.
Predicting Primary Gaze Behavior using Social Saliency Fields [ project page ]
Hyun Soo Park, Eakta Jain, and Yaser Sheikh
IEEE
International Conference on Computer Vision (ICCV), 2013
Tracking Human Pose by Tracking Symmetric Parts [ pdf ]
Varun Ramakrishna, Yaser Sheikh, and Takeo Kanade
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
Representing and Discovering Adversarial Team Behaviors using Player Roles [ project page ]
Patrick Lucey, Alina Bialkowski, Peter Carr, Iain Matthews, and Yaser Sheikh
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
One-Man-Band: A Touch Screen Interface for Producing Live Multi-Camera Sports Broadcasts [ project page ]
Peter Carr, Patrick Lucey, Iain Matthews, Eric Foote, and Yaser Sheikh
ACM International Conference on Multimedia (MM), 2013
3D Point Cloud Reduction Using Mixed-Integer Quadratic Programming
Hyun Soo Park, Yu Wang, Eriko Nurvitadhi, James C Hoe, Yaser Sheikh, and Mei Chen
IEEE Computer Vision and Pattern Recognition Workshop (CVPRW), 2013.
Three-dimensional Proxies for Hand-drawn Characters [ pdf ] [ project page ]
Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins
ACM Transactions on Graphics (TOG), 2012.
Bilinear Spatiotemporal Basis Models [ project page ] [ code ]
Ijaz Akhter, Tomas Simon, Sohaib Khan, Iain Matthews, and Yaser Sheikh
ACM Transactions on Graphics (TOG), 2012.
3D Social Saliency from Head-mounted Cameras [ project page ]
Hyun Soo Park, Eakta Jain, and Yaser Sheikh
Neural Information Processing Systems (NIPS), 2012.
Monocular Object Detection using 3D Geometric Primitives [ pdf ] [ video ]
Peter Carr, Yaser Sheikh, and Iain Matthews
European Conference on Computer Vision (ECCV), 2012.
Reconstructing 3D Human Pose from 2D Image Landmarks [ project page ]
Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2012.
Inferring Artistic Intention in Comic Art through Viewer Gaze[ project page ]
Eakta Jain, Yaser Sheikh, and Jessica Hodgins
ACM Symposium on Applied Perception (SAP), 2012. Best paper honorable mention!
Point-less Calibration: Camera Parameters from Gradient- Based Alignment to Edge Images [ pdf ]
Peter Carr, Yaser Sheikh, and Iain Matthews
IEEE Workshop on the Applications of Computer Vision (WACV), 2012. Best paper award!
Motion Capture from Body-Mounted Cameras [ project page ]
Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, and Jessica Hodgins
ACM SIGGRAPH, 2011.
Trajectory Space: A Dual Representation for Nonrigid Structure from Motion [ pdf ]
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2011.
Linearized Motion Estimation for Articulated Planes [ pdf ]
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2011.
Structure from Motion Blur in Low Light [ pdf ]
Yali Zheng, Shohei Nobuhara, and Yaser Sheikh
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2011.
3D Reconstruction of a Smooth Articulated Trajectory from a Monocular Image Sequence [ project page ]
Hyun Soo Park and Yaser Sheikh
IEEE International Conference on Computer Vision (ICCV), 2011.
Content Retargeting Using Parameter-Parallel Facial Layers [ project page ]
Natasha Kholgade, Iain Matthews, and Yaser Sheikh
Symposium on Computer Animation (SCA), 2011.
3D Reconstruction of a Moving Point from a Series of 2D Projections (oral) [ project page ]
Hyun Soo Park, Takaaki Shiratori, Iain Matthews, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2010.
Augmenting Hand Animation with Three Dimensional Secondary Motion [ project page ]
Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins
Symposium on Computer Animation (SCA), 2010. Best paper award!
Matching Trajectories of Anatomical Landmarks under Viewpoint Anthropometric, and Temporal Transforms [ pdf ]
Alexei Gritai, Yaser Sheikh, Cen Rao, and Mubarak Shah
International Journal of Computer Vision (IJCV), 2009.
In Defense of Orthonormality Constraints for Nonrigid Structure from Motion (oral) [ pdf ]
Ijaz Akhter, Yaser Sheikh, and Sohaib Khan
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2009. (oral)
Modeling the Product Manifold of Posture and Motion
Ankur Datta, Yaser Sheikh, and Takeo Kanade
Workshop on Tracking Humans for the Evaluation of their Motion in Image Sequences (THEMIS), 2009. Best paper award!
Dynamic Seethroughs: Synthesizing Hidden Views of Moving Objects [ project page ]
Peter Barnum, Yaser Sheikh, Ankur Datta, and Takeo Kanade
International Symposium of Mixed and Augmented Reality (ISMAR), 2009.
Background Subtraction for Freely Moving Cameras [ pdf ]
Yaser Sheikh, Omar Javed, and Takeo Kanade
IEEE International Conference on Computer Vision (ICCV), 2009.
Leveraging the Talent of Hand Animators to Create Three-Dimensional Animation [ project page ]
Eakta Jain, Yaser Sheikh, and Jessica Hodgins
Symposium on Computer Animation (SCA), 2009.
Trajectory Association Across Multiple Airborne Cameras
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2008.
Nonrigid Structure from Motion in Trajectory Space (oral) [ pdf ]
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade
Neural Information Processing Systems (NIPS), 2008.
On the Sustained Tracking of Human Motion (oral) [ pdf ]
Yaser Sheikh, Ankur Datta, and Takeo Kanade
IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2008.
Linear Motion Estimation for Systems of Articulated Planes [ pdf ]
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2008.
Mode-seeking by Medoidshifts (oral) [ pdf ]
Yaser Sheikh, Erum Khan, and Takeo Kanade,
IEEE International Conference on Computer Vision (ICCV), 2007.
On the Spacetime Geometry of Galilean Cameras [ pdf ]
Yaser Sheikh, Alexei Gritai, and Mubarak Shah,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2007
Trajectory Association across Non-overlapping Moving Cameras in Planar Scenes
Yaser Sheikh, Xin Li, and Mubarak Shah,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2007
Model Generation for Video-based Object Recognition
Humera Noor, Shahid Hafeez Mirza, Yaser Sheikh, Amit Jain, and Mubarak Shah
ACM International Conference on Multimedia, 2006.
Shape from Dynamic Textures for Planes [ pdf ]
Yaser Sheikh, Niels Haering, and Mubarak Shah
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2006.
Bayesian Modeling of Dynamic Scenes for Object Detection [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2005.
On the Use of Computable Features for Film Classification [ pdf ]
Zeeshan Rasheed, Yaser Sheikh, and Mubarak Shah
IEEE Transactions on Circuit and System for Video Technology (TCSVT), 2005.
Object Tracking Across Multiple Independently Moving Airborne Cameras [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE International Conference on Computer Vision (ICCV), 2005.
Exploring the Space of a Human Action [ pdf ]
Yaser Sheikh, Mumtaz Sheikh, and Mubarak Shah
IEEE International Conference on Computer Vision (ICCV), 2005.
Bayesian Object Detection in Dynamic Scenes, (oral) [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2005.
Establishing a Common View from Multiple Moving Aerial Sensors
Yaser Sheikh, Alexei Gritai, Imran Junejo, Robert Muise, Abhijit Mahalanobis, and Mubarak Shah
SPIE Symposium on Defense and Security, 2005.
Feature-based Georegistration of Aerial Images [ pdf ]
Yaser Sheikh, Sohaib Khan, and Mubarak Shah
In Geosensor Networks, 2004.
On the use of Anthropometry in the Invariant Analysis of Human Actions, (oral) [ pdf ]
Alexei Gritai, Yaser Sheikh, and Mubarak Shah
IAPR International Conference on Pattern Recognition (ICPR), 2004.
CASEE: A Hierarchical Event Representation for the Analysis of Videos, [ pdf ]
Asaad Hakeem, Yaser Sheikh, and Mubarak Shah
American Association for Artificial Intelligence (AAAI), 2004.
Aligning Dissimilar Images Directly, (oral) [ pdf ]
Yaser Sheikh and Mubarak Shah,
Asian Conference on Computer Vision (ACCV), 2004.
Accumulative Alignment of an Image Stream [ pdf ]
Yaser Sheikh, Yun Zhai, and Mubarak Shah
Asian Conference on Computer Vision (ACCV), 2004.
Visual Monitoring of Railroad Grade Crossing [ pdf ]
Yaser Sheikh, Khurram Shafique, Yun Zhai, and Mubarak Shah
SPIE Symposium on Defense and Security, 2004.
Geodetic Alignment of Aerial Video Frames [ pdf ]
Yaser Sheikh, Sohaib Khan, Mubarak Shah, and Richard Cannata
In Video Registration, Video Computing Series, 2003.
Semantic Film Preview Classification Using Low-Level Computable Features [ pdf ]
Zeeshan Rasheed, Yaser Sheikh, and Mubarak Shah
Workshop on Multimedia and Document Engineering, Berlin, Germany, 2003.
Aayush Bansal
(co-advised by Deva Ramanan)
| [画像:Tomas] | Tomas Simon (Robotics Institute, 2017) |
|---|---|
| [画像:Varun] | Varun Ramakrishna (Robotics Institute, 2015) |
| [画像:Yair] | Yair Movshovitz-Attias (Computer Science Department, PhD 2015) Software Engineer, Google Research Thesis: Dataset Curation through Rendering and Ontology Matching (co-advised by Takeo Kanade) |
| [画像:Natasha Kholgade] | Natasha Kholgade Banerjee (Robotics Institute, Ph.D. 2015) Assistant Professor, Clarkson University Thesis: 3D Manipulation of Objects in Photographs |
| [画像:Hyun Soo Park] | Hyun Soo Park (Mechanical Engg., Ph.D. 2014) |
| [画像:Ijaz Akhter] | Ijaz Akhter (LUMS, Ph.D. 2012) |
| [画像:Eakta Jain] | Eakta Jain (Robotics Institute, Ph.D. 2012) Assistant Professor at the University of Florida Thesis: Attention-guided Algorithms to Retarget and Augment Animations, Stills and Videos (co-advised by Jessica Hodgins) |
| [画像:Ankur Datta] | Ankur Datta (Robotics Institute, Ph.D. 2010) |
15-369 Perceptual Computing 2013
15-869 Human Motion Modeling and Analysis 2012
15-381 Artificial Intelligence 2010
Terms of use: The code is supplied with no warranty and Carnegie Mellon or the authors will not be held responsible for the correctness of the code. The software will not be transferred to outside parties without the authors' permission and will be used only for research purposes. In particular, the code will not be included as part of any commercial software package or product without the consent of the authors.
MATLAB code
"Groundtruthed" Sequence
Ducks Sequence
Fountain Sequences
STEP: Science, Technology, and Education in Pakistan
Random Musings
Cappucheerios!
