Papers, preprints, book chapters, theses, and patents by Jinwei Gu, grouped by year with the newest entries first.
Patent entries use grant or publication dates where available.
PaperNVIDIA Cosmos Team. "Cosmos 3: Omnimodal World Models for Physical AI." arXiv:2606.02800; Project; Code; Models/Data.
PaperShenyuan Gao, William Liang, Kaiyuan Zheng, ..., Jinwei Gu, et al. "DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos." arXiv:2602.06949.
PaperMoo Jin Kim, Yihuai Gao, Tsung-Yi Lin, Yen-Chen Lin, Yunhao Ge, Grace Lam, Percy Liang, Shuran Song, Ming-Yu Liu, Chelsea Finn, Jinwei Gu. "Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning." ICLR; Project; Code.
PaperXiao Fu, Shitao Tang, Min Shi, Xian Liu, Jinwei Gu, Ming-Yu Liu, Dahua Lin, Chen-Hsuan Lin. "Plenoptic Video Generation." CVPR.
PaperNVIDIA Cosmos Team. "World Simulation with Video Foundation Models for Physical AI (Cosmos-Predict2.5 / Cosmos-Transfer2.5)." arXiv:2511.00062; Predict2.5; Transfer2.5; Predict2.5 Code; Transfer2.5 Code.
PaperWei-Cheng Tseng, Jinwei Gu, Qinsheng Zhang, Hanzi Mao, Ming-Yu Liu, Florian Shkurti, Lin Yen-Chen. "Scalable Policy Evaluation with Video World Models." arXiv:2511.11520.
PaperHongjun Wang, Yitong Jiang, Collin McCarthy, David Wehr, Hanrong Ye, Xinhao Li, Ka Chun Cheung, Wonmin Byeon, Jinwei Gu, Ke Chen, Kai Han, Hongxu Yin, Pavlo Molchanov, Jan Kautz, Sifei Liu. "GSPN-2: Efficient Parallel Sequence Modeling." NeurIPS; arXiv:2512.07884.
PaperYutian Chen, Shi Guo, Tianshuo Yang, Lihe Ding, Xiuyuan Yu, Jinwei Gu, Tianfan Xue. "4DSloMo: 4D Reconstruction for High-Speed Scenes with Asynchronous Capture." SIGGRAPH Asia; arXiv:2507.05163.
PaperZeqi Gu, Yin Cui, Max Li, Fangyin Wei, Yunhao Ge, Jinwei Gu, Ming-Yu Liu, Abe Davis, Yifan Ding. "ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediary." CVPR; arXiv:2506.00742.
PaperMingde Yao, Menglu Wang, King Man Tam, Lingen Li, Tianfan Xue, Jinwei Gu. "PolarFree: Polarization-based Reflection-Free Imaging." CVPR; arXiv:2503.18055.
PaperNVIDIA Cosmos Team. "Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning." arXiv:2503.15558; Project; Code.
PaperNVIDIA Cosmos Team. "Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Control." arXiv:2503.14492; Project; Code.
PaperLiqun Chen, Yuxuan Li, Jun Dai, Jinwei Gu, Tianfan Xue. "A Physics-Informed Blur Learning Framework for Imaging Systems." CVPR; arXiv:2502.11382.
PaperGangwei Xu, Yujin Wang, Jinwei Gu, Tianfan Xue, Xin Yang. "HDRFlow: Real-time HDR Video Reconstruction with Large Motion." CVPR; arXiv:2403.03447.
2023
PaperH. Wu, C. Chen, L. Liao, J. Hou, W. Sun, Q. Yan, Jinwei Gu, W. Lin. "Neighbourhood Representative Sampling for Efficient End-to-End Video Quality Assessment." IEEE TPAMI, vol. 45, no. 12.
PaperKevin Chan, Xiangyu Xu, Xintao Wang, Jinwei Gu, Chen Change Loy. "GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond." IEEE TPAMI, 45(3).
PaperZhaoyang Zhang, Yitong Jiang, Wenqi Shao, Xiaogang Wang, Ping Luo, Kaimo Lin, Jinwei Gu. "Real-time Controllable Denoising for Image and Video." CVPR; arXiv:2303.16425.
PaperRuicheng Feng, Chongyi Li, Huaijin Chen, Shuai Li, Jinwei Gu, Chen Change Loy. "Generating Aligned Pseudo-Supervision from Non-Aligned Data for Image Restoration in Under-Display Camera." CVPR.
2022
PatentJinwei Gu, Kihwan Kim, Jan Kautz, Guilin Liu, S. Sengupta. "Inverse Rendering of a Scene from a Single Image." US Patent 11,295,514 B2, 2022年04月05日.
PaperJosh Rego, Huaijin Chen, Shuai Li, Jinwei Gu, Suren Jayasuriya. "Deep Camera Obscura: An Image Restoration Pipeline for Pinhole Photography." Optics Express 30(15):27214-27235.
PaperShiyu Duan, Huaijin Chen, Jinwei Gu. "JPD-SE: High-level Semantics for Joint Perception-Distortion Enhancement in Image Compression." IEEE Transactions on Image Processing, vol. 31.
PaperChongyi Li, Chunle Guo, Linghao Han, Jun Jiang, Ming-Ming Cheng, Jinwei Gu, Chen Change Loy. "Low-light Image and Video Enhancement Using Deep Learning: A Survey." IEEE TPAMI, vol. 44.
PatentSifei Liu, Shalini De Mello, Jinwei Gu, Varun Jampani, Jan Kautz. "Switchable Propagation Neural Network." US Patent 11,328,173 B2, 2022年05月10日.
2021
PatentKihwan Kim, Jinwei Gu, Chen Liu, Jan Kautz. "3D Plane Detection and Reconstruction Using a Monocular Image." US Patent 11,037,051 B2, 2021年06月15日.
PatentJinwei Gu, Kihwan Kim, Chao Liu. "Estimating Depth for a Video Stream Captured with a Monocular RGB Camera." US Patent 10,984,545 B2, 2021年04月20日.
PatentS. H. Baek, Kihwan Kim, Jinwei Gu, Orazio Gallo, A. J. Troccoli, Ming-Yu Liu, Jan Kautz. "Guided Hallucination for Missing Image Content Using a Neural Network." US Patent 10,922,793 B2, 2021年02月16日.
PaperFelipe Gutierrez-Barragan, Huaijin Chen, Mohit Gupta, Andreas Velten, Jinwei Gu. "iToF2dToF: A Robust and Flexible Representation for Data-Driven Time-of-Flight Imaging." IEEE Transactions on Computational Imaging, vol. 7.
PaperYitong Jiang, Inchang Choi, Jun Jiang, Jinwei Gu. "HDR Video Reconstruction with Tri-Exposure Quad-Bayer Sensors." arXiv.
2020
ApplicationDeqing Sun, Orazio Gallo, Jan Kautz, Jinwei Gu, Wei-Sheng Lai. "View Synthesis using Neural Networks." US Patent Application 16299062, 2020年09月17日.
PatentOrazio Gallo, Jinwei Gu, Jan Kautz, Patrick Wieschollek. "Deep-learning Method for Separating Reflection and Transmission Images Visible at a Semi-reflective Surface in a Computer Image of a Real-world Scene." US Patent 10,762,620, 2020年09月01日.
PatentSifei Liu, Shalini De Mello, Jinwei Gu, Ming-Hsuan Yang, Jan Kautz. "Learning Affinity via a Spatial Propagation Neural Network." US Patent 10,762,425 B2, 2020年09月01日.
PatentJinwei Gu, Samarth Manoj Brahmbhatt, Kihwan Kim, Jan Kautz. "Learning Based Camera Pose Estimation from Images of an Environment." US Patent 10,692,244, 2020年06月23日.
PatentJinwei Gu, Orazio Gallo, Ming-Yu Liu, Jan Kautz, Huaijin Chen. "Unsupervised Learning Approach for Video Deblurring." US Patent 10,593,020, 2020年03月17日.
PaperMatthias Innmann, Kihwan Kim, Jinwei Gu, Matthias Niessner, Charles Loop, Marc Stamminger, Jan Kautz. "NRMVS: Non-Rigid Multi-View Stereo." WACV.
PaperYan Chen, Jimmy Ren, Xuanye Cheng, Keyuan Qian, Jinwei Gu. "Very Power Efficient Neural Time-of-Flight." WACV.
2019
PatentJinwei Gu, Bennett Wilburn, Wei Jiang. "Methods and Systems for Light Field Augmented Reality/Virtual Reality on Mobile Devices." US Patent 10,388,069, 2019年08月20日.
PatentJinwei Gu, Xiaodong Yang, Shalini De Mello, Jan Kautz. "Systems and Methods for Dynamic Facial Analysis using a Recurrent Neural Network." US Patent 10,373,332, 2019年08月06日.
PaperWei-Sheng Lai, Orazio Gallo, Jinwei Gu, Deqing Sun, Ming-Hsuan Yang, Jan Kautz. "Video Stitching for Linear Camera Arrays." BMVC.
PaperSoumyadip Sengupta, Jinwei Gu, Kihwan Kim, Guilin Liu, David Jacobs, Jan Kautz. "Neural Inverse Rendering of an Indoor Scene from a Single Image." ICCV.
PaperChao Liu, Jinwei Gu, Kihwan Kim, Srinivas Narasimhan, Jan Kautz. "Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera." CVPR Oral; Best Paper Finalist.
PaperChen Liu, Kihwan Kim, Jinwei Gu, Yasutaka Furukawa, Jan Kautz. "PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Image." CVPR Oral.
2018
ApplicationYasunobu Hitomi, Jinwei Gu, Mohit Gupta, Tomoo Mitsunaga, Shree K. Nayar. "Systems, Methods, and Media for Reconstructing a Space-Time Volume from a Coded Image." US Patent Application 20180234672 A1, 2018年08月16日.
PatentWei Jiang, Jinwei Gu. "Markerless Multi-User, Multi-Object Augmented Reality on Mobile Devices." US Patent 9,928,656, 2018年03月27日.
PatentJinwei Gu, James Begole. "System and Method for Generalized View Morphing over a Multi-camera Mesh." US Patent 9,900,583, 2018年02月20日.
ApplicationDonghoon Lee, Sifei Liu, Jinwei Gu, Ming-Yu Liu, Jan Kautz. "Joint Synthesis and Placement of Objects in Scenes." US Patent Application 16201934.
PaperDonghoon Lee, Sifei Liu, Jinwei Gu, Ming-Yu Liu, Ming-Hsuan Yang, Jan Kautz. "Context-aware Synthesis and Placement of Object Instances." NeurIPS.
PaperSamarth Brahmbhatt, Jinwei Gu, Kihwan Kim, James Hays, Jan Kautz. "MapNet: Geometry-Aware Learning of Maps for Camera Localization." CVPR Spotlight.
PaperHuaijin Chen, Jinwei Gu, Orazio Gallo, Ming-Yu Liu, Ashok Veeraraghavan, Jan Kautz. "Reblur2Deblur: Video Deblurring via Self-Supervised Learning." ICCP.
PaperPatrick Wieschollek, Orazio Gallo, Jinwei Gu, Jan Kautz. "Separating Reflection and Transmission Images in the Wild." ECCV.
2017
PaperSifei Liu, Shalini Gupta, Jinwei Gu, Ming-Hsuan Yang, Jan Kautz. "Learning Affinity via Spatial Propagation Networks." NeurIPS.
PaperKihwan Kim, Jinwei Gu, Stephen Tyree, Pavlo Molchanov, Matthias Niessner, Jan Kautz. "A Lightweight Approach for Reflectance Estimation on-the-fly." ICCV Oral.
PaperSuren Jayasuriya, Orazio Gallo, Jinwei Gu, Timo Aila, Jan Kautz. "Reconstructing Intensity Images from Binary Spatial Gradient Cameras." CVPR Embedded Vision Workshop Oral.
PatentWei Jiang, Jinwei Gu. "Parallax Tolerant Video Stitching with Spatial-Temporal Localized Warping and Seam Finding." US Patent 9,363,449, 2016年06月07日.
PatentWei Jiang, Jinwei Gu. "Computational Multi-Camera Adjustment for Smooth View Switching and Zooming." US Patent 9,286,680, 2016年03月15日.
2015
PatentJinwei Gu, Yasunobu Hitomi, Tomoo Mitsunaga, Shree K. Nayar. "Methods and Systems for Coded Rolling Shutter." US Patent 9,100,514, 2015年08月04日.
PaperWei Jiang, Jinwei Gu. "Video Stitching with Spatial-Temporal Content-Preserving Warping." CVPR Computational Cameras and Displays Workshop.
2014
PaperChao Liu, Jinwei Gu. "Discriminative Illumination: Per-Pixel Classification of Raw Materials based on Optimal Projections of Spectral BRDF." IEEE TPAMI, 36(1):86-98.
PaperDengyu Liu, Jinwei Gu, Yasunobu Hitomi, Mohit Gupta, Tomoo Mitsunaga, Shree Nayar. "Efficient Space-Time Sampling with Pixel-wise Coded Exposure for High Speed Imaging." IEEE TPAMI, 36(2):248-260.
2013
PaperJinwei Gu, Shree Nayar, Eitan Grinspun, Peter Belhumeur, Ravi Ramamoorthi. "Compressive Structured Light for Recovering Inhomogeneous Participating Media." IEEE TPAMI, 35(3):555-567.
PaperChao Liu, Gefei Yang, Jinwei Gu. "Learning Discriminative Illumination and Filters for Raw Material Classification with Optimal Projections of Bidirectional Texture Functions." CVPR.
PaperJun Jiang, Dengyu Liu, Jinwei Gu, Sabine Susstrunk. "What is the Space of Spectral Sensitivity Functions for Digital Color Cameras?" WACV.
PaperJun Jiang, Jinwei Gu. "An Exemplar-Based Method for Automatic Visual Editing and Retouching of Fine Art Reproduction." Color and Imaging Conference.
2012
PaperJinwei Gu, Chao Liu. "Discriminative Illumination: Per-Pixel Classification of Raw Materials based on Optimal Projections of Spectral BRDFs." CVPR Oral.
PaperJun Jiang, Jinwei Gu. "Recovering Spectral Reflectance under Commonly Available Lighting Conditions." CVPR Computational Camera and Display Workshop Oral.
PaperAdria Fores, James Ferwerda, Jinwei Gu. "Toward a Perceptually Based Metric for BRDF Modeling." IS&T/SID Color Imaging Conference.
2011
PatentStephen S. Lin, Baining Guo, Heung-Yeung Shum, Jinwei Gu. "Radiometric Calibration from a Single Image." US Patent 7,986,830, 2011年07月26日.
PaperJinwei Gu, Toshihiro Kobayashi, Mohit Gupta, Shree Nayar. "Multiplexed Illumination for Scene Recovery in the Presence of Global Illumination." ICCV Oral.
PaperYasunobu Hitomi, Jinwei Gu, Mohit Gupta, Tomoo Mitsunaga, Shree Nayar. "Video From a Single Exposure Coded Photograph using a Learned Over-Complete Dictionary." ICCV.
ThesisJinwei Gu. "Measuring, Modeling, and Synthesis of Time-Varying Appearance of Natural Phenomena." Ph.D. thesis, Columbia University.
2009
PaperJinwei Gu, Ravi Ramamoorthi, Peter Belhumeur, Shree Nayar. "Removing Image Artifacts Due to Dirty Camera Lenses and Thin Occluders." ACM Transactions on Graphics, SIGGRAPH Asia.
PaperWojciech Matusik, Boris Ajdin, Jinwei Gu, Jason Lawrence, Hendrik Lensch, Fabio Pellacini, Szymon Rusinkiewicz. "Printing Spatially-Varying Reflectance." ACM Transactions on Graphics, SIGGRAPH Asia.
PaperJie Zhou, Fanglin Chen, Jinwei Gu. "A Novel Algorithm for Detecting Singular Points from Fingerprint Images." IEEE TPAMI, vol. 31, no. 7.
2008
PaperJinwei Gu, Shree Nayar, Eitan Grinspun, Peter Belhumeur, Ravi Ramamoorthi. "Compressive Structured Light for Recovering Inhomogeneous Participating Media." ECCV Oral.
2007
PaperJinwei Gu, Ravi Ramamoorthi, Peter Belhumeur, Shree Nayar. "Dirty Glass: Modeling and Rendering Contaminations on Transparent Surfaces." EGSR Oral.
PaperJie Zhou, Jinwei Gu, David Zhang. "Singular Points Analysis in Fingerprints Based on Topological Structure and Orientation Field." International Conference of Biometrics.
2006
PaperJinwei Gu, Chien-I Tu, Ravi Ramamoorthi, Peter Belhumeur, Wojciech Matusik, Shree Nayar. "Time-Varying Surface Appearance: Acquisition, Modeling, and Rendering." ACM Transactions on Graphics, SIGGRAPH.
PaperJinwei Gu, Jie Zhou, Chunyu Yang. "Fingerprint Recognition by Combining Global Structure and Local Cues." IEEE Transactions on Image Processing, vol. 15, no. 7.
PaperWei Jiang, Guihua Er, Qionghai Dai, Jinwei Gu. "Similarity-based Online Feature Selection in Content-based Image Retrieval." IEEE Transactions on Image Processing, vol. 15, no. 3.
2005
PatentJie Zhou, Jinwei Gu, Dingrui Wan. "Fingerprint Recognition based on Multiple Features." Chinese Patent CN1595425A, 2005年03月16日.
PaperWei Jiang, Guihua Er, Qionghai Dai, Jinwei Gu. "Hidden Annotation for Image Retrieval with Long-term Relevance Feedback Learning." Pattern Recognition, vol. 38, no. 11.
ThesisJinwei Gu. "Fingerprint Orientation Field Modeling and Its Applications." M.S. thesis, Tsinghua University.
2004
PaperJinwei Gu, Jie Zhou, David Zhang. "A Combination Model for Orientation Field of Fingerprints." Pattern Recognition, vol. 37, no. 3.
PaperJie Zhou, Jinwei Gu. "A Model-based Method for the Computation of Fingerprints' Orientation Field." IEEE Transactions on Image Processing, vol. 13, no. 6.
PaperJie Zhou, Jinwei Gu. "Modeling Orientation Fields of Fingerprints with Rational Complex Functions." Pattern Recognition, vol. 37, no. 2.
PaperStephen Lin, Jinwei Gu, Shuntaro Yamazaki, Heung-Yeung Shum. "Radiometric Calibration from a Single Image." CVPR Oral.
PaperWei Jiang, Mingjing Li, Hongjiang Zhang, Jinwei Gu. "Online Feature Selection based on Generalized Feature Contrast Model." ICME.
ChapterJie Zhou, David Zhang, Jinwei Gu, Nannan Wu. "Graphical Representation of Fingerprint Images." Integrated Image and Graphics Technologies, Kluwer Academic Publishers.
2003
PaperJinwei Gu, Jie Zhou. "Model-based Orientation Field Estimation for Fingerprint Recognition." ICIP.
PaperJinwei Gu, Jie Zhou. "A Novel Model for Orientation Field of Fingerprints." CVPR.