Bennett Wilburn

Synthetic Aperture Focusing Using a Shear-Warp Factorization of the Viewing Transform. Vaibhav Vaish, Gaurav Garg, Eino-Ville Talvala, Emilio Antunez, Bennnett Wilburn, Mark Horowitz, and Marc Levoy. Proc. Workshop on Advanced 3D Imaging for Safety and Security (in conjunction with CVPR 2005) Oral presentation. 2005). This paper analyzes the warps required for synthetic aperture photography using tilted focal planes and arbitrary camera configurations. We characterize the warps using a new rank-1 contraint that lets us focus on any plane, without having to perform metric calibration of the cameras. We show the advantages of this method with a real-time implementation using 30 cameras from the Stanford Multiple Camera Array. This video shows our results.

High Performance Imaging Using Large Camera Arrays. Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Eino-Ville Talvala, Emilio Antunez, Adam Barth, Andrew Adams, Mark Horowitz and Marc Levoy. (Presented at ACM Siggraph 2005). This paper describes the final 100 camera system. We also present applications enabled by the array's flexible mounting system, precise timing control, and processing power at each camera. These include high-resolution, high-dynamic-range video capture; spatiotemporal view interpolation (think Matrix Bullet Time effects, but with virtual camera trajectories chosen after filming); live, real-time synthetic aperture videography; non-linear synthetic aperture photography; and hybrid-aperture photography (read the paper for details!). Here's a video (70MB Quicktime) showing the system and most of these applications.

High Speed Video Using A Dense Camera Array. Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Marc Levoy and Mark Horowitz. Presented at CVPR 2004. We create a 1560fps video camera using 52 cameras from our array. Because we compress data in parallel at each camera, our system can stream indefinitely at this frame rate, eliminating the need for triggers. Here's the video of the popping balloon shown at left. The web page for the paper has several more videos.

Using Plane + Parallax for Calibrating Dense Camera Arrays. Vaibhav Vaish, Bennett Wilburn and Marc Levoy. Presented at CVPR 2004. We present a method for plane + parallax calibration of planar camera arrays. This type of calibration is useful for light field rendering and synthetic aperture photography and is simpler and more robust than full geometric calibration. Synthetic aperture photography uses many cameras to simulate a single large aperture camera with a very shallow depth of field. By digitally focussing beyond partially occluding foreground objects like foliage, we can blur them away to reveal objects in the background. Here's an example Quicktime video.

The light field video camera. Bennett Wilburn, Michal Smulski, Hsiao-Heng Kelin Lee, and Mark Horowitz. Proc Media Processors 2002, SPIE Electronic Imaging 2002. The light field video camera was the prototype for the 100-camera array. This describes our original architecture and 6-camera prototype.

Hardware-accelerated dynamic light field rendering. Bastien Goldlucke, Marcus Magnor, Bennett Wilburn. Vision, Modelling and Visualization 2002. Marcus and I started a collaboration while he was a post-doc at Stanford to render novel views from positions between the 6 cameras in our light field camera prototype. His student Bastien continued this work, adding new disparity estimation methods and hardware acceleration for the image warps.

Spatiotemporal Sampling and Interpolation for Dense Camera Arrays. This is a work in progress. We have already shown that we can simulate a high-speed camera by tightly packing many cameras with staggered trigger times. If we spread the cameras out, we can capture views from multiple positions and multiple times for spatiotemporal view interpolation--synthesizing new views from positions and times not in our captured set of images. Our improved temporal resolution lets us use simpler, image-based methods to generate new views. We can also eliminate the alignment errors in the high-speed video work above. Here's an example video.