Lei Xiao

About Me

I am a research scientist and manager at Reality Labs Research, Meta (formerly known as Facebook Reality Labs and Oculus Research). My research interest lies in the intersection of machine learning, computer graphics and computer vision, and particularly in computational photography and mixed reality. Before joining Oculus Research, I received my Ph.D. degree in Computer Science from the University of British Columbia.

Email: leixiao08 at gmail

We're looking for PhD interns for 2024 to work on 3D Computer Vision and Generative Imaging. We have openings in both Redmond and London. Please contact me if you're interested.


ReplaceAnything3D: Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields
Edward Bartrum, Thu Nguyen-Phuoc, Zhengqin Li, Numair Khan, Chris Xie, Armen Avetisyan, Douglas Lanman, Lei Xiao
arXiv 2024

GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis
Yiqing Liang, Numair Khan, Zhengqin Li, Thu Nguyen-Phuoc, Douglas Lanman, James Tompkin, Lei Xiao
arXiv 2024

TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion
Yu-Ying Yeh, Jia-Bin Huang, Changil Kim, Lei Xiao, Thu Nguyen-Phuoc, Numair Khan, Cheng Zhang, Manmohan Chandraker, Carl Marshall, Zhao Dong, Zhengqin Li
arXiv 2024

AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation
Thu Nguyen-Phuoc, Gabriel Schwartz, Yuting Ye, Stephen Lombardi, Lei Xiao
arXiv 2023

Tiled Multiplane Images for Practical 3D Photography
Numair Khan, Douglas Lanman, Lei Xiao
ICCV 2023

Temporally-Consistent Online Depth Estimation Using Point-Based Fusion
Numair Khan, Eric Penner, Douglas Lanman, Lei Xiao
CVPR 2023
[project] [paper] [code]

View Synthesis of Dynamic Scenes Based on Deep 3D Mask Volume
Kai-En Lin, Guowei Yang, Lei Xiao, Feng Liu, Ravi Ramamoorthi
Transactions on Pattern Analysis and Machine Intelligence (PAMI) 2023

NeuralPassthrough: Learned Real-Time View Synthesis for VR
Lei Xiao, Salah Nouri, Joel Hegland, Alberto Garcia Garcia, Douglas Lanman
[project] [code and dataset]

SNeRF: Stylized Neural Implicit Representations for 3D Scenes
Thu Nguyen-Phuoc, Feng Liu, Lei Xiao
[project] [paper] [supplementary video]

Neural Compression for Hologram Images and Videos
Liang Shi, Richard Webb, Lei Xiao, Changil Kim, Changwon Jang
Optics Letters, Vol. 47, Issue 22, 2022

Deep 3D Mask Volume for View Synthesis of Dynamic Scenes
Kai-En Lin, Lei Xiao, Feng Liu, Guowei Yang, Ravi Ramamoorthi
ICCV 2021

LiveView: Dynamic Target-Centered MPI for View Synthesis
Sushobhan Ghosh, Zhaoyang Lv, Nathan Matsuda, Lei Xiao, Andrew Berkovich, Oliver Cossairt
arXiv 2021

OpenNEEDS: A Dataset of Gaze, Head, Hand, and Scene Signals During Exploration in Open-Ended VR Environments
Kara Emery, Marina Zannoli, James Warren, Lei Xiao, Sachin Talathi
ACM Symposium on Eye Tracking Research and Applications (ETRA) 2021, Best Short Paper

Neural Supersampling for Real-time Rendering
Lei Xiao, Salah Nouri, Matt Chapman, Alexander Fix, Douglas Lanman, Anton Kaplanyan
[project] [blog post]

DeepFocus: Learned Image Synthesis for Computational Displays
Lei Xiao, Anton Kaplanyan, Alexander Fix, Matt Chapman, Douglas Lanman
SIGGRAPH Asia 2018
[project] [code and dataset] [oculus blog] [real-time demo] [oculus connect keynote]

Discriminative Transfer Learning for General Image Restoration
Lei Xiao, Felix Heide, Wolfgang Heidrich, Bernhard Schölkopf, Michael Hirsch
Transactions on Image Processing, Volume 27, Issue 8, 2018
[paper] [code]

Learning High-Order Filters for Efficient Blind Deconvolution of Document Photographs
Lei Xiao, Jue Wang, Wolfgang Heidrich, Michael Hirsch
ECCV 2016 (selected as Spotlight Presentation)

Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras
Lei Xiao, Felix Heide, Matthew O'Toole, Andreas Kolb, Matthias B. Hullin, Kiriakos N. Kutulakos, Wolfgang Heidrich
CVPR 2015

Stochastic Blind Motion Deblurring
Lei Xiao, James Gregson, Felix Heide, Wolfgang Heidrich
Transactions on Image Processing, Volume 24, Issue 10, 2015

Imaging in Scattering Media Using Correlation Image Sensors and Sparse Convolutional Coding
Felix Heide, Lei Xiao, Andreas Kolb, Matthias B. Hullin, Wolfgang Heidrich
Optics Express, Volume 22, Issue 21, 2014

Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Matthew O'Toole, Felix Heide, Lei Xiao, Matthias B. Hullin, Wolfgang Heidrich, Kiriakos N. Kutulakos

Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors
Felix Heide, Lei Xiao, Wolfgang Heidrich, Matthias B. Hullin
CVPR 2014 (selected as Oral Presentation)

Compressive Rendering of Multidimensional Scenes
Pradeep Sen, Soheil Darabi, Lei Xiao
Video Processing and Computational Video, LNCS 7082. Springer, Heidelberg (2011)