I am a research scientist and manager at Reality Labs Research, Meta (formerly known as Facebook Reality Labs and Oculus Research). My research interest lies in the intersection of machine learning, computer graphics and computer vision, and particularly in computational photography and mixed reality. Before joining Oculus Research, I received my Ph.D. degree in Computer Science from the
University of British Columbia.
| Email: leixiao08 at gmail |
We're looking for PhD interns for 2024 to work on 3D Computer Vision and Generative Imaging. We have openings in both Redmond and London. Please contact me if you're interested.
Publications
ReplaceAnything3D: Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields
Edward Bartrum, Thu Nguyen-Phuoc, Zhengqin Li, Numair Khan, Chris Xie, Armen Avetisyan, Douglas Lanman, Lei Xiao
arXiv 2024
[project][paper]
GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis
Yiqing Liang, Numair Khan, Zhengqin Li, Thu Nguyen-Phuoc, Douglas Lanman, James Tompkin, Lei Xiao
arXiv 2024
[project]
TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion
Yu-Ying Yeh, Jia-Bin Huang, Changil Kim, Lei Xiao, Thu Nguyen-Phuoc, Numair Khan, Cheng Zhang, Manmohan Chandraker, Carl Marshall, Zhao Dong, Zhengqin Li
arXiv 2024
[project]
AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation
Thu Nguyen-Phuoc, Gabriel Schwartz, Yuting Ye, Stephen Lombardi, Lei Xiao
arXiv 2023
[paper]
Tiled Multiplane Images for Practical 3D Photography
Numair Khan, Douglas Lanman, Lei Xiao
ICCV 2023
[paper]
Temporally-Consistent Online Depth Estimation Using Point-Based Fusion
Numair Khan, Eric Penner, Douglas Lanman, Lei Xiao
CVPR 2023
[project]
[paper]
[code]
View Synthesis of Dynamic Scenes Based on Deep 3D Mask Volume
Kai-En Lin, Guowei Yang, Lei Xiao, Feng Liu, Ravi Ramamoorthi
Transactions on Pattern Analysis and Machine Intelligence (PAMI) 2023
NeuralPassthrough: Learned Real-Time View Synthesis for VR
Lei Xiao, Salah Nouri, Joel Hegland, Alberto Garcia Garcia, Douglas Lanman
SIGGRAPH 2022
[project]
[code and dataset]
SNeRF: Stylized Neural Implicit Representations for 3D Scenes
Thu Nguyen-Phuoc, Feng Liu, Lei Xiao
SIGGRAPH 2022
[project]
[paper]
[supplementary video]
Neural Compression for Hologram Images and Videos
Liang Shi, Richard Webb, Lei Xiao, Changil Kim, Changwon Jang
Optics Letters, Vol. 47, Issue 22, 2022
[paper]
Deep 3D Mask Volume for View Synthesis of Dynamic Scenes
Kai-En Lin, Lei Xiao, Feng Liu, Guowei Yang, Ravi Ramamoorthi
ICCV 2021
[project]
LiveView: Dynamic Target-Centered MPI for View Synthesis
Sushobhan Ghosh, Zhaoyang Lv, Nathan Matsuda, Lei Xiao, Andrew Berkovich, Oliver Cossairt
arXiv 2021
[paper]
OpenNEEDS: A Dataset of Gaze, Head, Hand, and Scene Signals During Exploration in Open-Ended VR Environments
Kara Emery, Marina Zannoli, James Warren, Lei Xiao, Sachin Talathi
ACM Symposium on Eye Tracking Research and Applications (ETRA) 2021, Best Short Paper
[paper]
Neural Supersampling for Real-time Rendering
Lei Xiao, Salah Nouri, Matt Chapman, Alexander Fix, Douglas Lanman, Anton Kaplanyan
SIGGRAPH 2020
[project]
[blog post]
DeepFocus: Learned Image Synthesis for Computational Displays
Lei Xiao, Anton Kaplanyan, Alexander Fix, Matt Chapman, Douglas Lanman
SIGGRAPH Asia 2018
[project]
[code and dataset]
[oculus blog]
[real-time demo]
[oculus connect keynote]
Discriminative Transfer Learning for General Image Restoration
Lei Xiao, Felix Heide, Wolfgang Heidrich, Bernhard Schölkopf, Michael Hirsch
Transactions on Image Processing, Volume 27, Issue 8, 2018
[paper]
[code]
Learning High-Order Filters for Efficient Blind Deconvolution of Document Photographs
Lei Xiao, Jue Wang, Wolfgang Heidrich, Michael Hirsch
ECCV 2016 (selected as Spotlight Presentation)
[project]
Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras
Lei Xiao, Felix Heide, Matthew O'Toole, Andreas Kolb, Matthias B. Hullin, Kiriakos N. Kutulakos, Wolfgang Heidrich
CVPR 2015
[project]
Stochastic Blind Motion Deblurring
Lei Xiao, James Gregson, Felix Heide, Wolfgang Heidrich
Transactions on Image Processing, Volume 24, Issue 10, 2015
[project]
Imaging in Scattering Media Using Correlation Image Sensors and Sparse Convolutional Coding
Felix Heide, Lei Xiao, Andreas Kolb, Matthias B. Hullin, Wolfgang Heidrich
Optics Express, Volume 22, Issue 21, 2014
[project]
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Matthew O'Toole, Felix Heide, Lei Xiao, Matthias B. Hullin, Wolfgang Heidrich, Kiriakos N. Kutulakos
SIGGRAPH 2014
[project]
Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors
Felix Heide, Lei Xiao, Wolfgang Heidrich, Matthias B. Hullin
CVPR 2014 (selected as Oral Presentation)
[project]
Compressive Rendering of Multidimensional Scenes
Pradeep Sen, Soheil Darabi, Lei Xiao
Video Processing and Computational Video, LNCS 7082. Springer, Heidelberg (2011)
[paper]