Exploring MLLM-Diffusion Information Transfer with MetaCanvas
H. Lin, X. Pan, Z. Huang, J. Hou, J. Wang, W. Chen, Z. He, F. Juefei-Xu, J. Sun, Z. Fan, A. Thabet, M. Bansal, C. Wang
NeurIPS, 2026
Jialiang Wang
Generative AI research.
Principal Research Scientist @
NVIDIA Research.
Bio
Bio
I am a Principal Research Scientist in the Learning and Perception Research Group at NVIDIA Research working on AI Scientist, based in Santa Clara, California. Previously, I worked on world model, media generation foundation models and 3D computer vision. I was an AI Research Scientist at Meta Superintelligence Lab, received my Ph.D. in Computer Science from Harvard University and my B.A.Sc. from the University of Toronto.
Publications
2026
From Modalities to Propositions: A Language-Centric Framework for Multimodal Intelligence
N. Chang, M. Shen, S. Diao, J. Wang, J. Chen, T. Breuel, P. Molchanov, R. Mahmood, J. Alvarez
arXiv, 2026
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation
A. Basant, A. Kar, D. Paschalidou, F. Wei, F. Ferroni, G. G. Cobo, H. Turki, H. Ling, J. Seo, J. Lucas, J. Wu, J. Wang, J. Lorraine, J. Gao, K. He, K. Tothova, K. Xie, M. Tyszkiewicz, Q. Wu, R. de Lutio, R. Li, S. Fidler, S. W. Kim, T. Shen, T. Cao, T. Pfaff, W. Lew, X. Wu, X. Ren, Y. Lu, Y. Zhang, Z. Gojcic, Z. Wang (alphabetical, project co-lead)
NVIDIA Spatial Intelligence Lab, 2026
Think in strokes, not pixels: Process-driven image generation via interleaved reasoning
L. Zhang, J. Tian, Z. Fan, K. Li, J. Wang, W. Chen, M. Georgopoulos, F. Juefei-Xu, Y. Bao, J. McAuley, M. Li, Z. He
ECCV, 2026
PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generation
Y. Cai, K. Li, M. Jia, J. Wang, J. Sun, W. Chen, F. Juefei Xu, C. Wang, A. Thabet, X. Dai, X. Ju, A. Yuille, J. Hou
ECCV, 2026
Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development
N. Chang, M. Shen, J. Wang, R. Mahmood, J. Alvarez
ICML, 2026
UniT: Unified Multimodal Chain-of-Thought Test-time Scaling
L. Chen, H. Ma, Z. Fan, Z. Huang, A. Sinha, X. Dai, J. Wang, Z. He, J. Yang, C. Li, J. Sun, C. Wang, S. Yeung-Levy, F. Juefei-Xu
CVPR, 2026
2025
Improving Chain-of-Thought Efficiency for Autoregressive Image Generation
Z. Gu, M. Georgopoulos, X. Dai, M. Ghazvininejad, C. Wang, F. Juefei-Xu, K. Li, Y. Shi, Z. He, Z. He, J. Zhou, A. Davis, J. Wang
arXiv, 2025
LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexity
H. Wang, C. Y. Ma, Y. C. Liu, J. Hou, T. Xu, J. Wang, F. Juefei-Xu, Y. Luo, P. Zhang, T. Hou, P. Vajda, N. K. Jha, X. Dai
CVPR, 2025 Extended journal version
Learnings from Scaling Visual Tokenizers for Reconstruction and Generation
P. Hansen-Estruch, D. Yan, C. Y. Chuang, O. Zohar, J. Wang, T. Hou, T. Xu, S. Vishwanath, P. Vajda, X. Chen
ICML, 2025
DirectorLLM for Human-Centric Video Generation
K. Song, T. Hou, Z. He, H. Ma, J. Wang, A. Sinha, S. Tsai, Y. Luo, X. Dai, L. Chen, X. Xia, P. Zhang, P. Vajda, A. Elgammal, F. Juefei-Xu
BMVC, 2025
Pixel-Space Post-Training of Latent Diffusion Models
C. Zhang, S. Motwaini, M. Yu, J. Hou, F. Juefei-Xu, S. Tsai, P. Vajda, Z. He, J. Wang
ACM-MM RichMedia Workshop, 2025
Transfer between Modalities with MetaQueries
X. Pan, S. N. Shukla, A. Singh, Z. Zhao, S. K. Mishra, J. Wang, Z. Xu, J. Chen, K. Li, F. Juefei-Xu, J. Hou, S. Xie
arXiv, 2025
Token-Shuffle: Towards High-Resolution Image Generation with Autoregressive Models
X. Ma, P. Sun, H. Ma, H. Tang, C. Y. Ma, J. Wang, K. Li, X. Dai, Y. Shi, X. Ju, Y. Hu, A. Sanakoyeu, F. Juefei-Xu, J. Hou, J. Tian, T. Xu, T. Hou, Y. C. Liu, Z. He, Z. He, M. Feiszli, P. Zhang, P. Vajda, S. Tsai, Y. Fu
arXiv, 2025
2024
Movie Gen: A Cast of Media Foundation Models
The Movie Gen Team. Core contributor.
Meta AI Tech Report, 2024
Cache Me if You Can: Accelerating Diffusion Models through Block Caching
F. Wimbauer, B. Wu, E. Schoenfeld, X. Dai, J. Hou, Z. He, A. Sanakoyeu, P. Zhang, S. Tsai, J. Kohler, C. Rupprecht, D. Cremers, P. Vajda, J. Wang
CVPR, 2024
FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis
F. Liang, B. Wu, J. Wang, L. Yu, K. Li, Y. Zhao, I. Misra, J. B. Huang, P. Zhang, P. Vajda, D. Marculescu
CVPR, 2024
ControlRoom3D: Room Generation using Semantic Proxy Rooms
J. Schult, S. Tsai, L. Hollein, B. Wu, J. Wang, C. Y. Ma, K. Li, X. Wang, F. Wimbauer, Z. He, P. Zhang, B. Leibe, P. Vajda, J. Hou
CVPR, 2024
Efficient Quantization Strategies for Latent Diffusion Models
Y. Yang, X. Dai, J. Wang, P. Zhang, H. Zhang
CVPR workshop on Efficient and On-Device Generation, 2024
An Analysis on Quantizing Diffusion Transformers
Y. Yang, J. Wang, X. Dai, P. Zhang, H. Zhang
CVPR workshop on Transformers for Vision, 2024
2023
Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack
X. Dai*, J. Hou*, C. Y. Ma*, S. Tsai*, J. Wang*, R. Wang*, P. Zhang*, S. Vandenhende, X. Wang, A. Dubey, M. Yu, A. Kadian, F. Radenovic, D. Mahajan, K. Li, Y. Zhao, V. Petrovic, M. K. Singh, S. Motwani, Y. Wen, Y. Song, R. Sumbaly+, V. Ramanathan+, Z. He+, P. Vajda+, D. Parikh+
Meta AI Tech Report, 2023. * Equal contribution, alphabetical order. + Joint last authors.
NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View Indoor 3D Object Detection
C. Xu, B. Wu, J. Hou, S. Tsai, R. Li, J. Wang, W. Zhan, Z. He, P. Vajda, K. Keutzer, M. Tomizuka
ICCV, 2023
A Practical Stereo Depth System for Smart Glasses
J. Wang, D. Scharstein, A. Bapat, K. Blackburn-Matzen, M. Yu, J. Lehman, S. Alsisan, Y. Wang, S. Tsai, J. M. Frahm, Z. He, P. Vajda, M. F. Cohen, M. Uyttendaele
CVPR, 2023
Consistent Direct Time-of-Flight Video Depth Super-Resolution
Z. Sun, W. Ye, J. Xiong, G. Choe, J. Wang, S. Su, R. Ranjan
CVPR, 2023
2022
Toward Practical Monocular Indoor Depth Estimation
C. Y. Wu, J. Wang, M. Hall, U. Neumann, S. Su
CVPR, 2022
2021
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run
B. Wu, C. Li, H. Zhang, X. Dai, P. Zhang, M. Yu, J. Wang, Y. Lin, P. Vajda
arXiv, 2021
Level Set Binocular Stereo with Occlusions
J. Wang, T. Zickler
arXiv, 2021
Level Set Stereo for Cooperative Grouping with Occlusion
J. Wang, T. Zickler
ICIP, 2021
Before 2020
A Lighting-Invariant Point Processor for Shading
K. Heal, J. Wang, S. J. Gortler, T. Zickler
CVPR, 2020
Interpreting Robust Optimization via Adversarial Influence Functions
Z. Deng, C. Dwork, J. Wang, L. Zhang
ICML, 2020. Alphabetical order.
Improving Deep Stereo Network Generalization with Geometric Priors
J. Wang, V. Jampani, D. Sun, C. Loop, S. Birchfield, J. Kautz
arXiv, 2020
Local Detection of Stereo Occlusion Boundaries
J. Wang, T. Zickler
CVPR, 2019 Poster Project Stereoscope viewer
A Computational Model for Local Stereo Occlusion Boundary Detection
J. Wang, T. Zickler
Journal of Vision, VSS Abstract, 2019 Poster Project Stereoscope viewer
Half-Occlusion Boundary Detectors in Computational Stereo Vision
J. Wang, D. Glasner, T. Zickler
Journal of Vision, VSS Abstract, 2018 Slides Project Stereoscope viewer
Toward Perceptually-Consistent Stereo: A Scanline Study
J. Wang, D. Glasner, T. Zickler
ICCV, 2017
Patents
Xiong J., et al. System and Method for Depth Densification and Confidence Map Generation
U.S. Patent Application No. 18/430,201
Wang, J., et al. Distance Determinations Using One or More Neural Networks
U.S. Patent Application No. 16/852,944