Description

The integration of AI and machine learning into scientific computing, particularly in 3D and 4D geometry generation, is transforming how complex, dynamic phenomena are understood and modeled. Traditional 2D approaches are proving inadequate in capturing the full scope of multi-scale, heterogeneous scientific data, limiting the accuracy and applicability of simulations across such diverse fields as climate science, urban planning, and biomedicine. The ability to reconstruct high-fidelity 3D geometries enables more precise analysis of natural environments and man-made systems, driving breakthroughs in predictive modeling and hypothesis generation. As scientific challenges become more intricate — ranging from glacier melt patterns to urban infrastructure planning under extreme weather — accurate, scalable 3D methods are increasingly essential.

To tackle these challenges, this workshop seeks not only to surface key research questions but also to build an active and interdisciplinary community at the intersection of computer vision and scientific domains. By bringing together researchers, practitioners, and domain experts, we aim to spark meaningful dialogue, initiate new collaborations, and create lasting connections that extend beyond the event itself. This raises a set of new questions:

  • Q1: How to develop scalable, high-fidelity 3D/4D methods that seamlessly integrate heterogeneous views to represent complex and multi-scale scientific data?
  • Q2: How to optimize 3D/4D vision models with an awareness of and for the purposes of addressing downstream scientific problems?
  • Q3: How to balance the computational efficiency and accuracy in real-time 3D/4D reconstructions for scientific problems?

Topics

In this workshop, we aim to bring together experts from computer vision and scientific problems, spur discussions, and foster collaborations on broad and transformative questions and challenges (include but not limited to):

  • Multi-scale Patterns: How can 3D/4D models effectively capture both fine-grained and large-scale details in complex scientific datasets, such as fluid and smoke?
  • Large-scale Scenes: What techniques can improve the scalability of 3D/4D reconstructions for large environments like cities, forests, or glaciers, without sacrificing accuracy or computational feasibility?
  • Heterogeneous Views: How can we effectively integrate data from multiple sources (e.g., satellite, LiDAR, drone, mobile devices) to produce accurate and seamless 3D models while minimizing noise and alignment issues?
  • Dynamic and Time-varying Views: What methods can improve temporal coherence in 4D reconstructions of dynamic scenes, such as fast-moving natural systems or urban traffic, while avoiding artifacts?
  • Complex and Unstructured Geometries: How can 3D/4D models better handle irregular, unstructured geometries found in natural environments like mountains or coral reefs, particularly in the presence of sharp features?
  • Occlusions and Missing Observations: What techniques can be developed to fill gaps in occluded or incomplete data in real-world scenarios, ensuring accurate reconstructions despite missing perspectives or environmental obstacles?
  • Computational Complexity: How can we reduce the computational cost of high-quality 3D/4D reconstructions, especially for real-time or large-scale applications that require high-resolution output?
  • Generalization and Scene Adaptability: What approaches can help 3D/4D models generalize to new environments without retraining, enabling wider applicability across different scientific domains?
  • Real-time Rendering for Dynamic Scenes: How can we achieve real-time rendering for dynamic 4D scenes in complex environments, such as simulating natural disasters or fast-moving ecosystems?
  • Lighting and Viewpoint Variations: What novel algorithms can improve the robustness of 3D reconstructions in variable lighting or challenging viewpoints (e.g., low-light conditions or extreme weather)?

Scientific Domains. We invite paper submissions from various scientific domains, including but not limited to: Fluid Dynamics, Climate and Glaciology, Biomedicine and Medical Research, Astronomy and Planetary Science, Material Science, Physics and High Energy Research, Astrophysics and Space Science, Computational Modeling and Forecasting, Earth Science, Chemistry and Small Molecules, Ecology and Environmental Studies, Geosciences and Geology, Urban Planning and Architecture. Applications-driven submissions focusing on 3D/4D reconstructions for scientific data are also highly encouraged.

Confirmed Speakers (A-Z by Last Name)

Eitan Grinspun

Eitan Grinspun

Professor, University of Toronto

Danny Kaufman

Danny Kaufman

Principal Scientist, Adobe Research

Tamar Shinar

Tamar Shinar

Associate Professor, UC Riverside

Jiajun Wu

Jiajun Wu

Assistant Professor, Stanford University

Wei Xu

Wei Xu

Staff Computational Scientist, Trustworthy Artificial Intelligence (TAI) Group Lead, Brookhaven National Laboratory

Research Professor, Stony Brook University

Xiaoxiang Zhu

Xiaoxiang Zhu

Professor, Technical University of Munich

Call for Papers

We provide more submission details: Guidance for 3D4Science CFP at CVPR 2026.
OpenReview submission portal: https://openreview.net/group?id=thecvf.com/CVPR/2026/Workshop/3D4S
Tentative important dates (AoE time):
  • Abstract Submission Deadline: March 10, 2026
  • Paper Submission Deadline: March 12, 2026
  • Review Bidding Period: March 12 - March 14, 2026
  • Review Deadline: March 31, 2026
  • Acceptance/Rejection Notification Date: April 2, 2026
  • Camera-Ready Submission: April 11, 2026
  • Workshop Date: June 3 or 4, 2026

Travel Support

We are excited to offer a limited number of free workshop registrations for CVPR 2026, exclusively for full-time students attending in person. This initiative aims to support early-career researchers while fostering diversity, equity, and inclusion (DEI) in the academic community.

  • Selection Criteria: Applications will be evaluated based on the strength of the submitted materials. Priority will be given to students presenting papers at our workshop who lack alternative travel support.
  • How to Apply:
    • Personal & Academic Details: Name, affiliation, and relevant academic information
    • CV/Resume
    • Paper ID: Accepted or submitted to our workshop
    • Statement of Interest: A brief paragraph explaining how this opportunity will benefit your research and career
    • Attendance Confirmation: A clear statement confirming that you will attend in person

Schedule

All times are in Denver Time (GMT-6).

Denver Time (GMT-6) Event
13:00-13:05 Opening Remarks
13:05-13:35 Invited Talk 1
13:40-14:10 Invited Talk 2
14:15-14:30 Oral Talks
14:35-15:05 Invited Talk 3
15:10-15:40 Invited Talk 4
15:45-16:15 Poster
16:20-16:50 Invited Talk 5
16:55-17:25 Invited Talk 6
17:30-17:35 Closing Remarks

Organizers

Wuyang Chen

Wuyang Chen

Assistant Professor, Simon Fraser University

Marissa Ramirez de Chanlatte

Marissa Ramirez de Chanlatte

Playground Global

Zhiwen Fan

Peter Yichen Chen

Assistant Professor, The University of British Columbia

Zhiwen Fan

Zhiwen ("Aaron") Fan

Assistant Professor, Texas A&M University

Chuhang Zou

Chuhang Zou

Staff Research Scientist, Meta Reality Labs

Daniel Martin

Daniel Martin

Group Lead, Applied Numerical Algorithms Group, Lawrence Berkeley National Laboratory

Michael Mahoney

Michael Mahoney

Professor, University of California at Berkeley

Vice President, International Computer Science Institute (ICSI)

Group Lead, Machine Learning and Analytics Group, Lawrence Berkeley National Laboratory