Faculty
Luc Van Gool
Professor
Bio
Research area: Computer Vision
Google Scholar: link
Prof. Luc Van Gool’s focus research areas are machine learning and computer vision. He is head of the Computer Vision Laboratory at ETH Zurich, while also leading the Computer Vision Research Group at KU Leuven, Belgium. Professor Van Gool is one of the world’s most cited scientists in computer science, particularly in computer vision and machine learning, with over 280,000 citations.
With his research teams, Luc Van Gool is a partner in several national and international projects, e.g. the EU ACTS project Vanguard, the EU Esprit projects Improofs and Impact, and the EU Brite-Euram project Soquetec. He is also involved in several other projects that range from fundamental research to application-driven developments. His major research interests include 2D and 3D object recognition, texture analysis, range acquisition, stereo vision, robot vision, and optical flow.
Prof. Van Gool’s research has been recognized with many prestigious awards, including the David Marr Prize, the Koenderink Award, the Helava Prize, the Tsuji Award and an ERC Advanced Grant. Further, he has co-founded 12 start-up companies (assaia, Endosat, eSaturnus, Eyetronics, Fashwell, GeoAutomation, kooaba, Parquery, Procedural, segments.ai, Sensifai, upicto). Technology giants such as Nvidia, Apple, and Facebook have opened offices in Zurich as a result of these and other successful ETH start ups.
Publications
-
SOVA: Image size agnostic and task driven vision encoder
2026 · International Conference on Machine Learning (ICML 2026)
-
V^{2}-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondence
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
-
Universal Computational Aberration Correction: A Comprehensive Benchmark Analysis
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
-
SPEAR-1: Scaling Beyond Robot Demonstrations via 3D Understanding
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
-
Inferring Compositional 4D Scenes without Ever Seeing One
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
-
GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoning
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
-
FireScope: Wildfire Risk Raster Prediction With a Chain-of-Thought Oracle
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
-
Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encoding
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
-
Are Multimodal Large Language Models Ready for Omnidirectional Spatial Reasoning?
2026 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026) Findings
-
Rethinking Expressivity and Degradation-Awareness in Attention for All-in-One Blind Image Restoration
2026 · International Conference on Learning Representations (ICLR 2026)
-
LENS: Multi-level Evaluation of Multimodal Reasoning with Large Language Models
2026 · International Conference on Learning Representations (ICLR 2026)
-
EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmark
2026 · International Conference on Learning Representations (ICLR 2026)
-
Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization
2026 · International Conference on Learning Representations (ICLR 2026)
-
AR-VLA: Autoregressive Action Expert for Vision–Language–Action Models
2026 · Robotics: Science and Systems (RSS 2026)
-
Unlocking Efficient Vehicle Dynamics Modeling via Analytic World Models
2026 · AAAI Conference on Artificial Intelligence (AAAI 2026)
-
Autonomous Vehicle Path Planning by Searching With Differentiable Simulation
2026 · AAAI Conference on Artificial Intelligence (AAAI 2026)
-
StateSpaceDiffuser: Bringing Long Context to Diffusion World Models
2025 · Conference on Neural Information Processing Systems (NeurIPS 2025)
-
LangHOPS: Language Grounded Hierarchical Open-Vocabulary Part Segmentation
2025 · Conference on Neural Information Processing Systems (NeurIPS 2025)
-
GaussianWorld: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting
2025 · Conference on Neural Information Processing Systems (Datasets and Benchmarks Track) (NeurIPS 2025)
-
Domain-RAG: Retrieval-Guided Compositional Image Generation for Cross-Domain Few-Shot Object Detection
2025 · Conference on Neural Information Processing Systems (NeurIPS 2025)
-
When super-resolution meets camouflaged object detection: A comparison study
2025 · Computer Vision and Image Understanding (CVIU 2025)
-
Test-Time Training for Hyperspectral Image Super-Resolution
2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2025)
-
Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis
2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2025)
-
Guest Editorial: Introduction to the Special Section on Large-Scale Multimodal Learning: Universality, Robustness, Efficiency, and Beyond
2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2025)
-
Enhanced Multi-Scale Cross-Attention for Person Image Generation
2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2025)
-
Condition-Invariant Semantic Segmentation
2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2025)
-
Split Matching for Inductive Zero-shot Semantic Segmentation
2025 · British Machine Vision Conference (BMVC 2025)
-
Occam’s LGS: An Efficient Approach for Language Gaussian Splatting
2025 · British Machine Vision Conference (BMVC 2025)
-
Generalist Robot Manipulation beyond Action Labeled Data
2025 · Conference on Robot Learning (CoRL 2025)
-
Autonomous Vehicle Controllers From End-to-End Differentiable Simulation
2025 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)
-
Autonomous Vehicle Controllers From End-to-End Differentiable Simulation
2025 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)
-
XTrack: Multimodal Training Boosts RGB-X Video Object Trackers
2025 · International Conference on Computer Vision (ICCV 2025)
-
What You Have is What You Track: Adaptive and Robust Multimodal Tracking
2025 · International Conference on Computer Vision (ICCV 2025)
-
Understanding Museum Exhibits using Vision-Language Reasoning
2025 · International Conference on Computer Vision (ICCV 2025)
-
SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretraining
2025 · International Conference on Computer Vision (ICCV 2025)
-
Reducing Unimodal Bias in Multi-Modal Semantic Segmentation with Multi-Scale Functional Entropy Regularization
2025 · International Conference on Computer Vision (ICCV 2025)
-
ObjectRelator: Enabling Cross-View Object Relation Understanding in Ego-Centric and Exo-Centric Videos
2025 · International Conference on Computer Vision (ICCV 2025)
-
MOBIUS: Big-to-Mobile Universal Image Segmentation via Multi-modal Bottleneck Fusion and Calibrated Decoder Pruning
2025 · International Conference on Computer Vision (ICCV 2025)
-
Low-Light Image Enhancement using Event-Based Illumination Estimation
2025 · International Conference on Computer Vision (ICCV 2025)
-
Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description
2025 · International Conference on Computer Vision (ICCV 2025)
-
UniK3D: Universal Camera Monocular 3D Estimation
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
-
The Tenth NTIRE 2025 Image Denoising Challenge Report
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2025)
-
Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussians
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2025)
-
PBR-NeRF: Inverse Rendering with Physics-Based Neural Fields
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
-
One2Any: One-Reference 6D Pose Estimation for Any Object
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
-
MarkushGrapher: Joint Visual and Textual Recognition of Markush Structures
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
-
GaussianVLM: Scene-centric 3D Vision-Language Models using Language-aligned Gaussian Splats for Embodied Reasoning and Beyond
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
-
Exploration-Driven Generative Interactive Environments
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
-
Camera-Only 3D Panoptic Scene Completion for Autonomous Driving through Differentiable Object Shapes
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2025)
-
Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness
2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2025)
-
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting
2025 · International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT 2025)
-
CAFuser: Condition-Aware Multimodal Fusion for Robust Semantic Perception of Driving Scenes
2025 · IEEE Robotics and Automation Letters (RA-L 2025)
-
ReVLA: Reverting Visual Domain Limitation of Robotic Foundation Models
2025 · International Conference on Robotics and Automation (ICRA 2025)
-
Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Tracking
2025 · International Conference on Learning Representations (ICLR 2025)
-
Leveraging Driver Field-of-View for Multimodal Ego-Trajectory Prediction
2025 · International Conference on Learning Representations (ICLR 2025)
-
Mipmap-GS: Let Gaussians Deform with Scale-Specific Mipmap for Anti-Aliasing Rendering
2025 · International Conference on 3D Vision (3DV 2025)
-
A Large-Scale Dataset of Gaussian Splats and Their Self-Supervised Pretraining
2025 · International Conference on 3D Vision (3DV 2025)
-
Sun Off, Lights on: Photorealistic Monocular Nighttime Simulation for Robust Semantic Perception
2025 · Winter Conference on Applications of Computer Vision (WACV 2025)
-
Model Weights Reflect a Continuous Space of Input Image Domains
2025 · Winter Conference on Applications of Computer Vision (WACV 2025)
-
Language-Guided Instance-Aware Domain-Adaptive Panoptic Segmentation
2025 · Winter Conference on Applications of Computer Vision (WACV 2025)
-
Fine-Grained Spatial and Verbal Losses for 3D Visual Grounding
2025 · Winter Conference on Applications of Computer Vision (WACV 2025)
-
Diffusion-Based Particle-DETR for BEV Perception
2025 · Winter Conference on Applications of Computer Vision (WACV 2025)
-
Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Community
2025 · AAAI Conference on Artificial Intelligence (AAAI 2025)
-
Learning to Prompt with Text Only Supervision for Vision-Language Models
2025 · AAAI Conference on Artificial Intelligence (Technical Track on Computer Vision III) (AAAI-CV 2025)
-
Sharing Key Semantics in Transformer Makes Efficient Image Restoration
2024 · Conference on Neural Information Processing Systems (NeurIPS 2024)
-
Learning Generative Interactive Environments By Trained Agent Exploration
2024 · Conference on Neural Information Processing Systems Workshop (NeurIPSW 2024)
-
Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenes
2024 · Conference on Neural Information Processing Systems (NeurIPS 2024)
-
Physical Adversarial Attack Meets Computer Vision: A Decade Survey
2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2024)
-
Neural Vector Fields for Implicit Surface Representation and Inference
2024 · International Journal of Computer Vision (IJCV 2024)
-
Graph Transformer GANs With Graph Masked Modeling for Architectural Layout Generation
2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2024)
-
Domain Adaptive and Generalizable Network Architectures and Training Strategies for Semantic Image Segmentation
2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2024)
-
Bringing Masked Autoencoders Explicit Contrastive Properties for Point Cloud Self-supervised Learning
2024 · Asian Conference on Computer Vision (ACCV 2024)
-
A Unified Framework for Event-Based Frame Interpolation With Ad-Hoc Deblurring in the Wild
2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2024)
-
Prompting Diffusion Representations for Cross-Domain Semantic Segmentation
2024 · British Machine Vision Conference (BMVC 2024)
-
Ternary-type Opacity and Hybrid Odometry for RGB-only NeRF-SLAM
2024 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)
-
Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAM
2024 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)
-
Event-Free Moving Object Segmentation from Moving Ego Vehicle
2024 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)
-
Video Foundation Model for Medical 3D Segmentation
2024 · International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2024)
-
Walker: Self-supervised Multiple Object Tracking by Walking on Temporal Object Appearance Graphs
2024 · European Conference on Computer Vision (ECCV 2024)
-
The BRAVO Semantic Segmentation Challenge Results in UNCV2024
2024 · European Conference on Computer Vision Workshop (ECCVW 2024)
-
Taming CLIP for Fine-grained and Structured Visual Understanding of Museum Exhibits
2024 · European Conference on Computer Vision (ECCV 2024)
-
SLAck: Semantic, Location, and Appearance Aware Open-Vocabulary Tracking
2024 · European Conference on Computer Vision (ECCV 2024)
-
SILC: Improving Vision Language Pretraining with Self-Distillation
2024 · European Conference on Computer Vision (ECCV 2024)
-
SemiVL: Semi-Supervised Semantic Segmentation with Vision-Language Guidance
2024 · European Conference on Computer Vision (ECCV 2024)
-
Self-supervised Shape Completion via Involution and Implicit Correspondences
2024 · European Conference on Computer Vision (ECCV 2024)
-
ROMEO: Revisiting Optimization Methods for Reconstructing 3D Human-Object Interaction Models From Images
2024 · European Conference on Computer Vision Workshop (ECCVW 2024)
-
Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023
2024 · European Conference on Computer Vision (ECCV 2024)
-
MUSES: The Multi-Sensor Semantic Perception Dataset for Driving under Uncertainty
2024 · European Conference on Computer Vision (ECCV 2024)
-
MoVideo: Motion-Aware Video Generation with Diffusion Models
2024 · European Conference on Computer Vision (ECCV 2024)
-
MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentation
2024 · European Conference on Computer Vision (ECCV 2024)
-
Lego: Learning to Disentangle and Invert Concepts Beyond Object Appearance in Text-to-Image Diffusion Models
2024 · European Conference on Computer Vision (ECCV 2024)
-
Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Grounding
2024 · European Conference on Computer Vision (ECCV 2024)
-
DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Control
2024 · European Conference on Computer Vision (ECCV 2024)
-
Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detector
2024 · European Conference on Computer Vision (ECCV 2024)
-
Bayesian Self-Training for Semi-Supervised 3D Segmentation
2024 · European Conference on Computer Vision (ECCV 2024)
-
Stereo Risk: A Continuous Modeling Approach to Stereo Matching
2024 · International Conference on Machine Learning (ICML 2024)
-
Lightweight Image Super-Resolution via Flexible Meta Pruning
2024 · International Conference on Machine Learning (ICML 2024)
-
Image Fusion via Vision-Language Model
2024 · International Conference on Machine Learning (ICML 2024)
-
Vanishing-Point-Guided Video Semantic Segmentation of Driving Scenes .
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
UniDepth: Universal Monocular Metric Depth Estimation
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Towards Online Real-Time Memory-based Video Inpainting Transformers
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2024)
-
Summarize the Past to Predict the Future: Natural Language Descriptions of Context Boost Multimodal Object Interaction Anticipation
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Single-Model and Any-Modality for Video Object Tracking
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Rethinking Few-shot 3D Point Cloud Semantic Segmentation
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Real-World Mobile Image Denoising Dataset with Efficient Baselines
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Probabilistic Sampling of Balanced K-Means using Adiabatic Quantum Computing
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Matching Anything by Segmenting Anything
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Loopy-SLAM: Dense Neural SLAM with Loop Closures
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Investigating the Effectiveness of Cross-Attention to Unlock Zero-Shot Editing of Text-to-Video Diffusion Models
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2024)
-
HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloud
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Equivariant Multi-Modality Image Fusion
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Deep Equilibrium Diffusion Restoration with Parallel Sampling
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
Continuous Pose for Monocular Cameras in Neural Implicit Representation
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
A Unified and Interpretable Emotion Representation and Expression Generation.
2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)
-
StyleGenes: Discrete and Efficient Latent Distributions for GANs
2024 · Winter Conference on Applications of Computer Vision Workshop (WACVW 2024)
-
Optimizing Long-Term Robot Tracking with Multi-Platform Sensor Fusion
2024 · Winter Conference on Applications of Computer Vision Workshop (WACVW 2024)
-
Beyond SOT: Tracking Multiple Generic Objects at Once
2024 · Winter Conference on Applications of Computer Vision Workshop (WACVW 2024)
-
2D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentation
2024 · Winter Conference on Applications of Computer Vision Workshop (WACVW 2024)
-
Revisiting Evaluation Metrics for Semantic Segmentation: Optimization and Evaluation of Fine-Grained Intersection-over-Union
2023 · Conference on Neural Information Processing Systems (Datasets and Benchmarks Track) (NeurIPS 2023)
-
Real-Time Motion Prediction via Heterogeneous Polyline Transformer with Relative Pose Encoding
2023 · Conference on Neural Information Processing Systems (NeurIPS 2023)
-
LART: Neural Correspondence Learning with Latent Regularization Transformer for 3D Motion Transfer
2023 · Conference on Neural Information Processing Systems (NeurIPS 2023)
-
Autodecoding Latent 3D Diffusion Models
2023 · Conference on Neural Information Processing Systems (NeurIPS 2023)
-
Model-aware 3D Eye Gaze from Weak and Few-shot Supervisions
2023 · International Symposium on Mixed and Augmented Reality (ISMAR 2023)
-
Token-Consistent Dropout For Calibrated Vision Transformers
2023 · International Conference on Image Processing (ICIP 2023)
-
Surface Normal Clustering for Implicit Representation of Manhattan Scenes
2023 · International Conference on Computer Vision (ICCV 2023)
-
Source-free Depth for Object Pop-out
2023 · International Conference on Computer Vision (ICCV 2023)
-
Improving Online Lane Graph Extraction by Object-Lane Clustering
2023 · International Conference on Computer Vision (ICCV 2023)
-
Deformable Neural Radiance Fields using RGB and Event Cameras
2023 · International Conference on Computer Vision (ICCV 2023)