SIMBAR: Single Image-Based Scene Relighting For Effective Data Augmentation For Automated Driving Vision Tasks
Xianling Zhang, Nathan Tseng, Ameerah Syed, Rohan Bhasin, Nikita Jaipuria
Abstract
Real-world autonomous driving datasets comprise of images aggregated from different drives on the road. The ability to relight captured scenes to unseen lighting conditions, in a controllable manner, presents an opportunity to augment datasets with a richer variety of lighting conditions, similar to what would be encountered in the real-world. This paper presents a novel image-based relighting pipeline, SIMBAR, that can work with a single image as input. To the best of our knowledge, there is no prior work on scene relighting leveraging explicit geometric representations from a single image. We present qualitative comparisons with prior multi-view scene relighting baselines. To further validate and effectively quantify the benefit of leveraging SIMBAR for data augmentation for automated driving vision tasks, object detection and tracking experiments are conducted with a state-of-the-art method, a Multiple Object Tracking Accuracy (MOTA) of 93.3% is achieved with CenterTrack on SIMBAR-augmented KITTI - an impressive 9.0% relative improvement over the baseline MOTA of 85.6% with CenterTrack on original KITTI, both models trained from scratch and tested on Virtual KITTI. For more details and SIMBAR relit datasets, please visit our project website (https://simbarv1.github.io/).
Create a lesson
Related papers
Seeing the Small: Deformable Duality Mamba for Retinal Lesion Segmentation
Chang Yu, Siqing Li, Yuanchen Liu et al.
Evidential Deep Learning with conditional entropy for glaucoma detection
Hai Siong Tan, Kuancheng Wang
TMAL: Topology-preserving Multi-offset Affinity Learning for Curvilinear Structure Segmentation
Suho Han, Soungsill Park, Kanghyun Ryu et al.
Distribution Shift Detection in Remote Sensing Imagery using Machine Learning Models
Abdullah Almansour, Ozan K. Tonguz
Dark Matters: VAE-Aware HDR Encoding for SDR-to-HDR Video Reconstruction
Donghoon Cha, Bomseok Park, Hansl von Kwon et al.
Reasoning-Aware Relational Representation Learning for Open-Vocabulary Scene Graph Generation
Jiawei Xiao, Boya Wang, Longtian Qiu et al.