Back to articles
Article
Volume: 34 | Article ID: AVM-214
Image
Original image noise reconstruction for spatially-varying filtered driving scenes
  DOI :  10.2352/EI.2022.34.16.AVM-214  Published OnlineJanuary 2022
Abstract
Abstract

Test drives for the development of camera-based automotivealgorithms like object detection or instance segmentation are veryexpensive and time-consuming. Therefore, the re-use of existingdatabases like COCO or Berkeley Deep Drive by intentionallyvarying the image quality in a post-processing step promises tosave time and money, while giving access to novel image qualityproperties. One possible variation we investigate is the sharpnessof the camera system, by applying spatially varying optical blurmodels as low-pass filters on the image data. Any such opera-tion significantly changes the amount and distribution of noise, acentral property of image quality, which in this context is an un-desired side-effect. In this article, a novel method is presentedto reconstruct the original camera sensor noise for the filteredimage. This is different from denoising. The method estimatesthe original camera sensor noise using the combination of princi-pal component analysis (PCA) and a variance-stabilizing trans-formation. The noise is then reconstructed for the filtered imagewith the PCA applied locally on small image sections, and an in-verse variance-stabilizing transformation. Although the resultingnoise distribution can slightly deviate from the original, this novelmethod does not introduce any image artifacts as denoising woulddo. We present the method as applied to synthetic and real driv-ing scenes at different noise levels and discuss the accuracy of thereconstruction visually and with statistical parameters.

Subject Areas :
Views 89
Downloads 34
 articleview.views 89
 articleview.downloads 34
  Cite this article 

Luis Constantin Wohlers, Patrick Müller, Alexander Braun, "Original image noise reconstruction for spatially-varying filtered driving scenesin Proc. IS&T Int’l. Symp. on Electronic Imaging: Autonomous Vehicles and Machines,  2022,  pp 214-1 - 214-7,  https://doi.org/10.2352/EI.2022.34.16.AVM-214

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2022
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA