Abstract
This paper focuses on a training-based method to reconstruct a scene’s spectral reflectance from a single RGB image captured by a camera with known spectral response. In particular, we explore a new strategy to use training images to model the mapping between camera-specific RGB values and scene reflectance spectra. Our method is based on a radial basis function network that leverages RGB white-balancing to normalize the scene illumination to recover the scene reflectance. We show that our method provides the best result against three state-of-art methods, especially when the tested illumination is not included in the training stage. In addition, we also show an effective approach to recover the spectral illumination from the reconstructed spectral reflectance and RGB image. As a part of this work, we present a newly captured, publicly available, data set of hyperspectral images that are useful for addressing problems pertaining to spectral imaging, analysis and processing.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Abed, F.M., Amirshahi, S.H., Abed, M.R.M.: Reconstruction of reflectance data using an interpolation technique. J. Opt. Soc. Am. A 26(3), 613–624 (2009)
Agahian, F., Amirshahi, S.A., Amirshahi, S.H.: Reconstruction of reflectance spectra using weighted principal component analysis. Color Research & Application 33(5), 360–371 (2008)
Ayala, F., Echávarri, J.F., Renet, P., Negueruela, A.I.: Use of three tristimulus values from surface reflectance spectra to calculate the principal components for reconstructing these spectra by using only three eigenvectors. J. Opt. Soc. Am. A 23(8), 2020–2026 (2006)
Barakzehi, M., Amirshahi, S.H., Peyvandi, S., Afjeh, M.G.: Reconstruction of total radiance spectra of fluorescent samples by means of nonlinear principal component analysis. J. Opt. Soc. Am. A 30(9), 1862–1870 (2013)
Brainard, D.H., Freeman, W.T.: Bayesian color constancy. J. Opt. Soc. Am. A 14(7), 1393–1411 (1997)
Chen, S., Cowan, C.F., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Transactions on Neural Networks 2(2), 302–309 (1991)
Cheng, D., Prasad, D.K., Brown, M.S.: Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. J. Opt. Soc. Am. A 31(5), 1049–1058 (2014)
Cohen, J.: Dependency of the spectral reflectance curves of the munsell color chips. Psychonomic Science (1964)
Connah, D., Westland, S., Thomson, M.G.: Recovering spectral information using digital camera systems. Coloration Technology 117(6), 309–312 (2001)
Eslahi, N., Amirshahi, S.H., Agahian, F.: Recovery of spectral data using weighted canonical correlation regression. Optical Review 16(3), 296–303 (2009)
Fairman, H.S., Brill, M.H.: The principal components of reflectances. Color Research & Application 29(2), 104–110 (2004)
Finlayson, G.D., Trezzi, E.: Shades of gray and colour constancy. In: Color and Imaging Conference, vol. 2004, pp. 37–41 (2004)
Gijsenij, A., Gevers, T., van de Weijer, J.: Computational color constancy: Survey and experiments. IEEE Transactions on Image Processing 20(9), 2475–2489 (2011)
Hall, R., Hall, R.: Illumination and color in computer generated imagery, vol. 7. Springer, New York (1989)
Jaaskelainen, T., Parkkinen, J., Toyooka, S.: Vector-subspace model for color representation. J. Opt. Soc. Am. A 7(4), 725–730 (1990)
Jiang, J., Liu, D., Gu, J., Susstrunk, S.: What is the space of spectral sensitivity functions for digital color cameras? In: IEEE Workshop on Applications of Computer Vision, pp. 168–179 (2013)
Laamanen, H., Jetsu, T., Jaaskelainen, T., Parkkinen, J.: Weighted compression of spectral color information. J. Opt. Soc. Am. A 25(6), 1383–1388 (2008)
Lenz, R., Meer, P., Hauta-Kasari, M.: Spectral-based illumination estimation and color correction. Color Research & Application 24, 98–111 (1999)
MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth Berkeley Symposium on Mathematical Statistics and Probability, California, USA, vol. 1, pp. 281–297 (1967)
Maloney, L.T.: Evaluation of linear models of surface spectral reflectance with small numbers of parameters. J. Opt. Soc. Am. A 3(10), 1673–1683 (1986)
Maloney, L.T., Wandell, B.A.: Color constancy: a method for recovering surface spectral reflectance. J. Opt. Soc. Am. A 3(1), 29–33 (1986)
Marimont, D.H., Wandell, B.A.: Linear models of surface and illuminant spectra. J. Opt. Soc. Am. A 9(11), 1905–1913 (1992)
Park, J.I., Lee, M.H., Grossberg, M.D., Nayar, S.K.: Multispectral imaging using multiplexed illumination. In: International Conference on Computer Vision, pp. 1–8 (2007)
Parkkinen, J.P., Hallikainen, J., Jaaskelainen, T.: Characteristic spectra of munsell colors. J. Opt. Soc. Am. A 6(2), 318–322 (1989)
Peyvandi, S., Amirshahi, S.H.: Generalized spectral decomposition: a theory and practice to spectral reconstruction. J. Opt. Soc. Am. A 28(8), 1545–1553 (2011)
Peyvandi, S., Amirshahi, S.H., Hernández-Andrés, J., Nieves, J.L., Romero, J.: Spectral recovery of outdoor illumination by an extension of the bayesian inverse approach to the gaussian mixture model. J. Opt. Soc. Am. A 29(10), 2181–2189 (2012)
Prasad, D.K., Nguyen, R., Brown, M.S.: Quick approximation of camera’s spectral response from casual lighting. In: IEEE International Conference on Computer Vision Workshops, pp. 844–851 (2013)
Romero, J., Garcia-Beltran, A., Hernández-Andrés, J.: Linear bases for representation of natural and artificial illuminants. J. Opt. Soc. Am. A 14(5), 1007–1014 (1997)
Sharma, G., Wang, S.: Spectrum recovery from colorimetric data for color reproductions. In: Color Imaging: Device-Independent Color, Color Hardcopy, and Applications VII. Proc. SPIE, vol. 4663, pp. 8–14 (2002)
Zhang, X., Xu, H.: Reconstructing spectral reflectance by dividing spectral space and extending the principal components in principal component analysis. J. Opt. Soc. Am. A 25(2), 371–378 (2008)
Zhao, H., Kawakami, R., Tan, R.T., Ikeuchi, K.: Estimating basis functions for spectral sensitivity of digital cameras. In: Meeting on Image Recognition and Understanding, vol. 1 (2009)
Zhao, Y., Berns, R.S.: Image-based spectral reflectance reconstruction using the matrix r method. Color Research & Application 32(5), 343–351 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Nguyen, R.M.H., Prasad, D.K., Brown, M.S. (2014). Training-Based Spectral Reconstruction from a Single RGB Image. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8695. Springer, Cham. https://doi.org/10.1007/978-3-319-10584-0_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-10584-0_13
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10583-3
Online ISBN: 978-3-319-10584-0
eBook Packages: Computer ScienceComputer Science (R0)