Skip to main content

Interior Layout Generation Based on Scene Graph and Graph Generation Model

  • Conference paper
  • First Online:
Design Computing and Cognition’20
  • 699 Accesses

Abstract

Interior layout design is closely related to people’s everyday life and is very widely demanded. As much workload of interior layout design being repetitive and categorized, automation and assistance could be applied with the help of most recent advancement of artificial intelligence. In this paper, we present an exploration work of automating interior layout design. We put forward a set of representation rules which turn interior scene photos into structuralized scene graphs. With representation rule containing both categorial and spatial information, we establish an interior scene graph dataset by annotating well-designed interior scene pictures downloaded from online photo sharing sites. Using the interior scene dataset which contains over 400 valid interior scene graphs, we train a graph generative model and further render its output as reconstructed scenes. The system could generate interior scene within short time and could potentially be applied in multiple related tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 379.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wu W, Fu XM, Tang R, Wang Y, Qi YH, Liu L (2019) Data-driven interior plan generation for residential buildings. ACM Trans Graph (TOG) 38(6):1–12

    Google Scholar 

  2. Li W, Saeedi S, McCormac J, Clark R, Tzoumanikas D, Ye Q, Leutenegger S (2018) InteriorNet: mega-scale multi-sensor photo-realistic indoor scenes dataset. arXiv preprint arXiv:1809.00716

  3. Zhang SH, Zhang SK, Liang Y, Hall P (2019) A survey of 3D indoor scene synthesis. J Comput Sci Technol 34(3):594–608

    Article  Google Scholar 

  4. Wang K, Savva M, Chang AX, Ritchie D (2018) Deep convolutional priors for indoor scene synthesis. ACM Trans Graph (TOG) 37(4):70

    Google Scholar 

  5. Li M, Patil AG, Xu K, Chaudhuri S, Khan O, Shamir A, Zhang H (2019) GRAINS: generative recursive autoencoders for indoor scenes. ACM Trans Graph (TOG) 38(2):12

    Article  Google Scholar 

  6. Huang SS, Fu H, Hu SM (2016) Structure guided interior scene synthesis via graph matching. Graph Models 85:46–55

    Article  MathSciNet  Google Scholar 

  7. Wang K, Lin YA, Weissmann B, Savva M, Chang AX, Ritchie D (2019) Planit: planning and instantiating indoor scenes with relation graph and spatial prior networks. ACM Trans Graph (TOG) 38(4):1–15

    Article  Google Scholar 

  8. Merrell P, Schkufza E, Li Z, Agrawala M, Koltun V (2011) Interactive furniture layout using interior design guidelines. ACM Trans Graph (TOG) 30(4):87

    Article  Google Scholar 

  9. Xu W, Wang B, Yan DM (2015) Wall grid structure for interior scene synthesis. Comput Graph 46:231–243

    Article  Google Scholar 

  10. Qi S, Zhu Y, Huang S, Jiang C, Zhu SC (2018) Human-centric indoor scene synthesis using stochastic grammar. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5899–5908

    Google Scholar 

  11. Johnson J, Krishna R, Stark M, Li LJ, Shamma D, Bernstein M, Fei-Fei L (2015) Image retrieval using scene graphs. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3668–3678

    Google Scholar 

  12. Johnson J, Gupta A, Fei-Fei L (2018) Image generation from scene graphs. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1219–1228

    Google Scholar 

  13. Anderson P, Fernando B, Johnson M, Gould S (2016) Spice: semantic propositional image caption evaluation. In: European conference on computer vision. Springer, Cham, pp 382–398

    Google Scholar 

  14. Chang A, Savva M, Manning CD (2014) Learning spatial knowledge for text to 3D scene generation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 2028–2038

    Google Scholar 

  15. Zhou J, Cui G, Zhang Z, Yang C, Liu Z, Sun M (2018) Graph neural networks: a review of methods and applications. arXiv preprint arXiv:1812.08434

  16. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907

  17. Li Q, Han Z, Wu XM (2018) Deeper insights into graph convolutional networks for semi-supervised learning. In: Thirty-second AAAI conference on artificial intelligence

    Google Scholar 

  18. Brockschmidt M, Allamanis M, Gaunt AL, Polozov O (2018) Generative code modeling with graphs. arXiv preprint arXiv:1805.08490

  19. De Cao N, Kipf T (2018) MolGAN: an implicit generative model for small molecular graphs. arXiv preprint arXiv:1805.11973

  20. You J, Liu B, Ying Z, Pande V, Leskovec J (2018) Graph convolutional policy network for goal-directed molecular graph generation. In: Advances in neural information processing systems, pp 6410–6421

    Google Scholar 

  21. Li Y, Vinyals O, Dyer C, Pascanu R, Battaglia P (2018) Learning deep generative models of graphs. arXiv preprint arXiv:1803.03324

  22. Song S, Yu F, Zeng A, Chang AX, Savva M, Funkhouser T (2017) Semantic scene completion from a single depth image. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1746–1754

    Google Scholar 

  23. Liu M, Zhang K, Zhu J, Wang J, Guo J, Guo Y (2018) Data-driven indoor scene modeling from a single color image with iterative object segmentation and model retrieval. IEEE Trans Vis Comput Graph

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Su, X., Wu, C., Gao, W., Huang, W. (2022). Interior Layout Generation Based on Scene Graph and Graph Generation Model. In: Gero, J.S. (eds) Design Computing and Cognition’20. Springer, Cham. https://doi.org/10.1007/978-3-030-90625-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90625-2_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90624-5

  • Online ISBN: 978-3-030-90625-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics