Making-a-Scene: A Preliminary Case Study on Speech-Based 3D Shape Exploration Through Scene Modeling Academic Article uri icon

abstract

  • Abstract We explore verbalization as a means for quick-and-dirty 3D shape exploration in early design. Our work stems from the knowledge gap that the fundamental principles necessary to operationalize speech as a viable means for describing and communicating 3D digital forms do not currently exist. To address this gap, we present a case study on 3D scene modeling within the context of interior design. For this, we implemented a constrained workflow wherein a user can iteratively generate variations of seed templates of objects in a scene through verbal input. By using this workflow as an experimental setup, we systematically study four aspects of speech-based shape exploration, namely, (a) design-in-context (creating one shape with respect or in relation to the other), (b) order independence (sequence of parts preferred in speech-based shape exploration), (c) multiscale exploration (study how speech allows overview-then-detail modifications), and (d) semantic regions of interest (effectiveness of speech for modifying regions of a given object). We finally present an observational study with six participants selected from diverse backgrounds to better understand shape verbalization.

published proceedings

  • Journal of Computing and Information Science in Engineering

altmetric score

  • 0.25

author list (cited authors)

  • Vyas, S., Chen, T., Mohanty, R. R., & Krishnamurthy, V. R.

citation count

  • 1

complete list of authors

  • Vyas, Shantanu||Chen, Ting-Ju||Mohanty, Ronak R||Krishnamurthy, Vinayak R

publication date

  • December 2022