The Application of Virtual Humans and Virtual Scenes in Studio Layout Design (Postprint)
Selina Jen
Submitted 2025-07-09 | ChinaXiv: chinaxiv-202507.00295

Abstract

With the rapid development of contemporary digital technology, the application of virtual technology in studio layout design has become increasingly extensive. This paper aims to deeply explore the innovative application of virtual human and virtual scene technologies in modern studio layout design, and provides an outlook on their implementation methods, advantages, challenges, and future development trends.

[Objective] This study selects typical application scenarios to analyze from the dimensions of functional realization, scene construction, and interaction design, systematically demonstrating the application effects and innovative potential of virtual technology in studio layouts.

[Method] The research finds that the application of virtual humans and virtual scenes not only promotes the innovation and development of broadcasting technology but also brings more possibilities and opportunities for program production.

[Result / Conclusion] With the continuous advancement of technology and the ongoing expansion of application fields, virtual technology will play an increasingly important role in studio layout design.

Full Text

Preamble

Technology is poised to play an increasingly vital role in the layout and design of broadcast studios. With the rapid advancement of computer graphics, artificial intelligence algorithms, and multimodal sensing technologies, traditional studio design—once constrained by the limitations of physical space and the complexity of real-scene construction—is evolving. Conventional methods often struggle to achieve diverse and flexible scene effects; however, the introduction of virtual humans and virtual scenes has brought revolutionary changes to studio layout design.

By leveraging computer-generated imagery and 3D modeling, virtual technology can create realistic and vivid visual effects that greatly enrich the presentation of broadcast content. The application of virtual humans and virtual scenes not only enhances the visual appeal and entertainment value of programs but also holds significant practical importance. Virtual technology reduces the costs and time associated with physical set construction, thereby improving production efficiency. While traditional sets require substantial human, material, and financial resources—and are difficult to replace quickly—virtual technology allows for the rapid generation and switching of different scenes. Furthermore, the use of virtual humans enhances interactivity and immersion. Their real-time interaction capabilities diversify program formats, attracting greater audience engagement. Additionally, virtual scenes provide designers with expanded creative possibilities, allowing them to realize effects that are difficult to achieve in the physical world, ultimately improving program quality and competitiveness.

1.1 Role Positioning and Functions of Virtual Humans

Virtual humans can fulfill multiple roles in studio layout design, ranging from hosts and performing guests to interactive audience participants. With their unique advantages and expressive power, they inject new vitality and creativity into program recording.

As hosts, virtual humans add a novel dimension to studio design. They can traverse different scenes without time or space constraints, guiding the program flow and introducing guests. Through sophisticated motion capture and speech synthesis technologies, virtual hosts exhibit natural and fluid hosting styles, enabling seamless interaction with live guests and creating a more engaging atmosphere.

In the context of program recording, virtual humans also serve as performing guests. They can execute special effects and movements that are impossible in the real world, such as instantaneous costume changes or high-difficulty dance moves, providing a stunning visual experience. Furthermore, virtual humans can perform alongside real guests, co-creating spectacular stage effects. Finally, they can function as virtual audience members, participating in interactive segments to enhance the sense of presence and participation for real viewers.

1.2 Design Principles and Creativity of Virtual Scenes

The design of virtual scenes must consider the integration of program content, the creation of atmosphere, and the construction of spatial hierarchy. Through innovative design, virtual scenes can provide more vivid visual effects and improve the viewer experience.

The primary principle of virtual scene design is close integration with program content. The scene must not only match the theme and style of the program but also accurately convey its core message and emotional tone. For instance, in historical programs, virtual scenes can reconstruct ancient palaces or ruins using detailed modeling and rendering, allowing audiences to feel as though they have traveled through time. This integration enhances both the watchability and the audience's sense of immersion.

Furthermore, virtual scene design should focus on creating an atmosphere that triggers emotional resonance. By skillfully using lighting, color, texture, and sound, designers can evoke emotions such as romance, mystery, tension, or joy. In music programs, for example, a virtual scene can be designed as a dreamlike stage where light and shadow effects create a strong emotional connection between the singer and the audience.

1.3 Integration of Virtual and Physical Elements

The combination of virtual and physical elements in studio layout design demonstrates significant complementary advantages \cite{5, 6}. Virtual elements, such as virtual humans and scenes, offer infinite creative space due to their flexibility and lack of physical constraints. They can respond rapidly to production needs and create effects that traditional elements cannot. Conversely, physical elements—such as real stages, props, and lighting—provide a sense of reality and texture that enhances the audience's intuitive experience through physical feedback.

The integration of these elements allows each to maximize its strengths while compensating for the other's limitations. For example, incorporating real props and lighting into a virtual scene makes the environment appear more three-dimensional and authentic. Conversely, using virtual backgrounds on a physical stage breaks traditional limitations to create more impactful visuals. This synergy not only improves the visual quality of the program but also provides more creative possibilities for production, making interactions between the audience and virtual elements feel more grounded and interesting.

2.1 Enhancing Visual Effects and Artistic Expression

Virtual humans and scenes significantly enhance the visual impact of studio designs through rich colors, light, shadow, and unique dynamic modeling. Advanced rendering technology and color management allow virtual elements to present realistic color layers that either contrast with or harmonize with physical elements. The flexible use of virtual lighting, such as dynamic projections, enriches the spatial hierarchy and creates a unique artistic atmosphere.

The unique design of virtual humans in terms of appearance and movement is also a key factor. Virtual humans can be customized—from clothing to facial expressions—to achieve high-fidelity simulation or even surreal innovation. Similarly, creative designs in virtual scenes, such as fantastical landscapes or dynamic weather changes, provide audiences with a fresh and engaging visual experience.

2.2 Strengthening Interactivity and Audience Engagement

Virtual technology enhances interactivity through real-time engagement segments and audience feedback mechanisms. Using advanced VR and AR, virtual humans can interact with live or remote audiences through Q&A sessions, games, and challenges. This breaks the physical boundaries of the traditional studio and provides a more immersive experience. Virtual scenes can also change dynamically based on the interaction, maintaining audience interest. For example, in a music program, a virtual human can participate in a dance challenge with the audience while the scene shifts in real-time to match the musical style.

By integrating social media, online voting, and real-time comments, programs can immediately collect and display audience feedback. Virtual humans can act as information messengers, announcing voting results or highlighting comments, which fosters a sense of belonging among viewers. Virtual scenes can also be adjusted dynamically (e.g., changing colors or layout) to respond to audience preferences, further personalizing the experience.

2.3 Improving Spatial Efficiency and Flexibility

The introduction of virtual humans and scenes greatly expands the efficiency and flexibility of space utilization. Virtual reality technology allows for the creation of infinite virtual spaces within a limited physical area. For instance, a single physical studio can simulate multiple environments—such as historical settings, natural landscapes, or futuristic cities—with instantaneous transitions.

A notable example is the 2023 CCTV Spring Festival Gala program "When 'Mythical Beasts' Meet Children," which utilized glasses-free 3D and VR 3D painting to bring ancient mythical creatures to life, demonstrating the perfect fusion of technology and art. Unlike traditional scene changes that require significant labor and time to move props and adjust lighting, virtual scenes can be switched instantly via software \cite{11, 12}. This not only saves costs but also ensures the accuracy and fluency of transitions, allowing for more creative and diverse program content.

3. Future Trends in Virtual Human and Scene Application in Studio Design

With the rise of the Metaverse, studio design will expand from single physical spaces to multi-platform, cross-dimensional virtual spaces. Generative Artificial Intelligence (AIGC) will significantly enhance the design efficiency and creative potential of virtual elements. In the future, AI algorithms will automatically generate 3D models tailored to program themes, while virtual humans will use natural language processing to generate interactive scripts and improvised performances. AI-driven "text-to-scene" capabilities in VR design will lower the barrier to creative realization and enable real-time content production.

The maturation of Augmented Reality (AR) and Mixed Reality (MR) will facilitate the seamless connection between physical stages and virtual scenes. Through spatial computing and real-time keying, virtual backgrounds can dynamically match the lighting and perspective of physical props. This "virtual-real fusion" design philosophy will allow for the free adjustment of the ratio between virtual and real elements to meet different levels of authenticity required by the program.

Furthermore, virtual production will drive studios toward a green, low-carbon transformation. By reducing the material consumption of physical sets, the reuse rate of virtual scenes can exceed 90%. Additionally, the long-term cost of using AI virtual humans is lower than that of real actors, and they can be deployed across multiple programs to form sustainable IP assets. Virtual humans will evolve into "cultural symbols," maximizing user loyalty and commercial value through IP operations, including derivatives and virtual performances.

In conclusion, the application of virtual humans and scenes marks a new era of innovation in media production. These technologies not only enrich visual expression and artistic appeal but also significantly enhance audience engagement. As Metaverse, AIGC, and MR technologies continue to iterate, virtual elements will become deeply integrated into the underlying architecture of broadcast studios, driving the transition from "technology-enabled" to "intelligent reconstruction" and ultimately forming a new generation of media ecology where humans, machines, and scenes coexist.

References

[1] Wang Lihui, Dong Wei. The Charm of Virtual: Application of Virtual Technology in Omni-media Studios [J]. Exploration of Information Technology, 2021(12): 131-133.
[2] Wang Yi. Research on the Function and Acceptance of Virtual Hosts in Variety Shows [J]. China Television, 2023(1): 94-101.
[3] Chen Han. Application of Virtual Hosts in Radio and Television [J]. Video Engineering, 2024, 48(2): 171-173.
[4] Liang Jinsong, Zhang Bing, He Yi. Discussion on the Application of Lighting in Highlighting Virtual Scene Effects [J]. Modern Television Technology, 2016(9): 117-121.
[5] Yang Piaopiao, Zhao Jiguang. Virtual-Real Fusion and Scene Upgrading: Research on the IP Construction of Virtual Human "Liu Yexi" from the Perspective of Metaverse [J]. Audio-Visual Realm, 2023(04).
[6] Shen Hao, Yu Yinglong, Liu Xiaofeng. Design of Studio System Based on Virtual Reality Technology—Taking "Virtual Studio" Design as an Example [J]. Modern Cinema Technology, 2022(2): 23-29.
[7] Zhang Bo. Inspiration from Virtual Idol Variety Shows: A Case Study of Jiangsu Satellite TV's "2060" [J]. Video Production, 2024(3): 111-115.
[8] Jiao Yaonan. Research on VR Eye-tracking Data Visualization Based on Rendering Engines [J]. Modern Cinema Technology, 2024(12): 36-41.
[9] Cheng Pengxiang, Zhang Min. Design and Implementation of Virtual Studio Based on UE5 Platform [J]. Automation & Instrumentation, 2024(6): 114-117.
[10] Wang Miaomiao. Application of XR Technology in Gala Programs in the Era of Converged Media [J]. Video Engineering, 2023, 47(7): 159-162.
[11] Wang Junfan. Innovating Virtual Human Application Scenarios to Release Employee Productivity [J]. China Rural Finance, 2022(08): 88-89.
[12] Li Tianfu. Application of Virtual Studio Technology in Television Program Production [J]. Video Engineering, 2024, 49(1): 67-69.
[13] Chen Wentai, Sun Zhongbo. Returning to the Mirror Dimension: Technical Logic and Media Ecology Iteration of Sora under the Wave of Generative AI [J]. New Media Research, 2024(4).
[14] Zhao Wenhui, et al. Discussion on the Commercial Market Value of Virtual Idols [J]. Focusing Mirror, 2022(2): 15-15.
[15] Yu Guoming, Teng Wenqiang. Focusing on Emotional Value: On the "Breaking Circle" Mechanism of Virtual Idols [J]. News and Writing, 2021(04): 63-67.

Submission history

The Application of Virtual Humans and Virtual Scenes in Studio Layout Design (Postprint)