A New Workplace Where Virtual and Real Worlds Converge
Developing MR applications to bring this vision to life
~Aiming to Alleviate the Isolation of Remote Work and Address the Lack of Spontaneous Communication~

Nikken Sekkei Ltd. (Headquarters: Chiyoda-ku, Tokyo; President and CEO: Atsushi Omatsu; hereinafter “Nikken Sekkei”) and Hololab, Inc. (Headquarters: Shinagawa-ku, Tokyo;Representative Director and CEO: Kaoru Nakamura; hereinafter “HoloLab”) have developed an MR*1 prototype application aimed at realizing the “Cyber-Physical Workplace” (hereinafter “CPW”), a workplace where virtual and real spaces converge.
Through this development, Nikken Sekkei and HoloLab present a vision for a new workplace in the era of the “New Normal.”

This workplace aims to enhance communication and improve labor productivity by combining a cyber space (virtual space) built on BIM*2 data with sensor information from the physical space (real world) utilizing IoT, and connecting these different spaces through MR technology.

*1 MR (Mixed Reality)
A broad term referring to technologies that fuse the physical world with the digital world, such as VR (Virtual Reality), which provides an immersive experience in a digital environment, and AR (Augmented Reality), which overlays digital information onto the physical world.
*2 BIM (Building Information Modeling)
A system for constructing a building information model that combines primarily 3D geometric data created on a computer with attribute information about the building, such as room names and areas, material and component specifications and performance, and finishes.
 

Against the backdrop of the spread of the novel coronavirus in recent years, telework—centered on working from home—has rapidly gained traction. While the psychological barriers and costs associated with digital communication have decreased, various surveys have revealed that teleworkers are experiencing feelings of loneliness and that spontaneous communication has declined. CPW was created with the goal of addressing these issues through technology.
Nikken Sekkei has a long history of designing workplaces that meet the needs of each era. Drawing on that experience and know-how, we aimed to create a new vision for the workplace where the physical and virtual office environments are seamlessly integrated.
We are creating the workplace of the future—one that fits into a world where location-independent work continues to advance and wearing various mixed reality (MR) devices becomes the norm.
 

As the first step toward realizing CPW, we developed a prototype application that fosters serendipitous encounters in the workplace—whether through remote work or in a physical office—and uses mixed reality (MR) technology to enhance nonverbal communication, thereby alleviating feelings of isolation among remote workers and encouraging spontaneous interactions.
The system allows remote workers to immerse themselves in a virtual office space (digital twin) via VR devices and interact with avatars of office workers physically present in the office, while office workers can interact with avatars of remote workers projected into the physical office space via AR devices.
Through a proof-of-concept experiment conducted on August 9, 2022, we confirmed that the system reduces the sense of loneliness among remote workers and enables nonverbal communication—including gestures—between both remote and on-site workers.
 

• Real-Time Interconnectivity Across Multiple Devices for VR and AR
• Creating a digital twin that aligns the virtual space (converted BIM data) with the physical space (the office)
• Integration of Virtual Spaces and Sensor Data (Real-Time User Location Data via API Integration)
• Using a multiplayer game engine to improve communication clarity
• High-precision hand tracking that reproduces even the slightest finger movements

Nikken Sekkei’s Digital Solutions Lab was responsible for the conceptualization and planning, as well as the provision of BIM and IoT data and the pilot testing, while HoloLab handled application development and technical support.

Going forward, we plan to enhance this application’s business-oriented features (such as content sharing and presentation tools) and nonverbal communication features, and provide customers with the opportunity to experience them.
Furthermore, we will apply these technologies to smart buildings and the metaverse, pursue further technological development, and use these efforts to enhance our ability to propose workplace solutions and expand our consulting business.
 

Nikken Sekkei is a professional services firm specializing in architectural and civil engineering design and supervision, urban design, and related research, planning, and consulting services. For 120 years since its founding in 1900, Nikken Sekkei has been committed to creating value through "social environment design," which aims to solve both explicit and implicit social issues, in order to meet the demands of society and the diverse needs of its clients. To date, it has been involved in various projects in Japan, China, ASEAN, and the Middle East, and in recent years has expanded into India and Europe.

Established on January 18, 2017; 60 employees. As an R&D-focused company, we conduct research and system development in collaboration with client companies across a wide range of industries—including architecture and construction, manufacturing, and technology, media, and telecommunications—by leveraging mixed reality technology and the acquisition and utilization of spatial information through various sensor devices, thereby promoting the on-site implementation of cutting-edge technologies.