Technology for Constructing Point Cloud Metaverse

Photo-realistic cyberspace

In recent years, XR-related technologies have evolved, including virtual reality (VR) and mixed reality (AR). In the recent Corona Disaster, online communication has also grown. Implementation of the "metaverse" is progressing, enabling rich and diverse experiences.

For regional development, there are efforts to utilize the "metaverse" for virtual tourism. However, due to the poor quality of spatial representation, this often fails to lead to the "expansion of the relevant population" over the long term.

We aim to create a highly immersive, photo-realistic metaverse that allows visitors to sense space with all five senses, not just sight. We measure the real world and integrate and process vast amounts of data. We make it possible to experience life on the ground in the metaverse realistically. Passion and love for the local community will emerge. So far, we have researched using multiple senses, including sight, hearing, and touch.

The "3D point cloud media processing" measures, integrates, and processes reality to reproduce even the atmosphere of the place.

The "3D acoustic space estimation and generation" dynamically synthesizes environmental sounds. This technology creates a spatial acoustic experience that makes the user feel like they are in the same place.

Haptic Transmission Technology" presents the sensation of vibration. This technology delivers a more realistic experience.

Figure 1 3D point cloud media processing

Figure 2 3D acoustic space estimation and generation

Figure 3: Tactile sensation transmission technology (Photo by Keizo Kioku, taken from ICC_HP, courtesy of NTT InterCommunication Center [ICC])

In the future, we would like to construct an "ultra-realistic metaverse" that seamlessly connects the real and virtual worlds. In this metaverse, we will incorporate avatars utilizing AnotherMe technology to improve "autonomy/identity" and "diversity. We aim to implement this metaverse in society at an early stage by verifying the business model of this metaverse.

Activity Introduction

TENGUN Ogijima Project

A project by NTT, NTT West, NPO Ogijima Lifestyle Institute, and Kenohi Co. We have also created a photo-realistic Ogijima meta-verse.

We will utilize the "low latency," "low power consumption," and "high capacity and high quality" networks that the IOWN concept will realize. In addition, we will utilize the 3D spatial media processing technology and AnotherMe technology we are researching. We will seamlessly connect the real world and cyber world experiences. We aim to expand the number of people involved by implementing a new metaverse. We aim to solve various problems faced by remote islands such as Ogijima.