Report on the NTT R&D Forum 2020
Keynote speech 2
Into the IOWN
Breakthrough Innovation
Katsuhiko Kawazoe, PhD, Executive Vice President, Head of Research and Development Planning, NTT
In this paper, we would like to present "Into the IOWN (Innovative Optical and Wireless Network): Breakthrough Innovation." This article is based on a speech from Dr. Katsuhiko Kawazoe, Executive Vice President and Head of Research and Development Planning at NTT, during NTT R&D Forum 2020 Connect, which was held on November 17-20, 2020.
- Human beings are burdened by unknown risks
- Digitalization Creating Value
- Progress of the IOWN initiative
- New Challenges
- Conclusion
Human beings are burdened by unknown risks
The new coronavirus has reminded us that human beings are burdened by unknown risks. Even now in the 21st century, humankind is exposed to a variety of risks. The report(1), "12 risks that threaten human civilization" published in 2015 listed such risks as global pandemic, extreme weather, nuclear war, the international impact of political failure and the arrival of asteroids. This is the current number of near-earth asteroids that have been found to approach the Earth. On average, about 30 new asteroids continue to be discovered per week (Figure 1). There are asteroids that have not yet been discovered using the current observation technology. The asteroids shown in orange and red in this graph are dangerous asteroids 140 meters or greater in size that can destroy large cities. We need to further innovate our technology and accelerate the discovery of these dangerous asteroids.
What about the pandemic? Let's take a look from the perspective of a computer simulation. Supercomputers typically take years to simulate the characteristics and behavior of new viruses. It takes more than a year to take full-scale measures against new viruses. If you can simulate a new virus in a dramatically short period of time and anticipate who is more likely to be severely affected or what actions are more likely to lead to the spread of infection, you will be able to take more effective measures quickly. However, to accelerate this simulation, you must overcome the barriers of power consumption, density, latency, and thermal issues that are creating limits to performance of today's computers. I do not think the technology we have today is adequate to realize the bright future of humankind.
Digitalization Creating Value
So what should we do? In the past, the implementation of digital signal processing has been used to accelerate information and communication technology and increase its versatility and efficiency. That can make our lives and businesses more enriched and economical. I think it could be said that this approach has contributed to such aims. However, we recognized something during the pandemic. We are not facing a just one problem. Multiple issues are intertwined and there is not a single value to solve them. There are diverse range of values and they will not remain the same. I believe digitalization that creates the new value we need from time to time is really what will be needed in the future.
We introduced the approach of "Umwelt" (self-centered world) at last year's NTT R&D Forum. Umwelt is a concept proposed by German biologist Dr. Jakob von Uexküll, and is the theory that each organism has its own information recognition process and that the world is formed accordingly. The Copernican Revolution put forth by another German philosopher, Immanuel Kant, is the basis of Dr. von Uexküll's umwelt, asserting that rather than the idea of the world existing and people being aware of it, the world is a phenomenon formed by being perceived by people, meaning that we are all in a different umwelt. For example, while this world's flowers appear to be beautiful for humankind, it is also a world where bees place value on the nectar that they feed upon, and a world where mice have value as food for snakes (Figure 2). I hope you understand that a unique umwelt exists in each case.
Here are some examples of digitalization that have been able to create new value. Kabuki faces the problem of aging fans and young people not coming to watch. Here, we attempted to combine the two umwelten of young people and the old people who love kabuki. This involved a joint performance by the kabuki actor Shido Nakamura and the Vocaloid Hatsune Miku. Young people who have never been interested in kabuki were fascinated as they watched the kabuki and shouted out the cheers traditional to kabuki. The old-time kabuki fans also appreciated the new performance and pleasing experience made possible by Hatsune Miku and the latest technology. By combining the two umwelten, we were able to create new value, and I think this is the type of value-creating digitalization that we should aspire to.
In May of last year, we announced the Innovative Optical and Wireless Network (IOWN) concept to address risks unknown to humankind and promote digitalization generating new value. The concept involves introducing innovative optical technology to everything from the network to devices and information processing in order to solve thermal problems presenting a barrier to improving the performance of information processing platforms, and to achieve significant performance improvements in power consumption, transmission capacity, and latency. This is truly a breakthrough innovation.
Progress of the IOWN initiative
Next, we will discuss the specific progress of the IOWN initiative. We discussed three major elements in the IOWN concept last year. They are an All-Photonics Network, Digital Twin Computing and Cognitive Foundation. The origin of IOWN was the invention of optical transistors running at the world's smallest energy consumption of 1.6fJ/bit, which was announced in April 2019, and then the development of these optical devices has advanced even further. The world's first all-optical switch, combining ultra-fast speed with ultra-low power consumption, was unveiled in November. In March 2020, we achieved the invention of the world's first ultra-fast optical logic gate that could perform arbitrary logic operations using optical interference alone. These achievements greatly expanded the potential of optical technology (Figure 3). Based on the progress of these optical devices, we will introduce three common platforms that are built on IOWN: direct optical multi-point connectivity, extreme NaaS (Network as a Service) and data-centric computing. We would also like to introduce the various services created by these three common platforms (Figure 4).
Common Platforms
(1) Photonic Direct Communication
Photonic direct communication provides high-capacity optical paths through optical interfaces. Connecting end-to-end communication with optical paths enables high-capacity communication with low latency, high-precision time synchronization, multicasting to multiple points, and natural information communication enhanced with AI. It is possible to create dedicated networks by function for each wavelength of light (Figure 5). The network shape is a ring-shaped configuration of light that provides high reliability and rapid area deployment. In addition, a core had to be added each time a new demand arose in the past, but we will add a branch of light to meet demand and cover a large area with minimal optical fiber. It is possible to dynamically deliver high-capacity optical paths. This optical branch technology is achieved by a branch connection technology that polishes special optical fibers. This technology allows optical branches to be implemented without stopping the network.
(2) Extreme NaaS
Extreme NaaS provides a robust, flexible network service platform. IOWN's innovative optical technology and the Cognitive Foundation's multi-orchestrator physically and functionally merge the mobile and fixed networks. The benefits of both mobile and fixed networks can be enjoyed. This creates a new robust mobile-fixed integrated service that goes beyond the network differences. Users are able to stably use the service even when the environment changes without any awareness of which network they are using (Figure 6). We have been able to continue to connect with anticipatory prediction for the automated operation of tractors in Iwamizawa City, Hokkaido. Previously, handovers between different networks such as local 5G (5th generation mobile communication systems), 5G and BWA (Broadband Wireless Access) were not possible, but this platform allows tractors to remain connected as network switches.
The network systems were different in the past because the mobile network and fixed network provided different services. The reason was that the functional level and the performance level were different. However, from around 2000, network devices have been made more open, such as white box switches. The idea is to use general purpose chips instead of custom chips to separate hardware and software. This approach allows us to create versatile devices that can be used in a variety of applications and therefore be economically feasible. This approach has also been deployed in a 5G Radio Access Network (RAN), so-called virtualized RAN (vRAN). However, because of the use of these general purpose chips, the application was very limited because performance fell short when compared to dedicated devices that use custom chips. In contrast, the IOWN initiative aims to solve this challenge by using photoelectric convergence technology to improve the performance of general purpose chips (Figure 7). We want to create a system enabling the common use of both mobile and fixed networks in this way.
(3) Data-centric computing infrastructure
The data-centric computing infrastructure is an entirely new ICT platform that is based on data or information, and replaces the existing IP-centric computing. The left side is IP-centric and the right side is data-centric (Figure 8). At present, networks exchange information using IP packets and TCP/IP protocols regardless of differences in the information. However, essentially, each type of information has its own characteristics and uses, and therefore optimal transmission and processing method differ by the type of information. We propose a new computing architecture to deliver this data-centric platform.
Today's computer architecture connects multiple servers to a high-speed network for large-scale processing in an effort to increase computing capacity. However, packet queuing latency is a big problem. The proposed photonic-based disaggregated computing directly connects multiple memory banks and CPUs with optical I/O using optical data transmission. To enable this ultra-high-speed, high-capacity data transmission, we created a prototype silicon photonics chip for ultra-high-speed processing for the realization of 800Gbit/s photoelectric convergence devices. This new computing architecture solves the thermal problems and processing limits caused by conventional power consumption, and significantly improves system performance (Figure 9).
New Services
Next, I will introduce the various services offered using IOWN.
(1) Well-being
We are expecting the introduction of future-prediction services that will enrich the future for a happier life. The key points are visualization and simulation of your own future changes, indicators and other current physical conditions. However, simulation of individual human bodies has not yet been achieved anywhere. We want to capture vital signs with digital twin devices equipped with non-invasive blood and cardiac sensing technology to create a human digital twin, also known as a bio-digital twin. We will simulate and predict the future on the digital twin we have created, which will help us understand individual symptoms during diagnosis and treatment, select medications, prevent diseases, and even discover unknown things about ourselves. To create such a bio-digital twin, a digital twin device able to provide accurate physical information is required. One of these is the AI Tele-stethoscope currently undergoing research and development. This is an 18-channel wearable acoustic sensor that simultaneously collects physiological sounds from different parts of the body, allowing high quality, high fidelity sound to be transmitted to remote locations. We believe that this tele-stethoscope will continue to expand and develop its AI capabilities further. It will be possible to learn a combination of acquired sounds and various other information to estimate the shape and movement of the heart in a 3D model.
(2) Zero Environmental Impact
We launched NTT Space Environment and Energy Laboratories, a new research institute that is focused on creating innovative environmental energy technologies. The institute will contribute to the revitalization of the global environment and the realization of a sustainable and inclusive society from a space-based perspective. Specifically, we will work toward optimal operational control of artificial photosynthesis, lightning charging, and the optimal operation control of nuclear fusion reactors, with the aim of having zero environmental impact.
NTT has signed a comprehensive partnership agreement with the ITER International Fusion Energy Organization (ITER), a first for a private company. The project will leverage IOWN's ultra-fast, ultra-low latency network and digital twin computing to deliver a complex and precise control system for nuclear fusion reactors.
Together with this international project with ITER, we have also signed a partnership agreement with the National Institutes for Quantum and Radiological Science and Technology (QST), which is committed to achieving nuclear fusion in Japan. Together we will aim to create innovative energy technologies ahead of the rest of the world. I would like to present a message from Dr. Kenichi Kurihara, Director General of the Naka Fusion Institute at the National Institutes for Quantum and Radiological Science and Technology.
(Message from Kenichi Kurihara, Director General of QST)
NTT's IOWN technology is very advanced optical technology, and information processing is very important. We believe IOWN technology will play an important role in the fusion energy development project. We would like to promote cooperation with NTT in view of future implementation in power reactors. By combining research conducted in different fields by NTT and QST, we expect new technologies to be created for the first time in Japan and to contribute significantly to the realization of humankind's dream of fusion energy.
(3) Lightning Charging Technology
If extreme weather causes more lightning, the damage to people and equipment could be severe. We aim to use IOWN's digital twin computing for weather observation technology to accurately predict where lightning strikes will occur. In addition, we are promoting research to capture this lightning energy, and in 2022 we will start a lightning-induced charging experiment in a natural environment.
(4) 4D digital platform®
The 4D digital platform® builds a digital twin in cyberspace in real-time by using a highly accurate advanced geographical spatial database as the positional starting point, mapping various real world sensor data highly precise in terms of location and time, , and also by collecting and integrating data at high speeds. The digital twin is built by precise and real-time integration of 4D (four-dimensional) information -- latitude, longitude, altitude, and time -- to provide a variety of future predictions and real-world feedback.
Using the 4D digital platform® and related technologies, we provide value in areas such as streamlining traffic, leveraging city assets and co-maintaining social infrastructure. In addition, we aim to contribute to new sensing systems based on environmental monitoring using optical technology (optical fibers), and to the understanding of the earth to benefit the environment and disaster prevention by using optical lattice clocks network technology.
The 4D digital platform® requires accurate object recognition technology that is highly precise and available at even lower cost. Here, we applied the concept of umwelt, which was discussed at the beginning. The human uses visual information to recognize objects. However, a bat, for example, sends out ultrasonic waves and transmits them to recognize objects using the reflected wave. In the past, in order to accurately ascertain the location of communications equipment such as electric poles, the NTT Group used sensors, called lidar, employing lasers to determine the position. Although they were highly accurate, they were very expensive. This time, the visual information combined with a simple, inexpensive lidar was able to get a very good result when it was tested to demonstrate better object recognition performance than a high-performance lidar. That is, the combination of the two umwelten created new value through a composite umwelt (Figure 10).
We also want to use this IOWN innovation to contribute to shipping. NTT has signed a joint research agreement with MTI Co., Ltd. to conduct the world's first unmanned vessel field trial. We also received a message from Mr. Kazuo Ishizuka, President of MTI.
(Message from Mr. Kazuo Ishizuka, President of MTI)
The biggest challenge for the Nippon Yusen Group is to achieve ESG management with customers. In the future, we will work with our industry partners to develop technologies that aim to achieve zero-emission ships and autonomous vessel operations. The common thing here is that logistics and ships will become more and more systemized. High-capacity, high-speed communication and high-precision location measurement, including the oceangoing systems IOWN aims to provide, are critical technologies for us.
(5) Remote World
In society after the coronavirus, we need to ensure social distancing and to stimulate economic activities at the same time. This can be achieved through Remote World.
NTT has recently launched a new service brand called Remote World, and has started a range of services to provide spaces that surpass meeting face-to-face. In R&D, we have been working on research and development of the immersive telepresence technology called "Kirari!" that provides technology enabling people to share the excitement of being at a sporting venue as though the event were taking place in front of them. A variety of sporting events have been held without spectators during the coronavirus pandemic. We believe that our technology needs to evolve further to match this. For athletes, timely cheering during a game provides a source of energy and power that emboldens their spirit. And for the spectators who are cheering, the real pleasure of watching sport is the sense of togetherness formed with the players and audience through such passionate support. In order to achieve a sense of togetherness by inspire players through enthusiastic support, the most important thing is to send that support in a timely manner. The same applies to remote viewing. I think it is very important to realize how to reduce the latency and synchronize emotions between the stadium and the remote spectators, and also among spectators. Photonic direct communication technology connects all venues in real-time, allowing the audience to encourage players even remotely, creating a sense of togetherness among spectators. Furthermore, we believe that by attaching sensors to detect the amount of heat at each venue, depending on the intensity of the support, we can use a design that controls the brightness of the lighting to create a more connected experience. We are also beginning to research and develop emotional perceptual control technologies that capture the emotional changes of people watching remotely and interact with spectators to create a sense of togetherness and interactivity. In this research and development, we are also conducting joint research with Sony Corporation, which has strengths in device technology and interaction technology.
When watching sporting events in the post coronavirus era, or the era of the remote world, the use of ultra-low latency technology to connect remote venues will enable people to experience watching events as if they were in the same stadium.
IOWN Global Forum
Founded in January 2020 by NTT, Intel and Sony, the IOWN Global Forum includes a constantly increasing number of leading global companies, such as Microsoft, Dell, Ericsson, and NVIDIA, who have endorsed the innovations IOWN aims to bring to life. As its roadmap, the IOWN Global Forum agreed to issue core technical documents in 2021, establish specifications in 2024, and plan to start IOWN-compliant services by forum members in 2030. NTT would like to announce the specific content of the new computing architecture using optical technology introduced in 2021 without waiting for the year 2030. We will work with a variety of global partners to advance this innovation.
New Challenges
Next, let's look at the new challenges that will further expand R&D areas.
Globalization of R&D
We established NTT Research, Inc. in April 2019 as an overseas base for further expanding and enhancing basic research, and three laboratories have begun their activities since July, already producing significant results. For example, our cryptography research laboratory had 12 papers accepted, which account for 15% of all papers, by Crypto, the world's leading conference in the world of encryption, while it is said that if you have one or two papers accepted a year, you are already a top class researcher. That is what we have already accomplished. As another global R&D mission, we initiated an effort to establish dementia care as a research theme, with that being a social issue shared by Japan and Australia. This research strives to identify the real needs of the patient. This study brings together researchers in a variety of disciplines, such as brain science and human interfaces, to help patients enjoy living and to regain happiness. The resulting discussions then span across both countries. The Australian government has also appreciated this effort. I would like to present messages received from Mr. Simon Birmingham, Australian Minister for Trade, Tourism and Investment, and Mr. Dan Tehan, Minister for Education.
(Minister Simon Birmingham)
The partnership agreement that NTT has agreed upon with Deakin University and Western Sydney University is also the first such case for Australia. This cooperative relationship aims to solve common issues between our two countries. We aim for sustainable agriculture, food security, comfortable cities, renewable energy sources and expansion of digital infrastructure. The first project already in progress is the development of technology that improves the quality of life for people living with dementia.
(Minister Dan Tehan)
The Australian government is committed to working with universities and industries in the country to create jobs and improve productivity. The creation of translational research capabilities, led by industry and focused on social and economic outcomes, is a significant benefit to Australia. We will be able to build the future with knowledge shared in the forum.
Security
Security technologies have long played a game of cat and mouse with attackers. In the era of IOWN, where everything is connected by optics, we believe a new paradigm will emerge, not just the quantum key distribution currently gaining attention. For example, the optical lattice clock enables 10-18 precision measurement of latency, latency with the communication partner, and the altitude in centimeters, which can be used to achieve authentication from a completely new perspective. The subject of Secure Optical Transport is a challenge of new security technologies that use the characteristics of light (Figure 11).
Space
The NTT Group is in the second-stage of its commitment to space. In November 2019, NTT agreed to jointly conduct research with the Japan Aerospace Exploration Agency (JAXA).
We aim to achieve an ultra-high-speed, high-capacity, secure optical radio communications infrastructure that seamlessly links space and ground. In this joint study, we will start by conducting orbital trials of the innovative satellite IoT platform. Multiple Input Multiple Output (MIMO) technology will be applied to satellites for the first time in the world to solve capacity problems that have become a bottleneck in satellite communications. We aim to achieve an overwhelming increase in capacity, and also create a low-cost Internet of Things (IoT) platform at all locations around the world, including undeveloped regions without ground-level communication networks. The technology is already set for installation on a communications satellite scheduled for launch in FY 2022.
I would like to introduce you to a message from Dr. Masatoshi Harigae, Director General of the Aeronautical Technology Directorate at JAXA.
(Message from Director General Masatoshi Harigae)
In August 2019, JAXA and NTT entered into a cooperation agreement to realize secure optical wireless communication infrastructure with ultra-high speed and high capacity that seamlessly connects ground and space. Under this agreement, we are conducting joint research to make use of space as a new information platform beyond the Internet for the IOWN initiative.
In addition, with this challenge in space, we will announce our large vision called the "IOWN Space Computing Initiative."
The computing power provided with ultra-low power consumption achieved by IOWN's photoelectric convergence technology has a potential unimagined using previous technologies. We believe we can create a space data center that can process and analyze data on satellites. We are looking at a whole new computing platform where space energy alone can process and analyze a wide range of observation data across multiple satellites. We believe that IOWN's innovations will be a new ultra-stable permanent ICT infrastructure that is completely independent of the ground's ICT infrastructure, is not affected by adverse weather, places no burden on the earth, and is completely implemented in space, including with regard to energy (Figure 12).
Conclusion
Humankind has been innovating in a variety of ways. Today's technology is built upon the achievements of the past. We need to act with a long-term perspective rather than short-term. We need to measure happiness as an integral value over time rather than an instantaneous one, and lead humankind to the best future through innovation. To do this, we need to understand the infinite possibilities that technology can bring. This great challenge cannot be tackled with our knowledge alone. We want to be able to take a serious look at this problem with people in all areas and explore a better future together.
This time we introduced the specific progress and new challenges of the IOWN initiative. The NTT Group will contribute to all people through breakthrough innovation to ensure the continued happiness of humankind in the face of unknown risks.
Reference
(1) Global Challenges Foundation: "12 Risks that threaten human civilization: The case for a new risk category," 2015.