One of Canon’s many efforts. Learn more about the Noh volumetric video here or watch a Ted Talk about volumetric video technology.

Canon press release:

Canon and IBM Japan form joint business operation utilizing volumetric video technology to promote the visual and performing arts, release video for inaugural project: a performance of the Noh play Lady Aoi, directed by the Hoshokai.

TOKYO, July 2, 2021—Canon Inc. (Headquarters: Ohta-ku, Tokyo; CEO: Fujio Mitarai; heretofore: Canon) and IBM Japan Ltd. (Headquarters: Chuo-ku, Tokyo; CEO: Akio Yamaguchi; heretofore: IBM Japan) announced today that, starting in July, the two companies will form a business partnership based on the use of volumetric video technology to promote the visual and performing arts.

Volumetric video technology entails the use of digitalized 3D spatial data, which is rendered by computers to create a virtual space in which video can be generated from any angle. This technology has attracted significant interest in the sporting world and is becoming increasingly widespread in the entertainment industry. In addition, Canon has implemented this technology during an international rugby tournament in 2019 as well as other sporting events. In July 2020, the company established its Volumetric Video Studio – Kawasaki, to expand its range of activities in the entertainment industry.

In this joint project both companies have leveraged their combined technologies, products and networks to propose a volumetric video solution for the visual and performing arts community, with the aim of exploring new business opportunities and creating and growing new value for audiences. In particular, Canon contributes its volumetric video technology, which makes possible nearly simultaneous video capture and generation of high-resolution video. Through this technology, the company provides a new method for video content production and audiovisual experiences, in addition to passing on valuable cultural traditions.
Leveraging its know-how and experience in the field of art, IBM Japan provides consulting services that include business strategies and project execution support for companies involved in the arts in order to help the visual and performing arts achieve a digital transformation.

In addition, using its IBM Power System AC922 for accelerated computing and IBM Elastic Storage System broadband storage technology, the company can provide technological support through high-quality, high-speed and secure visual data processing and streaming technology, thus increasing the value of services using volumetric data.

The first project created through this corporate partnership is the release today of a performance of the Noh theatre work “Lady Aoi,” produced by Hoshokai and utilizing volumetric video technology. Directed by Kazufusa Hosho, Head of the Hosho Noh Style, the performance gracefully flows between scenes of the Noh stage and the spiritual world. For the creation of the video, Canon obtained 3DCG data of a real-life Noh stage, generated dynamic backgrounds and CG animations, and captured video of the Noh actors’ performance at the Volumetric Video Studio – Kawasaki. These resources were then smoothly integrated into the completed product, right there at the studio. IBM Japan provided high-speed infrastructure and technological support through its IBM Power Systems AC922 advanced dedicated parallel processing server and IBM Elastic Storage System broadband storage technology, enabling the use of essential responsiveness required for real-time video rendering.

Through this partnership, both Canon and IBM Japan will aim to create new value within the visual and performing arts world while expanding the potential use cases of volumetric video technology.