Introduction

Here, we provide some of binaural audio signals that provide the listener with the sensation of being in the environment where the sounds were recorded. The audio files on this page are in the SOPA (Stream Of Panoramic Audio) format, which is a custom data format used for our project. Most of these contents were recorded by using a miniature head simulator system.

Although its size is comparable with that of a conventional stereo WAV file, a SOPA file contains not only an audio data stream but also spatial information, which can be used to generate binaural signals from the SOPA file.

Stereo headphones or earphones are necessary in order to listen to the binaural signals.

Recommended browsers

Panoramic audio with a still panoramic image

[Play and Stop]

To open the demo, click one of the thumbnails below.

Once the image is loaded and the instruction saying "Click to start" or "Tap to start" appears, you can start reproducing sound by clicking (tapping) on the image.

During the reproduction, pan and tilt change according to the motion of the mouse pointer.

If you are using the mobile device, pan and tilt can be controlled by the rotation of the device.

Reproduction of the sound can be stopped by clicking (tapping) on the image (a pause function is not yet available).


panther22k.sopa

caw_of_crows.sopa

forest.sopa

fantaisie.sopa
Fantaisie by Gabriel Faure

primavera.sopa
Spring mvt. 1 from The Four Seasons by Antonio Vivaldi

romance.sopa
Romance for Violin and Orchestra No.2 in F, Op.50 by Ludwig van Beethoven

cygne22k.sopa
Le cygne by Camille Saint-Saens

canon.sopa
Canon and Gigue in D, for 3 violins and continuo, T.337 by Johann Pachelbel

two_pianos.sopa
Sonata for Two Pianos in D Major K. 448, mvt. 3 by Wolfgang Amadeus Mozart

four_hands.sopa
Marche militaire in D major (No.1) by Franz Peter Schubert

Panoramic audio with a full spherical video

The SOPA technology can be combined with a panoramic video. By clicking one of the thumbnails below, you can start a simple demonstration of the panoramic video with panoramic sound.

Once the image is loaded and the instruction saying "Click to start" or "Tap to start" appears on the bottom of the image, you can start playing sound and video by clicking (tapping) on the image.

In some browsers, you have to tap the screen to load a video clip first. Then the page will say "Tap to start" and you can start reproducing panoramic sound by tapping the image.


monorail2.sopa

moka.sopa

tow.sopa

crickets_cages.sopa

crickets_plntr.sopa

lost_species.sopa

dinosaurs.sopa

roars.sopa

battle.sopa

tanks_chopper.sopa

battle_tank.sopa

croak.sopa

sidewalk.sopa

railway.sopa

musix1.sopa

triple.sopa

camptown.sopa

tweets.sopa

rtwo.sopa

Thanks to Three.js (http://threejs.org/) for JavaScript 3D library.
Some panoramic videos were captured by RICOH THETA m15 (https://theta360.com/en/).

Many thanks to... (Some of the links below may be out of date.)

http://www.3dxtras.com/
for free 3D models
http://archibaseplanet.com/
for free 3D models
http://www.classicalarchives.com/
for free MIDI clips

Please visit the Tokyo City University's "Scenes with panoramic sounds," too.

[Panning on demand]

The direction in which the listener is facing (left or right) can be changed by dragging the mouse pointer to the left or right.

For example, dragging the mouse pointer to the left corresponds to turning your head to the left. The image in the window scrolls to the right, and the angle from which the sound arrives changes.

If you are using the mobile device, pan and tilt can be controlled by rotation of the device instead of dragging the mouse.


Pan to the right

Pan to the left

Not only panning in the horizontal plane (yaw) but also tilt (pitch) can be manipulated.

As this sort of manipulation is not available in conventional stereo audio formats, SOPA expands the possibilities for audio and audiovisual expression.

[Panoramic beamformer]

By using spatial information contained in SOPA data, it is possible to create and control directionality during the sound reproduction. The listener can selectively pick up sounds from any desired direction and reject sounds from other directions just like recording sound with a cardioid microphone. This functionality can be called "Panoramic beamformer."

For further information and demonstration of the panoramic beamformer, see Panoramic beamformer.

Let's enjoy panoramic audio

On this site, you can not only listen to but also create your own panoramic sounds. If you are interested in creating panoramic sounds on your own, see Create and share panoramc sounds.


Copyright© 2020 AIST