Introduction

Here, we provide some of binaural audio signals that provide the listener with the sensation of being in the environment where the sounds were recorded. The audio files on this page are in the SOPA (Stream Of Panoramic Audio) format, which is a custom data format used for our project. Most of these contents were recorded by using a miniature head simulator system.

Although its size is comparable with that of a conventional stereo WAV file, a SOPA file contains not only an audio data stream but also spatial information, which can be used to generate binaural signals from the SOPA file.

Stereo headphones or earphones are necessary in order to listen to the binaural signals.

Recommended browsers

Panoramic audio with a still panoramic image

[Play and Stop]

To open the demo, click one of the thumbnails below.

Once the image is loaded and the instruction saying "Click to start" or "Tap to start" appears, you can start reproducing sound by clicking (tapping) on the image.

During the reproduction, pan and tilt change according to the motion of the mouse pointer.

If you are using the mobile device, pan and tilt can be controlled by the rotation of the device.

Reproduction of the sound can be stopped by clicking (tapping) on the image (a pause function is not yet available).


mhs22k.sopa

stormy22k.sopa

forest.sopa

caw_of_crows.sopa

rhythm22k.sopa

panther22k.sopa

walkers.sopa

fantaisie.sopa
Fantaisie by Gabriel Faure

flute_sonata.sopa
Flute Sonata in B-flat major, Op. Anhang 4, mvt. 3 by Ludwig van Beethoven (dubious)

reverie.sopa
Reverie by Claude Debussy

ave_maria.sopa
Ellens dritter Gesang, Ellens Gesang III - Ave Maria - by Franz Peter Schubert

primavera.sopa
Spring mvt. 1 from The Four Seasons by Antonio Vivaldi

romance.sopa
Romance for Violin and Orchestra No.2 in F, Op.50 by Ludwig van Beethoven

cygne22k.sopa
Le cygne by Camille Saint-Saens

canon.sopa
Canon and Gigue in D, for 3 violins and continuo, T.337 by Johann Pachelbel

two_pianos.sopa
Sonata for Two Pianos in D Major K. 448, mvt. 3 by Wolfgang Amadeus Mozart

four_hands.sopa
Marche militaire in D major (No.1) by Franz Peter Schubert

Panoramic audio with a full spherical video

The SOPA technology can be combined with a panoramic video. By clicking one of the thumbnails below, you can start a simple demonstration of the panoramic video with panoramic sound.

Once the image is loaded and the instruction saying "Click to start" or "Tap to start" appears on the bottom of the image, you can start playing sound and video by clicking (tapping) on the image.

In some browsers, you have to tap the screen to load a video clip first. Then the page will say "Tap to start" and you can start reproducing panoramic sound by tapping the image.


Tanks_chopper.sopa

Croak.sopa

Battle_tank.sopa

Haunted_sniper.sopa

We_robots.sopa

Tanks.sopa

Pass.sopa

Railway.sopa

Cycle.sopa

Cretaceous.sopa

Windups1.sopa

Sidewalk.sopa

Battle.sopa

Musix1.sopa

Camptown.sopa

Alarms.sopa

Triple.sopa

Passenger.sopa

Panoramic sounds in a loop

In the examples below, sound and video are played back in a loop until terminated by the listener.


Monit.sopa

Tsukuba_west.sopa

Thanks to Three.js (http://threejs.org/) for JavaScript 3D library.
Some panoramic videos were captured by RICOH THETA m15 (https://theta360.com/en/).

Many thanks to...

http://www.3dxtras.com/
for free 3D models
http://archibaseplanet.com/
for free 3D models
http://www.freesfx.co.uk/
for free sound clips
http://www.otonomori.info/
for free sound clips
https://www.freesound.org/
for free sound clips
http://www.classicalarchives.com/
for free MIDI clips

Please visit the Tokyo City University's "Scenes with panoramic sounds," too.

[Panning on demand]

The direction in which the listener is facing (left or right) can be changed by dragging the mouse pointer to the left or right.

For example, dragging the mouse pointer to the left corresponds to turning your head to the left. The image in the window scrolls to the right, and the angle from which the sound arrives changes.

If you are using the mobile device, pan and tilt can be controlled by rotation of the device instead of dragging the mouse.


Pan to the right

Pan to the left

Not only panning in the horizontal plane (yaw) but also tilt (pitch) can be manipulated.

As this sort of manipulation is not available in conventional stereo audio formats, SOPA expands the possibilities for audio and audiovisual expression.

[Virtual cardioid microphone]

By using spatial information contained in SOPA data, it is possible to create and control directionality during the sound reproduction. The listener can selectively pick up sounds from any desired direction and reject sounds from other directions just like recording sound with a cardioid microphone. This functionality can be called "virtual cardioid microphone."

For further information and demonstration of the virtual cardioid microphone, see Virtual Cardioid Microphone.

Let's enjoy panoramic audio

On this site, you can not only listen to but also create your own panoramic sounds. If you are interested in creating panoramic sounds on your own, see Create and share panoramc sounds.


Copyright© 2017 AIST