This blog is a way for me to collect interesting stuff into one place. I'm not planning on making this a confession booth of any sort, just post random interesting web sites if I feel the need to comment on them (otherwise I just add them to my page) and comment on other stuff that is worth it (books, TV programs, games, CD's etc).

Knowing myself I doubt I will be updating this too often but we'll see...

3D sounds

Rest of the WebPosted by Marko Poutiainen Tuesday, May 01 2007 16:49:33

The Virtual Barbershop is quite an interesting experiment on how we perceive sound. David Heron has managed to create a real-sounding environment for headphones. I'm just left wondering why this couldn't be used more. Games tend to have poor 3D sounds if you don't have multiple speakers, especially feeling of distance seems hard to create. Yet many game types would benefit immensly from better sounds. First person shooters come to mind first. Just listening to that demonstration is enough to make you wonder what could be achieved. I can't think of many games that have anything resembling a believable sound environment. It feels like that part of gaming is lagging ten years behind the rest.

Processing power might of course be a stumbling block. The games should consider echoes and obstacles, for instance. My main gripe in Deus Ex - my all-time favourite game - is how you can hear sounds coming from behind walls just like if the wall wasn't there. You can hear footsteps through ten feet of concrete which is completely ridiculous.

Game developers are heading down the road of physics and improving the graphics more and more. Both are nice things, but trying to create a realistic experience requires a realistic sound system. As a matter of fact, it should be quite high in the priorities list because one would think it's much easier to create a good 3D sound environment than to create 3D images on a flat screen.

Of course the demonstration is much easier to make since the head doesn't move and the sounds have been made static - you can't do anything to change how the sounds play. Just the ability to be able to shake your virtual head would make the demonstration a lot harder to pull off. But surely it must be possible, maybe by trying to simulate a human's hearing, i.e. calculating the sounds created in the environment twice with that small difference in location. Echoes etc are a different things altogether, though but maybe a similar system to how lightning is calculated could be used. It could be a lot simpler.

I thinking of splitting the sound spectrum into parts. Say 20-80Hz, 80-200Hz etc depending on what a meaningful split is. Then you would have to define how much each part dampens when it hits each material in the gaming world. This is something similar to how lightning is calculated already. The general rule is, of course, that the higher the sound, the more it dampens, but if this was based on material, the sounds would sound very different in a jungle than in inside a subway station.

But I'm no expert on this so I can't possibly calculate how much processing power even a simple system would require. It could be an interesting experiment in itself, though.

  • Comments(2)

Fill in only if you are not real

The following XHTML tags are allowed: <b>, <br/>, <em>, <i>, <strong>, <u>. CSS styles and Javascript are not permitted.
Posted by Makis Wednesday, May 09 2007 16:13:02

Oops! It looks like the entire website that had the experiment has disappeared and all the links I find to it googling are broken as well.

I think one problem is that most people use cheap plastic speakers and they have been placed wrong so even if a game did have great sounds they would be wasted. I think this will slowly improve but for most games I would think headphones would be the best choice. 5 speaker systems are not really an option for most gamers.

But things might change once game graphics reach a point where improvements have a rapidly diminishing return. At that point developers mus concentrate on more than just upping the resolution and adding more nifty graphical gimmicks. Perhaps we then will see radical improvements in other areas such as sound?

Posted by djpmom Sunday, May 06 2007 03:03:44

Very interesting (despite the broken link :-). Sounds in games are certainly part of the whole atmosphere, and the more realistic the better...I was always fairly happy just to hear footsteps and a few birdcalls, but now you've got me thinking about it . Gamers seem to be primarily visual-centric, however- witness the push for and popular reaction to more-and-better-graphics - I wonder if sound will ever get much attention?