Google voice looks like it got a pretty major upgrade.

Which is good as someone mentioned that it downloaded 40 ogg files when they first used it.

I am still leaving the sound muted to start with, but hopefully this is no longer an issue.