Deaf

A deafened spellcaster incurs a 20% chance to fail any spell he or she casts that has a verbal component. This affects both types of spellcasters.

Deafened people also usually cannot be affected by a Bard's songs, or even certain spells which require you to hear its effects.

Being deaf (probably! - please research) also means you automatically fail any listen checks.