Then why is it in their name on their MySpace? And in all reviews I've seen of the band, the ! has been there.
There was even a quote in a magazine where they said they had an exclamation mark in their name before Panic(formerly !) At The Disco did... so I'm inclined to disagree.