I'd be interested to see the evidence of harm caused by them.
I'm a staunch believer in anything that will help a search engine get a full appreciation of my sites. I have no evidence of it particularly helping though
That said, I've moved my blog onto it's own domain and I've undergone none of the pain I expected. Could it be that sitemaps helped?