Having difficulty with social interaction due to a medical condition, IMO, doesn't make one an "asshole", any more than a cancer patient who lies in bed all day is "lazy".
It's the people who are aware of and excuse being an asshole by a self-diagnosed "oh I'm probably on the spectrum" statement I've issues with.
My experience of people (medically diagnosed) with Asperger's does not support that statement.