One of the difficulties surrounding Aspergers Syndrome is expressing body language and non-verbal cues. It's often a symptom of Aspergers.
Body language involves hand gestures, overall carrying of one's person, but also facial expressions. Even eye contact is governed by body language. Not having the tools needed to properly read or convey the right kind of body language and response makes simple conversations challenging.
Body language becomes a point of conflict for those who cannot really understand it. This leads to insecurity in social situations. Eventually, it may cause a person with Aspergers Syndrome to isolate from social setting, simply because of the fear that they may be seen inept.