A relatively unexplored aspect in bipolar disorder (BD) is the ability to accurately judge other's nonverbal behavior. To explore this aspect of social cognition in this population is particularly meaningful, as it may have an influence in their social and interpersonal functioning. The aim of this research was to study interpersonal accuracy (IPA) in remitted BDs, that is, the specific skills that fall under the general term Theory of Mind (ToM). Study participants included 119 remitted individuals with BD (70 BD I and 49 BD II), and they were compared with a group of 39 persons diagnosed with unipolar depression (UD) and 119 control participants. The MiniPONS was used to test the whole spectrum of nonverbal cues as facial expressions, body language and voice. Results indicated a superiority of the control group with statistically significant differences both in the performance in the MiniPONS (number of right answers) and in each of the areas evaluated by this test. BD groups, in recognition of the meaning of gestures in face, body and voice intonation, performed significantly worse than controls. ANCOVA analysis controlling the effect of age shows that control group performed significantly better compared to clinical groups, and there were no differences between UD and BD groups. The results indicate a deficit in IPA and suggest that better comprehension of deficiencies in interpersonal accuracy in BD may help to develop new training programs to improve in these patients the understanding of others, which might have a positive impact in their psychosocial functionality, and thus lead to the objective of functional rehabilitation.