One thing to bring up is that the mic is really situated on the left earbud, not on the music control bar, so you ought to be wearing the left ear during conversations, or you ought to converse with the left earbud rather than to the music control bar where the mic is generally situated for other headsets.
Audio quality