The company recruited 50 specialists from a variety of sectors, including cybersecurity, trust and safety, and international security, to test the model in an adversarial manner and aid in the further eradication of its habit of lying. As a result, OpenAI continues to strongly advise that “great care should be taken when using language model outputs, particularly in high-stakes contexts,” with the exact protocol (such as human review, grounding with additional context, or avoiding high-stakes uses altogether) matching the needs of a specific use-case. However, 40% less is not the same as “solved,” and the system continues to insist that Elvis’ dad was an actor.
