“Looking into SHAP (SHapley Additive exPlanations) explanations of the predictions gives some insights about ChatGPT writing style,” the researchers conclude. “It is extremely polite, aiming to please different types of requests from various domains fairly well mimicking humans, but that still does not have the profoundness of human language (e.g. irony, metaphors,…).”
Although the machine learning model proved effective in differentiating between AI and human writing, it’s important to note that OpenAI’s language models will only continue to advance in sophistication. ChatGPT is presently running on GPT-3.5, although GPT-4 is already under development. The capacity of these language models to resemble human writing will definitely increase as they develop and evolve.
