The report’s Chapter 3, Technical AI Ethics, delves deeper into bias and toxicity in AI, which are difficult to quantify. According to the report, unfiltered models are much easier to lead into problematic territory, and instruction tuning can help to alleviate this problem. Making models more fair or unbiased in one way, however, may have unanticipated consequences in other metrics.
