NVIDIA has incorporated NeMo Guardrails into its existing NeMo framework for building generative AI models, which business customers can gain access to through the company’s AI Enterprise software platform. NVIDIA has made the product open-source to contribute to the developer community’s efforts towards AI safety.
The introduction of NeMo Guardrails comes after some of the most high-profile generative AI models have come under scrutiny for their tendency to “hallucinate” information. This is where the AI generates false or incorrect information. Google’s chatbot, for example, made a factual error during its first public demo.
