Nvidia wants to limit AI with more guard rails for applications like ChatGPT
A new Github project page from Nvidia has been published, possibly giving some major insight into how the company wants to control AI in the future.
The explosion of AI applications is unprecedented.ChatGPT,Google Bard, andBingare paving the way for language-based models to grow intowhole new otherworldly things, as well as assisting withday-to-day research.
However, as it has been pointed out multiple times, ChatGPT and the roster of AI chatbotsaren’t perfect. There are a lot of chances for misinformation, as well as manipulating the AI into giving you answers it really shouldn’t.
A new development fromNvidia, however, aims to reign in those using AI at a software level. The new “guardrails” system, or NeMo, is an open-source frameworkavailable from GitHub. It’s intended to allow developers to add safeguards to prevent conversations from steering off course.
In the description, Nvidia is attempting to allow developers to regain some control over thewily AI. It’s built with Python, and easily installed through the “pip” terminal command.
Nvidia project aims to curb malicious AI interaction
The project is split into different aspects that the guardrails can do. This includes “Topical Rails”, which should prevent the bot from going “off-topic”. In the example given, the core workings of the AI within the terminal are shown, including the process it takes to ensure a correct answer is given.
There’s also a jailbreak detection layer, that Nvidia says will force the AI to double-check if it is being takenadvantage of.
It also has dubbed misinformation as “hallucinations” in a strange turn of phrase. However, the NeMo system is designed to prevent this from happening and keep the bot in check throughout the interaction.
ChatGPT users mourn the loss of their AI boyfriends due to GPT-5 update
First Descendant devs respond amid accusations of using fake AI streamers in ads
New app lets you play & create AI generated games in a TikTok-like feed
Nvidia has decided to make this AI guardrails system open-source in an attempt to get the community surrounding artificial intelligence to contribute to it. This should stay the hand of those looking tocreate nefarious usagefrom the blunders that occur when using these bots.
It should also be noted that Nvidia and OpenAI, the developers behind ChatGPT, intend to use more than30,000 GPUs to power the bot.
