Meaning of prompt injection | Babel Free

Definitions

A method of causing an artificial intelligence to ignore its initial instructions (often ethical restrictions) by giving it a certain prompt.

countable, uncountable

Examples

“Retomeli.io is a jobs board for remote workers, and the website runs a Twitter bot that spammed people who tweeted about remote working. The Twitter bot is explicitly labelled as being "OpenAI-driven", and within days of Goodside's proof-of-concept being published, thousands of users were throwing prompt injection attacks at the bot.”

“Yesterday, OpenAI announced an API for ChatGPT and posted an underlying format for the bot on GitHub, alluding to the issue of prompt injections.”

“One category is what's known as a "prompt injection attack," in which users trick the software into revealing its hidden data or instructions.”

“Large language models (LLMs), a trendy way of building artificial intelligence, have an inherent security problem: they cannot separate code from data. As a result, they are at risk of a type of attack called a prompt injection, in which they are tricked into following commands they should not.”

CEFR level