Tag: special-tokens

Source URL: https://simonwillison.net/2024/Aug/20/sql-injection-like-attack-on-llms-with-special-tokens/#atom-everything Source: Simon Willison’s Weblog Title: SQL injection-like attack on LLMs with special tokens Feedly Summary: SQL injection-like attack on LLMs with special tokens Andrej Karpathy explains something that’s been confusing me for the best part of a year: The decision by LLM tokenizers to parse special tokens in the input string (,…