Tag: token streams

Source URL: https://simonwillison.net/2024/Sep/14/andrej-karpathy/#atom-everything Source: Simon Willison’s Weblog Title: Quoting Andrej Karpathy Feedly Summary: It’s a bit sad and confusing that LLMs (“Large Language Models") have little to do with language; It’s just historical. They are highly general purpose technology for statistical modeling of token streams. A better name would be Autoregressive Transformers or something. They…