Tag: generative modeling
-
Simon Willison’s Weblog: Qwen: Extending the Context Length to 1M Tokens
Source URL: https://simonwillison.net/2024/Nov/18/qwen-turbo/#atom-everything Source: Simon Willison’s Weblog Title: Qwen: Extending the Context Length to 1M Tokens Feedly Summary: Qwen: Extending the Context Length to 1M Tokens The new Qwen2.5-Turbo boasts a million token context window (up from 128,000 for Qwen 2.5) and faster performance: Using sparse attention mechanisms, we successfully reduced the time to first…
-
Hacker News: Diffusion Is Spectral Autoregression
Source URL: https://sander.ai/2024/09/02/spectral-autoregression.html Source: Hacker News Title: Diffusion Is Spectral Autoregression Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses the similarities between diffusion models and autoregressive models in the context of generative modeling, particularly for visual data. It elaborates on the mathematical aspects and underlying principles that link these two paradigms,…