Cloud Security Alliance News Clipping Site

Tag: ollama

  • Simon Willison’s Weblog: Quantization matters

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Nov/23/quantization-matters/#atom-everything Source: Simon Willison’s Weblog Title: Quantization matters Feedly Summary: Quantization matters What impact does quantization have on the performance of an LLM? been wondering about this for quite a while, now here are numbers from Paul Gauthier. He ran differently quantized versions of Qwen 2.5 32B Instruct through his Aider code editing…

  • Hacker News: Memos – An open source Rewinds / Recall

    —

    by

    system automation
    in

    Source URL: https://github.com/arkohut/memos Source: Hacker News Title: Memos – An open source Rewinds / Recall Feedly Summary: Comments AI Summary and Description: Yes Summary: The text describes “Memos,” a privacy-centric software tool designed for passive screen recording. Its primary focus is on user data control, ensuring all recording and processing occur locally, which aligns with…

  • Simon Willison’s Weblog: Ollama: Llama 3.2 Vision

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Nov/13/ollama-llama-vision/#atom-everything Source: Simon Willison’s Weblog Title: Ollama: Llama 3.2 Vision Feedly Summary: Ollama: Llama 3.2 Vision Ollama released version 0.4 last week with support for Meta’s first Llama vision model, Llama 3.2. If you have Ollama installed you can fetch the 11B model (7.9 GB) like this: ollama pull llama3.2-vision Or the larger…