Tag: model validation

  • Simon Willison’s Weblog: yet-another-applied-llm-benchmark

    Source URL: https://simonwillison.net/2024/Nov/6/yet-another-applied-llm-benchmark/#atom-everything Source: Simon Willison’s Weblog Title: yet-another-applied-llm-benchmark Feedly Summary: yet-another-applied-llm-benchmark Nicholas Carlini introduced this personal LLM benchmark suite back in February as a collection of over 100 automated tests he runs against new LLM models to evaluate their performance against the kinds of tasks he uses them for. There are two defining features…

  • Cloud Blog: Adapting model risk management for financial institutions in the generative AI era

    Source URL: https://cloud.google.com/blog/topics/financial-services/adapting-model-risk-management-in-the-gen-ai-era/ Source: Cloud Blog Title: Adapting model risk management for financial institutions in the generative AI era Feedly Summary: Generative AI (gen AI) promises to usher in an era of transformation for quality, accessibility, efficiency, and compliance in the financial services industry. As with any new technology, it also introduces new complexities and…