Tag: training strategies
-
Hacker News: OpenCoder: Open Cookbook for Top-Tier Code Large Language Models
Source URL: https://opencoder-llm.github.io/ Source: Hacker News Title: OpenCoder: Open Cookbook for Top-Tier Code Large Language Models Feedly Summary: Comments AI Summary and Description: Yes Summary: OpenCoder represents a significant advancement in the field of code-focused language models (LLMs) by being a completely open-source project. It leverages a transparent data process and extensive training datasets that…
-
Simon Willison’s Weblog: Quoting Jason Wei (OpenAI)
Source URL: https://simonwillison.net/2024/Sep/12/jason-wei-openai/#atom-everything Source: Simon Willison’s Weblog Title: Quoting Jason Wei (OpenAI) Feedly Summary: o1-mini is the most surprising research result I’ve seen in the past year Obviously I cannot spill the secret, but a small model getting >60% on AIME math competition is so good that it’s hard to believe— Jason Wei (OpenAI) Tags:…