Tag: inference cloud

Source URL: https://www.theregister.com/2024/09/10/sambanovas_inference_cloud/ Source: The Register Title: SambaNova makes Llama gallop in inference cloud debut Feedly Summary: AI infra startup serves up Llama 3.1 405B at 100+ tokens per second Not to be outdone by rival AI systems upstarts, SambaNova has launched inference cloud of its own that it says is ready to serve up…