Cloud Security Alliance News Clipping Site

Tag: mixture-of-experts

Hacker News: Tencent drops a 389B MoE model(Open-source and free for commercial use))

Nov 5, 2024

—

by

system automation

in Uncategorized

Source URL: https://github.com/Tencent/Tencent-Hunyuan-Large Source: Hacker News Title: Tencent drops a 389B MoE model(Open-source and free for commercial use)) Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text introduces the Hunyuan-Large model, the largest open-source Transformer-based Mixture of Experts (MoE) model, developed by Tencent, which boasts 389 billion parameters, optimizing performance while managing resource…
Hacker News: ARIA: An Open Multimodal Native Mixture-of-Experts Model

Oct 11, 2024

—

by

system automation

in Uncategorized

Source URL: https://arxiv.org/abs/2410.05993 Source: Hacker News Title: ARIA: An Open Multimodal Native Mixture-of-Experts Model Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses the introduction of “Aria,” an open multimodal native mixture-of-experts AI model designed for various tasks including language understanding and coding. As an open-source project, it offers significant advantages for…