Tag: community-driven projects

Source URL: https://simonwillison.net/2024/Aug/27/distro/#atom-everything Source: Simon Willison’s Weblog Title: NousResearch/DisTrO Feedly Summary: NousResearch/DisTrO DisTrO stands for Distributed Training Over-The-Internet – it’s “a family of low latency distributed optimizers that reduce inter-GPU communication requirements by three to four orders of magnitude". This tweet from @NousResearch helps explain why this could be a big deal: DisTrO can increase…