͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

Forwarded this email? Subscribe here for more

Introducing Paris

World's First Decentralized Trained Open-Weight Diffusion Model

Gin Jiang, Raihan Seraj, Marcos Villagra, and Bidhan Roy

Oct 7

READ IN APP

Welcome to Everything Bagel

Don’t recognize this sender? Unsubscribe with one click

Bagel recently imported your email address from another platform to Substack. You'll now receive their posts via email or the Substack app. To set up your profile and discover more on Substack, click here.

We’re releasing Paris - the world’s first decentralized trained open-weight diffusion model. The model is open for research and commercial use under the MIT license.

We named it Paris after the city that has always been a refuge for those creating without permission. Two remarkable facts that makes Paris first of it’s kind,

It’s a combination of smaller expert diffusion models pre-trained from scratch across different continents in complete isolation. The experts required zero gradient, parameter, or intermediate activation synchronization among each other during training.
This zero communication protocol achieves comparable quality to SOTA distributed approaches using 14× less data and 16× less compute.

How? Full technical report and model weights below.

Full Technical Report : https://github.com/bageldotcom/paris/blob/main/paper.pdf
Model Weights : https://huggingface.co/bageldotcom/paris

We believe we can scale this approach to global state-of-the-art results. But that requires solving some more really, really hard problems. If you’re an ML researcher or engineer interested in helping us achieve this while doing the best open-source work of your career, come work with us: jobs.bagel.com.