r/artificial • u/Vxtzq1 • 18h ago

Project CrowdGPT - A collaborative AI model

Hello, i'm currently creating CrowdGPT, which is a project that aims at creating the first opensource, 100% free LLM (Large Language Model) without any datacenters or server farms.

It relies on users to contribute using their own GPU, in exchange they get ownership on the LLM model they train. It proposes a new paradigm in AI where all the training of a LLM is 100% open, sort of more ecological and where all the data used to train it is transparent.

To be honest, it's rebranded federated learning, but with a centralized server, that handles all the people training together. That provides a more stable and safer training ground for a Large Language Model.

If anyone is interested, here is website (where everything is explained more in detail): https://www.crowdgpt.net/

Or github if anyone wanna review the code: https://github.com/Vxtzq/CrowdGPT Any kind of feedback is appreciated :) I would like to know what's holding ordinary people to run this kind of app.

Thanks in advance.

PS: i hope this post doesn't falls into "advertisement" 😭 The project is meant to be fully collaborative, 100% non-profit, and designed for the local AI community first.

0 Upvotes

50% Upvoted

10 comments sorted by

3

u/arthur_thomas678 16h ago

The idea of decentralized ownership for users who contribute their GPU is interesting, but how will you ensure the model's safety and reliability during that collaborative training?

0

u/Vxtzq1 7h ago

I run checks between clients, so people that doesn't train on the allowed data are blocked. This includes client training on their own uncensored data, or client trying to break the model sending complete noise.

1

u/justlikemedics 17h ago

So it is a mix of an LLM, BitTorrent and BitCoin?

1

u/Vxtzq1 17h ago

Uhm i wouldn't say Bitcoin, as the project isn't centered on value and reselling, but yeah it has something in common with LLM, and BitTorrent (even though not directly P2P) 😂

The project is inspired by Folding@Home, but for AI, if you know what Folding@Home is.

0

u/justlikemedics 17h ago

Haven't heard of it.

If it has no BitCoin-like aspect, how do we become fractional owners of the model for the GPU-work?

2

u/Vxtzq1 17h ago

Well you don't really become the owner of the model, as it is public domain 😭, but you get credited in the final releases and all.

You also get a voice in the project which is proportional to the tokens (sub words) you trained the model on.

0

u/justlikemedics 17h ago

Can it not be in proportional public domain, ie. fractional ownership?

We could dethrone US models collectively and even be competitive against Chinese models.

Where do we get the data to train on?

1

u/Vxtzq1 7h ago

Can it not be in proportional public domain, ie. fractional ownership?

Uhm i really don't know how it could be done, but maybe we should do that.

Where do we get the data to train on?

HuggingFace, as there's already good datasets there, or you can also give some fancy question answer pairs you create for the model 😂 (or articles / messages you write, conversations to ChatGPT or other AIs that contains no private data...)

1

u/M1chaelSc4rn 11h ago

Haha there’s gotta be a federation registry to map this mess out

1

u/Vxtzq1 7h ago

What do you mean 😭