Hugging Face crawls as many GitHub repositories as it can with the help of the Software Heritage Archive so as to create their Stack v2 LLM for code. And of course without consent of rights holders.
Opt-out is possible.
Oh, scrapes.
The datasets are stored in a git repository, so even when your opt-out request is “honored”, the “deleted” data remains in the repository history.
Hugging face open sourced a dataset every big AI company already has privately. We need to get mad about this because hugging face is the last target to take down, to finish the regulatory capture started at the behest of openAI and company.
Even if scrapping GitHub was made illegal, does anybody here really think the money would go to them and not Microsoft?
It’s data brokers and the copyright mafia vs open source and you guys are choosing to root for the former?
I checked and 52 of my repos are in this.
