LeMaterial: an open source initiative to accelerate materials discovery and research
•
19
Thomas Wolf PRO
thomwolf
AI & ML interests
NLP and open-source :-)
Recent Activity
upvoted
a
collection
2 days ago
🥂 FineWeb2
liked
a Space
3 days ago
data-is-better-together/fineweb-c
liked
a Space
3 days ago
Vchitect/VBench_Leaderboard
Articles
Organizations
Posts
12
Post
4046
We are proud to announce
HuggingFaceFW/fineweb-2: A sparkling update to
HuggingFaceFW/fineweb with 1000s of 🗣️languages.
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
Post
760
Exponentially growing number of open-source AI models over the course of the past 30 months – from a few thousands to over 1 million and more
Interactive data viz: huggingface/open-source-ai-year-in-review-2024
Interactive data viz: huggingface/open-source-ai-year-in-review-2024
spaces
10
models
6
datasets
21
thomwolf/my-distiset-88a662c1
Viewer
•
Updated
•
10
•
9
thomwolf/my-distiset-340ae369
Viewer
•
Updated
•
10
•
18
thomwolf/distilabel-example-test
Viewer
•
Updated
•
10
•
39
thomwolf/distilabel-example
Viewer
•
Updated
•
10
•
45
thomwolf/blue_sort
Updated
•
120
thomwolf/data_test
Updated
•
74
thomwolf/cameras_conditions
Viewer
•
Updated
•
214
•
42
thomwolf/lerobot-sort2
Preview
•
Updated
•
90
•
1
thomwolf/lerobot-sort3
Preview
•
Updated
•
106
thomwolf/act-raw-sort3
Updated
•
213