HuggingFace have released "Fineweb Edu" - a Common Crawl dataset that has been finely filtered - including with the help of Llama 3 70B.
Fineweb - A Finely Cleaned Common Crawl Dataset
Fineweb - A Finely Cleaned Common Crawl…
Fineweb - A Finely Cleaned Common Crawl Dataset
HuggingFace have released "Fineweb Edu" - a Common Crawl dataset that has been finely filtered - including with the help of Llama 3 70B.