allenai/MADLAD-400
Updated
•
299k
•
155
text-pretrain-data
some pretrain dataset for LLM
-
-
CASIA-LM/ChineseWebText
Viewer • Updated • 1k • 2.79k • 44 -
allenai/dolma
Updated • 2.68k • 992 -
allenai/peS2o
Updated • 2.65k • 193 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 6.07k • 399 -
wenge-research/yayi2_pretrain_data
Viewer • Updated • 1.68M • 800 • 59 -
togethercomputer/RedPajama-Data-V2
Updated • 2.24k • 395 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 15.6k • 892 -
togethercomputer/RedPajama-Data-1T
Viewer • Updated • 1.73M • 1.98k • 1.14k -
Tele-AI/TeleChat-PTD
Updated • 612 • 174 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 10.5k • 328 -
GAIR/MathPile
Preview • Updated • 563 • 193 -
EleutherAI/proof-pile-2
Updated • 6.34k • 213 -
vietgpt/open-web-math
Viewer • Updated • 6.32M • 55 -
meta-math/MetaMathQA
Viewer • Updated • 395k • 15.4k • 444 -
bigcode/the-stack-dedup
Viewer • Updated • 237M • 20k • 383 -
bigcode/the-stack
Viewer • Updated • 546M • 24.4k • 958 -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 43 • 92 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 39.2k • 585 -
Locutusque/UltraTextbooks
Viewer • Updated • 5.52M • 1.55k • 198 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 17.5k • 672