The Smol Training Playbook
📚
2.75k
The secrets to building world-class LLMs
Eric FU
aHaric
·
AI & ML interests
None yet
Recent Activity
liked
a Space
about 2 months ago
HuggingFaceTB/smol-training-playbook
liked
a Space
about 2 months ago
lerobot/robot-learning-tutorial
commented on
an
article
11 months ago
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
Organizations
None yet
liked
2
Spaces
about 2 months ago
commented on
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
11 months ago
Hello, the KV cache memory requirements in FP16 of 405B, 0.984 GB 15.38 GB 123.05 GB, these three values look like from FP32, could you double-check it? And how to get the KV cache memory when I get a new LLM?