Connecting atoms to bits.
Mechatronics Specialist | PES/PAV.
Li-ion, BMS & Rapid Prototyping.
Resilient AI systems.
Pinned Loading
-
hotpin-llm
hotpin-llm PublicHotPin: routing-guided expert pinning for lossless low-RAM MoE inference on consumer CPU+NVMe - 120B model at 3.84 tok/s in 19 GB RAM, no GPU
Python
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.