-
gini
- Hong Kong
-
10:58
(UTC +08:00) - https://verifiedmetrics.com/
- @onetom
Stars
LLM
1 repository
A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.