开源项目精选 85GitHub
truespar/paddock· GPU 模型推理服务器
Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
⭐ 62 stars语言 Rust
📎 发布于 09-04 03:52🔗 阅读原文(github.com)