Description
A high-throughput and memory-efficient inference and serving engine for LLMs
Installation Instructions
Instructions not filled in by author. Author knows what to do. Everybody else should avoid this repo.
Active Releases
The following unofficial repositories are provided as-is by owner of this project. Contact the owner directly for bugs or issues (IE: not bugzilla).
| Release | Architectures | Repo Download |
|---|---|---|
Fedora 42
|
aarch64 (0)*, i386 (0)*, ppc64le (0)*, s390x (0)*, x86_64 (0)* | Fedora 42 (6 downloads) |
|
Fedora 43
|
aarch64 (0)*, ppc64le (0)*, s390x (0)*, x86_64 (3)* | Fedora 43 (6 downloads) |
* Total number of downloaded packages.
Quick Enable
#> dnf copr enable bytehackr/vLLM
More info about enabling Copr repositories