Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-20 01:31:42 +02:00
Code Issues Packages Projects Releases Wiki Activity

added link for novita AI, added legacy warning for old GGML models

Browse Source
This commit is contained in:
Concedo
2024-09-09 11:19:32 +08:00
parent c78690737c
commit 27bbdf7d2a
2 changed files with 20 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3
View File
@@ -34,6 +34,9 @@ After running this command you can launch Koboldcpp from the current directory u
## Run on RunPod
- KoboldCpp can now be used on RunPod cloud GPUs! This is an easy way to get started without installing anything in a minute or two, and is very scalable, capable of running 70B+ models at afforable cost. [Try our RunPod image here!](https://koboldai.org/runpodcpp).
## Run on Novita AI
KoboldCpp can now also be run on Novita AI, a newer alternative GPU cloud provider which has a quick launch KoboldCpp template for as well. [Check it out here!](https://koboldai.org/novitacpp)
## Docker
- The official docker can be found at https://hub.docker.com/r/koboldai/koboldcpp
- If you're building your own docker, remember to set CUDA_DOCKER_ARCH or enable LLAMA_PORTABLE