Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-09 22:39:13 +02:00
Code Issues Packages Projects Releases Wiki Activity

add runpod to readme

Browse Source
This commit is contained in:
Concedo
2024-06-28 14:47:11 +08:00
parent 176923f58b
commit 3e6a9673ef
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3
View File
@@ -29,6 +29,9 @@ For more information, be sure to run the program with the `--help` flag, or [che
- KoboldCpp now has an **official Colab GPU Notebook**! This is an easy way to get started without installing anything in a minute or two. [Try it here!](https://colab.research.google.com/github/LostRuins/koboldcpp/blob/concedo/colab.ipynb).
- Note that KoboldCpp is not responsible for your usage of this Colab Notebook, you should ensure that your own usage complies with Google Colab's terms of use.
## Run on RunPod
- KoboldCpp can now be used on RunPod cloud GPUs! This is an easy way to get started without installing anything in a minute or two, and is very scalable, capable of running 70B+ models at afforable cost. [Try our RunPod image here!](https://koboldai.org/runpodcpp).
## OSX and Linux
### Linux Usage (Precompiled Binary, Recommended)