Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-18 16:55:14 +02:00
Code Issues Packages Projects Releases Wiki Activity

Add logit_bias to the OpenAI api (#577)

Browse Source 
* Add logit_bias to the OpenAI api

* Cleanup and refactor, test in swagger.

---------

Co-authored-by: Concedo <39025047+LostRuins@users.noreply.github.com>
This commit is contained in:
DebuggingLife46
2023-12-26 21:56:19 +05:30
committed by GitHub
parent 5006b23099
commit e733a9e425
4 changed files with 70 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files
kcpp_docs.embd
+12 -2
View File
@@ -8,7 +8,7 @@
<!-- schema -->
<script>
let spec = {
let spec = {
"components": {
"schemas": {
"BasicError": {
@@ -176,7 +176,17 @@
"default": false,
"description": "KoboldCpp ONLY. If true, also removes detected stop_sequences from the output and truncates all text after them. Does not work with SSE streaming.",
"type": "boolean"
}
},
"logit_bias": {
"default": {},
"description": "KoboldCpp ONLY. An dictionary of key-value pairs, which indicate the token IDs (int) and logit bias (float) to apply for that token. Up to 16 value can be provided.",
"type": "object",
"example": {
"2": -20,
"145": -1.4,
"3105": 3.2
},
},
},
"required": [
"prompt"