# KoboldAI Lite

Connecting

Loading...

Enter Sends
Allow Editing
[ABORT]
The AI is typing...

Quick Start - Select A Scenario
Automatically select AI model ? This option picks a suitable AI model based on the selected scenario. If no text model is currently selected, an appropriate one will be automatically picked for you.
Save File / Load File / Export File

Caution: Storage Slots are saved to a tempoary cache and can be deleted by your browser. To avoid losing data, use the download file button.

Select your AI provider
The AI Horde is a service that generates text using crowdsourced GPUs run by independent volunteer workers. Avoid sending privacy sensitive information. Click here for more info
Your AI Horde API Key ? You need an API key to use AI Horde to generate text. Get one at https://aihorde.net/register or use the anonymous key 0000000000.
[Manage My Workers] Need a Key?
(Register New User)
Select AI Horde Model ? These are the models currently provided by AI Horde volunteers. [See Current Volunteers]
Select By Worker ? This option explicitly assigns worker IDs, fixed based on the current workers available at model selection time.
You can use this to connect to a KoboldAI instance running via a remote tunnel such as trycloudflare, localtunnel, ngrok.
Localhost IPs require host mode enabled. You can use the remote address displayed in the remote-play.bat window or colab window, note that the model must be loaded first.
Please input URL of the KoboldAI instance.
Show Console Logging
Entering your OpenAI API key will allow you to use KoboldAI Lite with their API.
Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the OpenAI API and is not transmitted to us.
Only Temperature, Top-P and Repetition Penalty samplers are used.
Please input OpenAI API URL and Key.
Entering your OpenRouter API key will allow you to use KoboldAI Lite with their API.
Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the OpenRouter API and is not transmitted to us.
Only Temperature, Top-P and Repetition Penalty samplers are used.
Please input OpenRouter Key.
Entering your MistralAI API key will allow you to use KoboldAI Lite with their API.
Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the MistralAI API and is not transmitted to us.
Only Temperature and Top-P samplers are used.
Please input MistralAI Key.
Model Choice:
Add Version Num
Streaming
ChatCompletions API
Main Message Role:
Add Prefix
Add Postfix
Entering your Claude API key will allow you to use KoboldAI Lite with their API.
Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature.
At this time, the official Claude API has CORS restrictions and must be accessed with a CORS proxy. Your connection WILL be proxied.
Only Temperature, Top-P and Top-K samplers are used.
Please input Claude API URL and Key.
Model Choice:
Add Endpoint Version
Claude Compatibility Rename Fix
Uses Gemini or PaLM Text Bison by Google.
Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the Gemini API and is not transmitted to us.
Please input Gemini or PaLM API Key.
Uses Cohere's models through their own API.
Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the Cohere API and is not transmitted to us.
Please input Cohere API Key.
Use WebSearch
Use Preamble
Really Start A New Story?
Unsaved data will be lost.
Keep AI Selected?
Keep Memory and World Info?
Advanced Load File
Select categories to import from saved file. Selected categories will be overwritten. Unselected categories will retain original values.

Main Story |
Memory and Author's Note |
World Info |
Stop Sequences |
General Settings |
Aesthetic Settings |

Image Information
Loading...
Settings
Usage Mode ?Story Mode is best for novel style writing. Adventure Mode is best for Interactive Fiction RPGs. Chat Mode is best for chat conversations with the AI. Instruct mode is for giving the AI ChatGPT styled tasks.
UI Style Select ?Select your preferred UI style, which affects text formatting and display. Some UIs are only available for specific modes.
Your Name ?The name the AI will see you as
AI Name ?Name of the person(s) you want to chat with. Multiple opponents can be specified, creating a group chat, separate their names using multiple lines.
Instruct Tag Preset ?Quickly select between common instruct tag formats. Different models are trained with different tags.
Instruct Tag Format ?Specify the exact text formatting used for instruct mode.
System Tag ?The sequence to start the system prompt
Sys. Prompt ?A fixed system message sent at the very start to guide the AI behavior. Usually NOT needed
User Tag ?The sequence to start an instruction prompt
Assistant Tag ?The sequence to start an assistant response
Multiline Replies ?Whether to allow multiple lines in AI responses (Chat/Adventure). Disable this if the AI starts generating rubbish.
Continue Bot Replies ?Allow incomplete AI chat mode replies, which can be continued by pressing submit again. Not recommended for newbies.
Chat PrePrompt ?Modifies the context, injecting tokens to improve chat quality for new chats.
Adventure PrePrompt ?Modifies the context, injecting tokens to improve adventure quality for new adventures.
Enable Markdown ?Allows the UI to use markdown formatting such as quotes and code blocks.
Trim Sentences ?Trims incomplete sentences in AI output.
Trim Whitespace ?Removes trailing whitespace in AI output.
Compress Newlines ?Compresses multiple newlines into one newline in AI output.
Inject Timestamps ?Injects timestamps into context (Chat/Instruct), allowing the AI to have a sense of time.
Inject ChatNames ?Appends chat names after every instruct tag, a hybrid chat mode.
Assistant Jailbreak ?Automatically injects a jailbreak message after every instruct query, to make the AI more likely to obey you.
Sampler Preset ?Pick from an easy selection of curated generation presets, or configure your own.
Context Size ?Maximum number of context tokens submitted to the AI. Must exceed max output tokens. Can be further increased by editing the textbox. Older models stop at 2048, newer ones can do 4096 or greater.
512
2048
Auto-Adjust Limits
Max Output ?Number of tokens the AI should generate. Higher numbers will take longer to generate.
16
512
Auto-Adjust Limits
Temperature ?Randomness of sampling. High values can increase creativity but may make text less sensible. Lower values will make text more predictable but can become repetitious.
0.1
2
Repetition Penalty ?Used to penalize words that were already generated or belong to the context (too high causes incoherence!).
1
2
Top-P Sampling ?Used to discard unlikely text in a nucleus sampling process. Lower values will make text more predictable but can become repetitious. Set to 1 to deactivate it.
0
1
Top-K Sampling ?Top-K Sampling. Discards all but the K most likely tokens. Set 0 to Deactivate.
0
1
Advanced Sampler Config ?These settings control alternative samplers configurations. They are inactive by default, you usually do not need to change them.
Top-A
Typical
TFS
Min-P
Pr. Pen.
Seed
Rp.Range
Rp.Slope
Smooth.F
DyTemp
EOS Token Ban ?Allow the End-Of-Stream (EOS) token and potentially other restricted special tokens to be generated.
Sampler Order ? The order by which all 7 samplers are applied, separated by commas. 0=top_k, 1=top_a, 2=top_p, 3=tfs, 4=typ, 5=temp, 6=rep_pen
Mirostat ? Replaces your samplers with mirostat, an alternative sampling method. May not be available depending on backend, not supported on Horde.
Mode
Tau
Eta
Mirostat Not Supported
DRY (If supported) ?An advanced multi-token repetition penalty. May not be available depending on backend, not supported on Horde.
Mult.
Base
A.Len
DRY Not Supported
Grammar ? Grammar Sampling (KCPP) - Allows you to constrain output to fit specific structures. Resets grammar state every generation unless Retain is checked.
Retain
Generate Images ?Use the AI Horde or a local A1111 instance to insert AI generated images into your story.
Allow NSFW
Save In A1111

Autogenerate Save Images

Text To Speech ?Enable Text-To-Speech to have your story automatically read to you.

Language |

Narrate Both Sides
Narrate Only Dialog
Beep on Done
Notify on Done
Browser TTS Speed:
Voice Input ?Requires KoboldCpp with Whisper model loaded. Enables Speech-To-Text voice input. Automatically listens for speech in 'On' mode (Voice Detection), or use Push-To-Talk (PTT).
Voice Delay:
Style tags to use for generating images:
(E.g. Sketch, Realistic, Anime, 3D Render, Drawing)
Negative Prompt:
Number of Steps:
Cfg. Scale:
Sampler:
Aspect Ratio ? Square is recommended. Changing aspect ratio will affect the resolution used to generate. This may impact quality or memory usage. :
Img2Img Strength ? Higher values lead to a more different image. :
Save Higher-Res ? This option will result in larger save files which may be slower. Changing this setting only applies to NEW images. :
Token Streaming ?Use token streaming for partial responses. SSE is smoother but less well-supported. Poll is chunkier but more reliable. Not available on Horde.
Idle Responses
Never Escape HTML ?Avoids escaping any HTML tags, allowing HTML injections. Not recommended!
Placeholder Tags ?If enabled, uses universal {{user}} and {{[INPUT]}} placeholders that get swapped on submit. If disabled, uses plaintext chat or instruct tags verbatim.
Render Sp.Tags ?If enabled, renders special tags like EOS and padding tokens. Not recommended.
Autosave Session ?Autosaves your current story and settings on exit, reloads when you return
Embed Settings File ?Includes your current settings when saving or sharing your story
Rename Save File ?Prompts to input a different filename when saving file.
Show Advanced Load ?If enabled, allows you to select additional configurations during file load
Card Import Prompt ?If enabled, prompts the user to choose what mode to import a character card in. If disabled, automatically picks chat mode.
Run In Background ?Prevents the browser from suspending KoboldAI Lite by playing a silent audio track. This setting cannot be saved.
User Mods ?Allows you to load third-party user created mods (caution).
Autoscroll Text ?Automatically scrolls the text window down when new text is generated
Unlock Scroll Height ?Unlocks the text viewport, allowing for infinite height without scrolling
Viewport Width ?Controls horizontal scaling of the viewport window
Inverted Colors ?Inverts all colors, simple light mode
Background Img
Context Data
Memory?Put the information you want the AI to always remember. It will be inserted into the top of every request sent to the AI.
Newline After Memory
Author's Note?Similar to Memory, but inserted near the end of the text instead of the start. A good way to control the mood/behavior of the AI.
Author's Note Template?A placeholder, will be inserted with the author's note replacing the <|>. You generally don't need to change this. A/N Strength?Controls how far back to insert the Author's Note. Notes injected closer to the end have a stronger effect.
WI Insert Location ?Controls where the world info should be inserted
WI Search Depth ?Controls how far back in the text to search for World Info Keys
Case Sensitive Keys
Extra Stopping Sequences ?Triggers the text generator to stop generating early if this sequence appears, in addition to default stop sequences. If you want multiple sequences, separate them with the following delimiter: ||$||
Stop Sequences may be unavailable.
Logit Biases ?Specify a dictionary of token IDs to modify the probability of occuring.
Logit bias may be unavailable.
Enter OpenAI-formatted logit bias dictionary. Each key is the integer token IDs and their values are the biases (-100.0 to 100.0). Leave blank to disable.
Input is a JSON object, reference here.
Input Strings Instead of IDs (Uses KCPP Tokenizer) ?If enabled, allows you to input strings instead of only token IDs, and tokenizes them for you.
Token Filter ?Outright removal for ANY tokens containing a specific substring from model vocab. If you want multiple sequences, separate them with the following delimiter: ||$||
Token filter may be unavailable.
Outright removal for ANY tokens containing a specific substring from model vocab. If you want multiple sequences, separate them with the following delimiter: ||$||
Note: If you're trying to ban a specific token ID, you should use Logit Bias instead!
Regex Replace ?Allows transforming incoming text with regex patterns, modifying all matches. Replacements will be applied in sequence.

Placeholder Tags ?Configure automatic substitutions for placeholders in text.
Stories can use placeholders like {{user}} and {{[INPUT]}} that require dynamic substitution. If disabled, uses plaintext tags verbatim.
Enable Placeholder Tags ?If enabled, uses placeholders that get swapped on submit. If disabled, uses plaintext verbatim.

Worker List

Name | Model | Capabilities | Uptime | Kudos
--- | --- | --- | --- | ---

My Worker List

Name | Description | Uptime | Kudos | Maint. | Del.
--- | --- | --- | --- | --- | ---

Share Story
Warning: This story is very long. It may not load in some browsers. You should save it as a file instead.
Dynamic Temperature Wizard
Dynamic temperature is specified by a Temperature Value and a Temperature Range. Actual temperature is allowed to be automatically adjusted dynamically between (DynaTemp ± DynaRange).
For ease of use, a simple converter is provided here. Setting both values to the same temperature disables DynaTemp.
Minimum Temperature:
Maximum Temperature:

Temperature:
DynaTemp-Range:

DynaTemp-Exponent:
Add New Image
Paste Image From Clipboard
Share Story Import / Export
Chat Selectors
Aesthetic UI customization panel
Background Style
Bubble Color:
System 🖌️
You 🖌️
AI 🖌️
Rounded Bubbles:
Color Background:
Min Height:
px
Horizontally-centered text:
Margin (px):
L:
R:
T:
B:
Padding (px):
L:
R:
T:
B:
Portrait Style
Portraits:
🖼️ Your Portrait
🖼️ AI's Portrait
Portrait Style:
(Reset Image)
User Portrait:
Size:
px
A/R:
AI Portrait:
Size:
px
A/R:
Show Names (Chat Mode):
Font Style
Font Size:
px
Customize:
Per-entity:
Style Text:
Colors:
text🖌️
"speech"🖌️
*action*🖌️
You:
text🖌️
"speech"🖌️
*action*🖌️
AI:
text🖌️
"speech"🖌️
*action*🖌️
System:
text🖌️
"speech"🖌️
*action*🖌️
Code blocks:
background🖌️
foreground🖌️
(Reset All Styles)

Style Preview