mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-01 01:50:51 +02:00

Files

T

Concedo 5b54b90dca Merge branch 'upstream' into concedo_experimental

# Conflicts:
#	ci/run.sh
#	docs/backend/SYCL.md
#	docs/ops.md
#	docs/ops/SYCL.csv
#	examples/sycl/start-svr.sh
#	examples/sycl/test.sh
#	examples/sycl/win-start-svr.bat
#	examples/sycl/win-test.bat
#	ggml/CMakeLists.txt
#	ggml/src/ggml-sycl/common.hpp
#	ggml/src/ggml-sycl/element_wise.cpp
#	ggml/src/ggml-sycl/fattn-vec.hpp
#	ggml/src/ggml-sycl/ggml-sycl.cpp
#	ggml/src/ggml-sycl/presets.hpp
#	ggml/src/ggml-sycl/set_rows.cpp
#	ggml/src/ggml-sycl/ssm_conv.cpp
#	scripts/sync-ggml.last
#	tests/test-backend-ops.cpp
#	tests/test-model-resolution.cpp
#	tests/test-mtmd-c-api.c

2026-08-08 17:08:22 +08:00

README.md

mtmd: support Qwen3-TTS (note: breaking change to llama-tts binary) (#26254 )

2026-08-04 17:26:15 +02:00

tts.cpp

tts: account for the vocoder pass in the timings line (#26733 )

2026-08-07 22:35:52 +02:00

README.md

llama.cpp TTS

This is a tool to demonstrate audio generation capability in llama.cpp via libmtmd. It was added via PR #26254

Note: this tool used to serve as a demo for OuteTTS, but it was converted to a more model-agnostic tool.

Common usage

Simple usage:

llama-tts -hf ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF -p "Hello world" --output out.wav

Common params:

Sampling params such as --top-k, --top-p, --temp, etc.
-n <number_of_frames> limits the output length, e.g. -n 500. Note that how many milliseconds each frame represents varies by model
Core inference params such as -ngl, -b, -ub, etc.

Qwen3-TTS

Available params:

--tts-lang can be zh, en, de, it, pt, es, ja, ko, fr, ru (default: en)
--tts-speaker-file should point to a speaker reference audio file (wav, mp3)

Example usage:

llama-tts -hf ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF \
    -p "Hello world" \
    --tts-lang english \
    --tts-speaker-file speaker.mp3 \
    --output out.wav