Wagner Bruna bad9b61064 sd: sync to master-582-7023fc4 (#2150) ...

* sd: remove sampler alias handling from the C++ layer

It's already handled at the Python layer.

* sd: sync to master-580-7d33d4b

* sd: sync to master-582-7023fc4

2026-04-21 23:01:33 +08:00

..

vocab

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

bpe_tokenizer.cpp

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

bpe_tokenizer.h

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

clip_tokenizer.cpp

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

clip_tokenizer.h

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

mistral_tokenizer.cpp

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

mistral_tokenizer.h

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

qwen2_tokenizer.cpp

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

qwen2_tokenizer.h

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

t5_unigram_tokenizer.cpp

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

t5_unigram_tokenizer.h

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

tokenize_util.cpp

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

tokenize_util.h

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

tokenizer.cpp

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00

tokenizer.h

sd: sync to master-582-7023fc4 (#2150)

2026-04-21 23:01:33 +08:00