Skip to content

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

fix(sentence_transformer): resolve device consistently with other branches (#10843)

li-lizhec678258a58cd
diff --git a/unsloth/models/sentence_transformer.py b/unsloth/models/sentence_transformer.py
index 691e3186c68..3c14c681940 100644
--- a/unsloth/models/sentence_transformer.py
+++ b/unsloth/models/sentence_transformer.py
@@ -1542,7 +1542,7 @@ class FastSentenceTransformer(FastModel):
if isinstance(st_device, dict) or (
isinstance(st_device, str) and st_device in ["auto", "sequential"]
):
- st_device = "cuda"
+ st_device = None
model_kwargs = {"torch_dtype": dtype}