Thinking model
#6
by
GhostGate
- opened
Hey!
I was wondering if the model is trained on "think" tokens? I am wondering because I noticed it starts do thinking tags and I am not sure if it's me or if the model is a "think" model.
Well it can do both, thinking and non thinking, the default is thinking mode set to true, but you can toggle the thinking mode on / off by including /no_think, and /think in system prompt or in your user prompt directly.
Got it! Thank you for the answer :) Also, congratulations on an amazing finetune. I have yet to deeply test it, but initial reactions are very positive.
Goekdeniz-Guelmez
changed discussion status to
closed