@TheAhmadOsman · ♡ 240 · tool
- local llms 101
- running a model = inference (using model weights)
- inference = predicting the next token based on your input plus all tokens generated so far
- together, these make up the "sequence"
- tokens ≠ words
- they're the chunks representing the text a model sees
-...
Tool relevant to chipmonk tech.