02B / generation
JSON probabilities
token by token
Ask the model to estimate the same displayed-option distribution and write it as JSON. Watch every token arrive.
waiting for a run
- first token
- —
- total
- —
- input
- —
- output
- —
Source: Hacker News
02B / generation
token by token
Ask the model to estimate the same displayed-option distribution and write it as JSON. Watch every token arrive.
waiting for a run
Source: Hacker News
You must be logged in to post a comment.