Iām asking because Iām writing a short post about how LLMs work and want to explain the probabilities which makes sense for the words displayed but donāt obviously add up to a 100 even if one bucket is āall other possibilitiesā which I donāt see. Why does next line have a probability?
The top 5 options don't add up to 100% because there's plenty of other options beyond the top 5. The last sentence tells you that top 5 options are around 84% of all. Btw, a cool trick is also to ask ChatGPT itself what do certain things here mean š For example: What does "-0.89 logprob on 1 token" means in LLMs?
Next line in this context would mean the sentence ends here (unpunctuated). So, the dog ran.