Advanced
In reply to @tempetechie.eth
Avi šŸ’™@savvyavi
9/19/2023

I’m asking because I’m writing a short post about how LLMs work and want to explain the probabilities which makes sense for the words displayed but don’t obviously add up to a 100 even if one bucket is ā€œall other possibilitiesā€ which I don’t see. Why does next line have a probability?

In reply to @savvyavi
Tempe Techie @tempetechie.eth
9/20/2023

The top 5 options don't add up to 100% because there's plenty of other options beyond the top 5. The last sentence tells you that top 5 options are around 84% of all. Btw, a cool trick is also to ask ChatGPT itself what do certain things here mean šŸ˜‰ For example: What does "-0.89 logprob on 1 token" means in LLMs?

In reply to @savvyavi
Thomas D. Pellegrin (šŸ„,šŸ”Ŗ)@aviationdoctor.eth
9/20/2023

Next line in this context would mean the sentence ends here (unpunctuated). So, the dog ran.