Scorpil@discuss.tchncs.de to ChatGPT@lemmy.worldEnglish · 1 year agoUnderstanding Generative AI: Part One - Tokenizerscorpil.comexternal-linkmessage-square2fedilinkarrow-up115arrow-down14
arrow-up111arrow-down1external-linkUnderstanding Generative AI: Part One - Tokenizerscorpil.comScorpil@discuss.tchncs.de to ChatGPT@lemmy.worldEnglish · 1 year agomessage-square2fedilink
minus-squaremozzribo@leminal.spacelinkfedilinkarrow-up1·1 year agoWhat are tokens and how to count them?
What are tokens and how to count them?