VOOZH
about
URL: https://dev.to/t/bpe
⇱ Bpe - DEV Community
The Tokenizer Behind GPT: Understanding BPE Step by Step
👁 yaya_sh profile
Yaya
👁 Image
Yaya
Jun 7
The Tokenizer Behind GPT: Understanding BPE Step by Step
#
bpe
#
ai
#
llm
#
machinelearning
👁 Image
1
reaction
Add Comment
4 min read
Open Source Project of the Day (#85): tiktoken - OpenAI's Blazing-Fast BPE Tokenizer
👁 wonderlab profile
WonderLab
👁 Image
WonderLab
Jun 4
Open Source Project of the Day (#85): tiktoken - OpenAI's Blazing-Fast BPE Tokenizer
#
opensource
#
nlp
#
bpe
#
openai
Add Comment
7 min read
Tokenization: The Cursed Trick that Unlocked LLMs
👁 neuraldownload profile
Neural Download
👁 Image
Neural Download
Mar 20
Tokenization: The Cursed Trick that Unlocked LLMs
#
tokenization
#
bpe
#
bytepairencoding
#
gpttokens
Add Comment
4 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
👁 DEV Community
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
👁 Image
👁 Image
👁 Image
👁 Image
👁 Image
