dmatth1 / REPOSITORY
quicktok
Quicktok, an exact BPE tokenizer 7x faster than tiktoken
AI & agentsShow HNLicense unchecked
Explore repositoryOriginal HN title; author claims are not independently verified.
1Top HN score
1Total comments
1Linked discussions
GO STRAIGHT TO THE SOURCE