dqbd/tiktokenizerPublic

NotificationsYou must be signed in to change notification settings
Fork121
Star1k

Online playground for OpenAPI tokenizers

License

MIT license

1k stars 121 forks Branches Tags Activity

Star

Notifications

You must be signed in to change notification settings

Branches Tags

Folders and files

Name		Name	Last commit message	Last commit date
Latest commit History 57 Commits
public		public
src		src
.env.example		.env.example
.eslintrc.cjs		.eslintrc.cjs
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
next.config.mjs		next.config.mjs
package.json		package.json
postcss.config.cjs		postcss.config.cjs
prettier.config.cjs		prettier.config.cjs
tailwind.config.cjs		tailwind.config.cjs
tsconfig.json		tsconfig.json
yarn.lock		yarn.lock

Repository files navigation

Tiktokenizer

Online playground foropenai/tiktoken, calculating the correct number of tokens for a given prompt.

Special thanks toDiagram for sponsorship and guidance.

CleanShot.2023-03-02.at.22.58.11.mp4

Acknowledgments

About

Online playground for OpenAPI tokenizers

tiktokenizer.vercel.app

Releases

No releases published

Packages

No packages published

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

License

Folders and files

Latest commit

History

Repository files navigation

Tiktokenizer

Acknowledgments

About

Topics

Resources

License

Stars

Watchers

Forks

Releases

Packages

Contributors3

Languages

Movatterモバイル変換

License

dqbd/tiktokenizer

Folders and files

Latest commit

History

Repository files navigation

Tiktokenizer

Acknowledgments

About

Topics

Resources

License

Stars

Watchers

Forks

Releases

Packages0

Contributors3

Languages

Packages