tiktoken

PyPI

Is tiktoken safe to use?

The latest brin safety scan flagged tiktoken v0.12.0 with risk indicators that warrant review. No known CVE vulnerabilities. Trust score: 65/100. Review the findings below before use. This is an automated assessment and may contain errors.

Install (safety-checked)

tiktoken Has Warnings

Warnings detected due to potential concerns

warning
CVEs

0

Threats

0

Install Scripts

0

Risk Indicators

  • Package includes native code modules
  • Package can spawn child processes

brin Recommendations

  • This package has warnings detected. Evaluate the specific concerns before proceeding.

Install with brin add tiktoken to automatically apply these checks before installation.

This is an automated, point-in-time assessment and may contain errors. Findings are risk indicators, not confirmed threats. Security posture may change over time. Maintainers can dispute findings via the brin review process.

tiktoken Capabilities & Permissions

What tiktoken can access when installed. Review these capabilities before using with AI agents like Cursor, Claude Code, or Codex.

Network Access

This package makes network requests.

api.github.comopenaipublic.blob.core.windows.net
Protocols: http, https

Filesystem Access

Reads and writes to the filesystem.

.env (r)pyproject.toml (r).env (rw).env (rw)

Process Spawning

This package can spawn child processes.

Environment Variables

Accesses the following environment variables.

DATA_GYM_CACHE_DIRRAYON_NUM_THREADSTIKTOKEN_CACHE_DIRTIKTOKEN_MAX_EXAMPLES

Native Modules

Contains native code that runs outside the JavaScript sandbox.

numpy

AGENTS.md for tiktoken

Good instructions lead to good results. brin adds tiktoken documentation to your AGENTS.md so your agent knows how to use it properly—improving both safety and performance.

brin init

Vercel's research: 100% accuracy with AGENTS.md vs 53% without →

tiktoken Documentation & Source Code

For the full tiktoken README, API documentation, and source code, visit the official package registry.

Frequently asked questions about tiktoken safety

Weekly Downloads

18.6M

Version

0.12.0

License

MIT

Other Versions

Last Scanned

Feb 5, 2026

Trust Score

65/100·Legitimacy signals, not safety

Capabilities

Network

Connects to: api.github.com, openaipublic.blob.core.windows.net

Filesystem

Reads & Writes files

Process

Spawns child processes

Environment

Accesses: DATA_GYM_CACHE_DIR, RAYON_NUM_THREADS, TIKTOKEN_CACHE_DIR...

Native

Contains native modules