brin
brin

swebench

PyPI

Is swebench safe to use?

Based on the latest brin safety scan, no vulnerabilities or threats were detected for swebench v4.1.0. Trust score: 70/100. No known CVE vulnerabilities, no detected threat patterns, and no suspicious capabilities identified. This is an automated, point-in-time assessment.

Install (safety-checked)

swebench Passed Security Checks

No security concerns detected

clean
CVEs

0

Threats

0

Install Scripts

0

No Concerns Detected

No security concerns detected in the latest brin assessment. This is an automated, point-in-time evaluation — security posture may change.

This is an automated, point-in-time assessment and may contain errors. Findings are risk indicators, not confirmed threats. Security posture may change over time. Maintainers can dispute findings via the brin review process.

swebench Capabilities & Permissions

What swebench can access when installed. Review these capabilities before using with AI agents like Cursor, Claude Code, or Codex.

Network Access

This package makes network requests.

arxiv.orgcode.djangoproject.comdeb.nodesource.comdl-ssl.google.comdl.google.comdocs.github.comdownloads.apache.orggetcomposer.orggithub.comhugovk.github.io+7 more
Protocols: http, https

Filesystem Access

Reads and writes to the filesystem.

/usr/ (rw).env (rw)/usr/ (rw)/usr/ (rw)/usr/ (rw).env (rw)/usr/ (rw).env (rw)+43 more

Process Spawning

This package can spawn child processes.

Environment Variables

Accesses the following environment variables.

ANTHROPIC_API_KEYGITHUB_TOKENGITHUB_TOKENSHUGGING_FACE_HUB_TOKENOPENAI_API_KEY

Native Modules

Contains native code that runs outside the JavaScript sandbox.

numpy

AGENTS.md for swebench

Good instructions lead to good results. brin adds swebench documentation to your AGENTS.md so your agent knows how to use it properly—improving both safety and performance.

brin init

Vercel's research: 100% accuracy with AGENTS.md vs 53% without →

swebench Documentation & Source Code

For the full swebench README, API documentation, and source code, visit the official package registry.

View on PyPI

Frequently asked questions about swebench safety

Weekly Downloads

392.0K

Version

4.1.0

Last Scanned

Feb 5, 2026

Trust Score

70/100·Legitimacy signals, not safety

Capabilities

Network

Connects to: arxiv.org, code.djangoproject.com, deb.nodesource.com...

Filesystem

Reads & Writes files

Process

Spawns child processes

Environment

Accesses: ANTHROPIC_API_KEY, GITHUB_TOKEN, GITHUB_TOKENS...

Native

Contains native modules