alpaca-eval

PyPI

Is alpaca-eval safe to use?

Based on the latest brin safety scan, no vulnerabilities or threats were detected for alpaca-eval v0.6.6. Trust score: 65/100. No known CVE vulnerabilities, no detected threat patterns, and no suspicious capabilities identified. This is an automated, point-in-time assessment.

Install (safety-checked)

alpaca-eval Passed Security Checks

No security concerns detected

clean
CVEs

0

Threats

0

Install Scripts

0

No Concerns Detected

No security concerns detected in the latest brin assessment. This is an automated, point-in-time evaluation — security posture may change.

This is an automated, point-in-time assessment and may contain errors. Findings are risk indicators, not confirmed threats. Security posture may change over time. Maintainers can dispute findings via the brin review process.

alpaca-eval Capabilities & Permissions

What alpaca-eval can access when installed. Review these capabilities before using with AI agents like Cursor, Claude Code, or Codex.

Network Access

This package makes network requests.

api.chat.jina.aichat.jina.aidoi.orggithub.comhuggingface.coreplicate.comwww-files.anthropic.com
Protocols: https

Filesystem Access

Reads and writes to the filesystem.

.env (r).env (rw)

Process Spawning

This package can spawn child processes.

Environment Variables

Accesses the following environment variables.

ANTHROPIC_API_KEYANTHROPIC_MAX_CONCURRENCYAPI_MAX_CONCURRENCYCOHERE_API_KEYDATASETS_FORCE_DOWNLOADDATASETS_TOKENGOOGLE_API_KEYHUGGINGFACEHUB_API_TOKENIS_ALPACA_EVAL_2JINA_CHAT_API_KEY+6 more

Native Modules

Contains native code that runs outside the JavaScript sandbox.

numpypandasscipy

AGENTS.md for alpaca-eval

Good instructions lead to good results. brin adds alpaca-eval documentation to your AGENTS.md so your agent knows how to use it properly—improving both safety and performance.

brin init

Vercel's research: 100% accuracy with AGENTS.md vs 53% without →

alpaca-eval Documentation & Source Code

For the full alpaca-eval README, API documentation, and source code, visit the official package registry.

Frequently asked questions about alpaca-eval safety

Weekly Downloads

59.5K

Version

0.6.6

Last Scanned

Feb 12, 2026

Trust Score

65/100·Legitimacy signals, not safety

Capabilities

Network

Connects to: api.chat.jina.ai, chat.jina.ai, doi.org...

Filesystem

Reads & Writes files

Process

Spawns child processes

Environment

Accesses: ANTHROPIC_API_KEY, ANTHROPIC_MAX_CONCURRENCY, API_MAX_CONCURRENCY...

Native

Contains native modules

Is alpaca-eval Safe? | PyPI Safety Scan - brin