Automated repository security assessment

Local static security scan

Find what an attacker would find first, before they do.

Code Rail checks a public repository for exposed credentials and known dependency vulnerabilities, then produces a short, prioritized report — the kind of review a developer would otherwise skip. Deterministic scanners do the detection; the AI only reasons over their findings, so it uses a fraction of the tokens that asking an AI to read and check the whole repository directly would take.

Read-only clone Secret detection Dependency triage Saves tokens vs. AI-only checking
0code execution
3severity levels
1paste-to-report flow
No raw codesent to the AI model
Best demo results: use a public repository with a dependency file like package.json or requirements.txt. Repos without manifests still get checked for exposed secrets.
Assessment target

Paste a public GitHub repository

Local backend

Public repositories only. Code Rail clones a temporary read-only copy, scans text files and dependency manifests, then deletes the clone.

Cloning repository…
config.js
apiKey = "AKIA..."
lodash: 4.17.15
rawrepo contents
→
rankedfix-first report
SecretsAWS keys, GitHub tokens, private keys, Slack tokens, Stripe keys, password-like values.
DependenciesChecks npm and Python manifests against a hackathon-ready built-in advisory baseline.
ReportRanks issues by severity and gives a plain-language remediation path.
Executive summary
Findings

Click a finding to see the affected file, why it matters, and the recommended fix.

What Code Rail does
gitleaks

Secret detection

Finds exposed API keys, tokens, passwords and private keys committed to a repository.

npm audit · pip-audit

Dependency vulnerability audit

Checks third-party packages against known CVE databases so outdated, vulnerable libraries are flagged before they ship.

AI triage

Severity ranking

Every finding is rated high, medium or low, so you know what to fix first instead of facing a flat list of alerts.

AI triage

Plain-language explanations

Each finding says what the problem is, why it matters, and a concrete recommended fix a developer can act on right away.

Report

Filterable findings

Switch between secrets and dependencies, and expand any finding to see the affected file, explanation and fix.

Read-only

Safe by design

Uses a shallow, read-only copy of a public repository. Nothing is executed and nothing is attacked.

Established scanners do the detection

Detection is done by well-known, deterministic tools, so results are repeatable and not an AI guess. The AI only explains and prioritizes what those tools found.

The AI reads findings, not your code

The model receives a short, structured list of findings rather than the whole repository. That saves tokens, keeps cost low, keeps the report focused, and limits how much of your source is ever sent to a model.

Far fewer tokens than asking an AI to read your repo

Because only the scanners' findings go to the AI, the amount of text it has to process depends on how many issues exist, not how big the codebase is. In the example below, that is roughly 99% fewer tokens. It is an estimate you can adjust, not a measured average.

Built for the people who skip security reviews

Small teams and solo developers rarely have time for a full audit. Code Rail gives them a prioritized report in one step, with fixes they can apply the same day.

Honest about its scope

This is automated static analysis (secret detection and dependency scanning), not a penetration test. We say so in the product, along with its known limitations, because trust in a security tool starts with accurate claims.

Estimated token savings

An illustrative estimate, not a measured average. Change the numbers to match a repository.

AI reads the whole repository–
Code Rail (findings only)–
Estimated reduction–

Assumptions: about 10 tokens per line of code; about 500 tokens of instructions plus about 270 tokens per finding (input and output). Real counts vary by language and model. Very large repositories may not fit in a single AI request at all. After running real scans, replace these assumptions with the token counts your AI provider reports.

How it compares
Running scanners yourselfAsking an AI to read the repoCode Rail
Reliable detectionYesInconsistentYes, via the scanners
Prioritized, explained resultsRaw output to interpretYesYes
Cost to analyzeFreeHigh, scales with repo sizeLow — saves tokens by sending only structured findings, not the repo
Setup effortInstall and configure each toolUpload or paste codePaste a repository URL
1

Clone

A shallow, read-only copy of the public repository is pulled for analysis.

2

Scan

Established scanners check for leaked secrets and vulnerable dependencies.

3

Report

Findings are ranked by severity and explained in plain language.

What this checks

Code Rail runs two categories of automated static analysis: secret detection (via gitleaks) and software composition analysis (via npm audit / pip-audit) against known CVE databases. It does not execute the application or attempt exploitation — this is not a penetration test.

Why AI is used

The scanners above do all the detection work, deterministically and for free. The one AI call reasons over a short, structured list of findings — not the raw repository — to rank severity, explain risk in plain language, and suggest fixes. That is why this uses a small fraction of the tokens an approach that asked an AI to read the whole repository would need.

Known limitations

Secret detection carries known false-positive and false-negative tradeoffs inherent to the underlying tool. This prototype does not check GitHub Actions configuration, repository settings, or source code patterns beyond dependency and secret scanning. It does not replace a professional security audit.