Portfolio

Apr 2026 – Jun 2026 · Contract

Devzy AI is a pre-seed AI DevTools company building an agentic AI system for automated code review and developer workflow integrations.

• Built an MVP agentic AI system for automated code review, using multi-model orchestration (LLMs + tools) to evaluate code quality, security, and architecture in developer workflows.
• Designed validation pipelines combining LLM reasoning with static analysis, test execution, and compliance-aware security checks (GDPR, HIPAA, PCI-DSS, SOC 2 aligned).
• Implemented model routing and evaluation frameworks balancing accuracy, latency, and cost, with feedback loops to reduce false positives.
• Shipped CLI, PR, and IDE integrations delivering near real-time review feedback across the SDLC.

prakharsingh · cli · github-action · vscode-extension

Scanner-agnostic Compliance Intelligence Engine: normalizes SARIF from six OSS scanners, maps findings to eight compliance frameworks, and optionally adjudicates via a four-role LLM ensemble before posting inline PR evidence.

• Ingests SARIF from Checkov, Semgrep, CodeQL, Trivy, tfsec, and gitleaks; any tool that emits SARIF can feed it, so detection is never re-implemented
• Maps findings to eight frameworks (NIST 800-53, SOC2, ISO 27001, PCI-DSS, FedRAMP, HIPAA, GDPR, org-policy) via crosswalk packs; adding a framework is a YAML file, no detection code
• Optional four-role LLM adjudication ensemble (Detector → Verifier → Adversarial → Judge) with composite confidence scoring across six weighted signals; configurable model routing per role
• Framework-specific detection agents (GDPR, HIPAA, SOC2, FedRAMP, OrgPolicy, DataFlow) cover controls static engines cannot observe; ships seven authored Semgrep rules for gap coverage
• Outputs inline PR comments (diff-filtered, control-tagged), OSCAL assessment-results JSON, SEO-ready coverage HTML, aggregate SARIF, and a configurable severity gate
• Ships as a Python CLI, a GitHub Action, and a VS Code extension published on the Marketplace and Open VSX

LogKat · vscode-extension

VS Code sidebar extension for exploring and switching git worktrees.

• Activity Bar panel that stays in sync with local git state automatically, listing all worktrees for the current project root
• Branch Diff Explorer: expand any worktree to browse committed, staged, and untracked changes; double-click any file for a native side-by-side diff view
• Smart Switch dialog with New Window, Replace Current, and Add to Workspace modes; optional 'remember my choice' preference
• Published on VS Code Marketplace and Open VSX, available to VS Code, Cursor, and other Open VSX clients

2026-05-14

Building evaluation sets from past PRs, scoring precision vs recall, calibrating confidence thresholds, and wiring offline eval into production routing decisions.

2026-05-12

Multi-model LLM orchestration, grounding with static analysis and retrieval-augmented generation, false positives as the dominant cost, and compliance (GDPR / HIPAA / PCI-DSS / SOC 2) as a routing constraint rather than a bolted-on check.