AI Security & Red Teaming · Spire Digi Solution

SENTINEL AI — Multi-Agent Security Assessment Platform

500 structured security scenarios across 20 AI-specific domains, run by a fleet of specialized security agents.

Delivered at: Spire Digi Solution
Role: Lead architect — platform design, specialized-agent model and the full 500-scenario security taxonomy.
20AI security domains
500structured test scenarios

The problem

Generic penetration testing wasn’t built for LLMs, RAG, agents, MCP and multi-agent systems. Assessing modern AI needs its own taxonomy, its own specialized attack agents, and an evidence-first, authorization-gated process end to end — not a checklist borrowed from conventional AppSec.

Business Context

Generic penetration testing has no taxonomy for LLM, RAG, agent, MCP and multi-agent failure modes, which left Spire Digi Solution needing a structured way to assess modern AI systems instead of borrowing a checklist built for conventional AppSec.

Architecture

Scroll sideways to see the full diagram
SENTINEL AI — Multi-Agent Security Assessment PlatformProduction architecture — request flows top → bottom; security & observability span every layerClientslayer 1Security consoleREST / SDK clientsEdge & networklayer 2WAF & DDoS shieldL7 filtering · bot controlAPI gatewayrouting · versioningRate limits & quotasper tenant / per keymTLS · TLS 1.3encrypted in transitIdentity & accesslayer 3OIDC / OAuth2SSO · short-lived tokensRBAC + ABACleast privilegeTenant isolationdata · vectors · toolsSecrets → Vaultno static credentialsAI security & guardrailslayer 4focusNeMo Guardrailstopical & safety railsInjection / jailbreak filterinput inspectionPII & secret redactioninbound & outboundPolicy engine · OPAallow / deny decisionsOutput validationgrounding · citationsMulti-agent assessment corelayer 5Authorized target onboardingscope & sign-offDiscovery + threat-model agentsdynamic per targetScenario planner20 domains · 500 scenariosParallel domain security agentsbounded concurrencyControlled executorapproved scenarios onlyCorrelation & explainable riskframework-mapped scoringExecution & toolslayer 6Sandboxed workersephemeral · isolatedEvidence engineimmutable · hash-chainedReporting & retestexecutive + technicalModel layerlayer 7LLM gateway · routing & quotasPrimary model + auto fallbackSelf-hosted · vLLM / TritonEmbeddings serviceData & statelayer 8PostgreSQLpgvector / QdrantRedis cacheObject storageImmutable audit logcross-cutting — applied across every layer aboveSECURITY & COMPLIANCE · CROSS-CUTTINGSIEM & threat detectionruntime alertsSupply-chain scanningTrivy · Semgrep · GitleaksSBOM & image signingprovenanceAdversarial mappingOWASP LLM Top 10 · MITRE ATLASComplianceEU AI Act · ISO 42001 · NIST AI RMFOBSERVABILITY & OPS · CROSS-CUTTINGOpenTelemetry tracesprompts · steps · toolsMetricsPrometheus / GrafanaEvaluation & regression gatesblock bad releases in CICost & latency analyticsper tenant / routeAlerting & on-callSLOs · error budgetsCI/CD · IaCKubernetes · GitOpsTEN ARCHITECTURE PILLARS · REVIEWED END TO ENDScalabilitySecurityAI Security / GuardrailsReliability & ResilienceObservabilityGovernanceCost OptimizationData & RAG SecurityPerformanceMaintainability / DevSecOpsLegendSecurityGovernance / accessOrchestrationData / modelProcessing / executionObservability / storage20 AI-specific domains and 500 structured scenarios, run by specialized agents under an evidence-first, authorization-gated process end to end.

Key capabilities

20-domain, 500-scenario AI security taxonomy — prompt injection, RAG poisoning, agent goal hijacking, MCP security, memory security, multi-agent/A2A, multimodal, supply chain, governance and more

Dynamic threat modeling that selects the relevant specialized agents per target

Parallel, bounded-concurrency execution of approved scenarios only, fail-closed by default

Immutable evidence collection mapped to OWASP LLM Top 10 and MITRE ATLAS

Attack-path correlation with explainable, framework-mapped risk scoring

Executive and technical reporting with tracked remediation and retesting

Security & Risk

Generic penetration testing has no taxonomy for LLM, RAG, agent, MCP and multi-agent failure modes. SENTINEL AI runs 500 structured scenarios across 20 AI-specific domains through specialized security agents, each authorization-gated and evidence-first.

Outcome

A structured, repeatable AI security assessment — dynamic threat modeling and explainable risk scoring instead of a checklist borrowed from conventional AppSec.

Challenges

Building a 20-domain, 500-scenario taxonomy was only half the problem — the harder part was dynamic threat modeling that selects the relevant specialized agents per target, then executing only approved scenarios with bounded concurrency and a fail-closed default, so the assessment itself never became a source of risk to the target it was testing.

Lessons Learned

A repeatable AI security assessment needs its own taxonomy, not a retrofit of conventional AppSec categories. Mapping every scenario and finding to OWASP LLM Top 10 and MITRE ATLAS is what makes results explainable and comparable across engagements, instead of a one-off list of things that happened to break.

Architecture pillars

Designed and reviewed against all ten — see how I evaluate every architecture.

Want this level of testing applied to your own system? Start an AI Security Assessment.

ScalabilitySecurityAI Security / GuardrailsReliability & ResilienceObservabilityGovernanceCost OptimizationData & RAG SecurityPerformanceMaintainability / DevSecOps

Technology

ReactTypeScriptFastAPIPostgreSQLRedisConfigurable vector DBObject storageQueue / brokerOpenTelemetryPrometheusGrafanaDockerKubernetes

Want something like this, built properly?

I design and ship systems like this one — from architecture through to production.