01. The Real Threat Model
None of these require a sophisticated attacker. A retrieval query that isn't scoped correctly, an evaluation suite that doesn't cover a real failure mode, or cost monitoring that only checks aggregate spend, all create exposure through ordinary gaps, not novel attacks.
The margin erosion risk deserves the same seriousness as the others, even though it doesn't look like a security problem at first glance. A tenant whose usage pattern turns unprofitable isn't a data breach, but left unmonitored for a full billing cycle it can do comparable damage to the business. It's caught by the same discipline: per-tenant instrumentation from day one, rather than a retrofit once the finance team asks why margin slipped.
02. Specific Risks
- Cross-tenant data leakage: retrieval or context construction that isn't strictly scoped per tenant, especially in shared vector stores or caching layers.
- Prompt injection within a tenant: user-supplied or retrieved content manipulating model behavior within that tenant's own session.
- Margin erosion: usage growth eroding gross margin silently because cost isn't attributed and monitored per tenant.
- Provider dependency risk: a single upstream model provider outage or behavior change taking down the product with no fallback.
- Context window bleed: caching or batching optimizations that concatenate multiple tenants' context into a single model call to save cost, a common performance shortcut that reintroduces cross-tenant exposure.
- Silent quality drift: an upstream model version change or a prompt edit degrading output for a specific customer segment without triggering any alert, since nothing failed loudly enough to notice.
03. Defenses That Work
- Tenant isolation enforced at the database layer, tested directly with adversarial cross-tenant queries, not assumed from application code alone.
- All retrieved and user-supplied content treated as untrusted input when constructing model context.
- Per-tenant and per-feature cost attribution visible in dashboards from launch, with cost regression testing on every change.
- Model abstraction with fallback routing so a single provider's outage or degradation doesn't take down the whole product.
- Adversarial evaluation cases specifically targeting injection and cross-tenant leakage, run in CI alongside standard quality cases, not treated as a separate one-off security exercise.
04. What to Ask a Vendor
- How is tenant isolation tested, and can you show adversarial cross-tenant test results?
- How is cost attributed per tenant, and how quickly would margin erosion be caught?
- What happens if the primary model provider has an outage?
- What happens when a batching or caching optimization is proposed? Is cross-tenant exposure re-tested before it ships?
See our AI SaaS development guide for how these controls fit into the full product architecture.
05. Frequently Asked
Can one tenant's data leak into another tenant's AI output?
It can, if retrieval and context construction aren't strictly scoped per tenant at the database layer. This is one of the most serious risks specific to multi-tenant AI products and needs to be verified through testing, not assumed from application-level checks alone.
Can a prompt injection attack cross tenant boundaries?
If tenant isolation is enforced correctly at the data layer, a prompt injection in one tenant's content shouldn't be able to access another tenant's data, but it can still manipulate behavior within its own tenant's session. Both need independent defenses.
How do we catch margin erosion before it becomes a real problem?
Per-tenant and per-feature cost attribution visible from launch, not retrofitted after a quarter of unexplained margin decline. Cost regression testing on every change that touches the AI layer catches expensive regressions before they ship.
Does using a well-known model provider remove the need for our own security testing?
No. Provider-level safety measures address the model's own behavior, not how your application constructs context, isolates tenants, or handles retrieved content. Those remain your responsibility regardless of which provider sits underneath.
Cloudz Computing enforces tenant isolation at the database layer and tests it directly, not by trusting application-level checks alone.
Explore the AI SaaS Development solution →
Request a private consultation