Reverse engineering a $1B Legal AI tool exposed 100k+ confidential files
TL;DR Highlight
Filevine's legal AI SaaS had a public API endpoint returning Box admin tokens without auth, exposing 100K+ confidential files from law firms.
Who Should Read
Security engineers and backend devs building SaaS products with third-party OAuth integrations, and CTOs evaluating legal AI vendors.
Core Mechanics
- Filevine had a publicly accessible API endpoint that returned Box admin tokens without any authentication — a classic insecure direct object reference issue on a privileged token endpoint.
- The exposed tokens gave access to Box admin accounts belonging to law firm customers, meaning confidential legal documents (over 100K files) were readable by anyone who hit the endpoint.
- The researcher reported the vulnerability responsibly, but initial response from Filevine was slow. The issue was eventually patched.
- This is a textbook OAuth token storage failure: the server-side tokens were returned client-side with no authorization check on the caller.
- The attack surface is especially sensitive here — legal SaaS products hold privileged client communications, case files, and court documents that carry attorney-client privilege.
Evidence
- The researcher documented the endpoint, sample request, and sanitized token response, confirming the unauthenticated access was trivially reproducible.
- Community reaction was strong: several commenters noted this is a systemic problem with 'move fast' SaaS culture when applied to high-sensitivity legal data.
- Others pointed out that law firms face ABA ethics rules around client data confidentiality — a breach like this could expose firms to bar complaints in addition to legal liability.
- There was debate about whether Filevine's response timeline was acceptable for a security incident of this severity.
How to Apply
- Audit all endpoints that return OAuth tokens or third-party API credentials — verify that caller authorization is checked, not just authentication.
- Never store third-party admin tokens in a way that's retrievable via a user-facing API without checking the requester's permission scope.
- For legal/medical/financial SaaS: treat third-party integration tokens as secrets with the same access controls you'd apply to raw credentials.
- Add automated tests for your most sensitive API endpoints that explicitly verify unauthenticated requests are rejected with 401/403.
Code Example
// Vulnerable pattern: frontend directly receives a high-privilege token and calls external API
const res = await fetch(`${BOX_SERVICE}/recommend`, {
method: 'POST',
body: JSON.stringify({ projectName: 'Very sensitive Project' })
// No Authorization header!
});
const { boxToken } = await res.json(); // admin token is returned as-is
// Safe pattern: backend acts as proxy or issues short-lived presigned URLs
// Backend (Node.js example)
app.get('/api/file/:fileId', authenticate, async (req, res) => {
// 1. Verify user permissions
const hasAccess = await checkPermission(req.user, req.params.fileId);
if (!hasAccess) return res.status(403).json({ error: 'Forbidden' });
// 2. Call Box API using a token stored only on the backend
const boxClient = new BoxClient({ accessToken: process.env.BOX_ADMIN_TOKEN });
const downloadUrl = await boxClient.files.getDownloadURL(req.params.fileId);
// 3. Return only a short-lived URL (no direct token exposure)
res.json({ url: downloadUrl, expiresIn: 60 });
});Terminology
Related Papers
What happened after 2k people tried to hack my AI assistant
실제로 6,000개 이상의 이메일로 AI 에이전트에 prompt injection 공격을 시도한 공개 실험 결과로, Claude Opus 4.6이 비밀 파일 유출을 한 번도 허용하지 않았지만 실험 설계의 현실성에 대한 논란이 뜨거웠다.
When Does Combining Language Models Help? A Co-Failure Ceiling on Routing, Voting, and Mixture-of-Agents Across 67 Frontier Models
여러 LLM을 조합해도 '모든 모델이 동시에 틀리는 비율(β)'이 성능 상한선이며, 업계가 쓰는 pairwise 상관계수(ρ)는 이 상한선을 예측하지 못한다.
Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability
실제 환경처럼 API가 망가지거나 결과가 이상할 때 LLM 에이전트가 얼마나 잘 버티는지 측정하는 벤치마크 ToolBench-X 공개.
Nearly Half of LG Smart TV Apps Contain Residential Proxy SDKs
6,038개의 LG·Samsung 스마트 TV 앱을 스캔했더니 2,058개에서 사용자의 IP를 몰래 팔아 트래픽을 중계하는 Residential Proxy SDK가 발견됐다. TV는 컴퓨터처럼 감시받지 않아서 프록시 호스트로 거의 이상적인 환경이다.
Prompt Injection as Role Confusion
LLM이 시스템 프롬프트, 사용자 입력, 툴 출력을 구분하지 못하는 구조적 결함이 prompt injection의 근본 원인이라는 ICML 2026 논문으로, 현재 LLM 보안 아키텍처의 한계를 명확히 분석한다.
GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
모델 크기가 커질수록 성능이 좋아진다는 통념에 반해, 오픈소스 753B 모델 GLM-5.2가 추정 1~2T 규모의 GPT-5.5보다 환각 비율이 3배 낮다는 벤치마크 결과가 나왔다. 단순히 파라미터 수와 벤치마크 점수만으로 모델을 선택하면 실제 업무에서 낭패를 볼 수 있다는 경고다.