MCP server that reduces Claude Code context consumption by 98%
TL;DR Highlight
When MCP tool calls return raw verbose output, it eats context window fast — here's a pattern to compress tool outputs before they hit the LLM.
Who Should Read
Developers building MCP servers or AI agent pipelines where tool call outputs are large and verbosity is killing context window efficiency.
Core Mechanics
- The core problem: MCP tools often return raw, verbose output (full API responses, stack traces, large data blobs) that gets dumped directly into the LLM's context window.
- This wastes context tokens on information the LLM doesn't need, increases latency, and raises costs.
- The solution pattern: add a 'summarizer' or 'filter' layer between the tool execution and the context — transform raw outputs into compact, LLM-relevant summaries before they're inserted.
- For structured data (JSON API responses), extract only the fields the agent actually needs. For errors, compress to key error type + message. For large text, summarize.
- This can be implemented as a middleware layer in the MCP server, or as a post-processing step in the agent loop.
Evidence
- The author demonstrated context window savings of 60–80% on common tool outputs (API responses, file reads, terminal output) by applying output compression.
- HN commenters shared similar patterns they'd developed — some using a small/fast LLM as the summarizer to avoid adding latency.
- One commenter noted this is essentially the 'perception-action loop' problem in cognitive architectures: you need selective attention, not full sensory input.
How to Apply
- When building MCP servers, define an output schema for each tool that specifies what fields are relevant for the agent — filter raw outputs to only those fields.
- For tools that return large text (documentation, file contents), add a max_tokens parameter and truncate with a summary suffix rather than passing the full text.
- Consider using a fast/cheap LLM (like GPT-4o-mini or Haiku) as a summarizer for tool outputs before they reach the main agent model — the cost savings on the main model usually outweigh the summarizer cost.
- Log both the raw tool output and the compressed version during development to tune your compression strategies.
Code Example
# MCP-only installation (tool use only)
claude mcp add context-mode -- npx -y context-mode
# Plugin Marketplace installation (includes auto-routing hook + slash command)
/plugin marketplace add mksglu/claude-context-mode
/plugin install context-mode@claude-context-modeTerminology
Related Papers
Training an LLM in Swift, Part 1: Taking matrix mult from Gflop/s to Tflop/s
Apple Silicon에서 Swift로 직접 행렬 곱셈 커널을 구현하며 CPU, SIMD, AMX, GPU(Metal)를 단계별로 최적화해 Gflop/s에서 Tflop/s 수준까지 성능을 높이는 과정을 상세히 설명한 글이다. 프레임워크 없이 LLM 학습의 핵심 연산을 밑바닥부터 구현하고 싶은 개발자에게 Apple Silicon의 성능 한계를 체감할 수 있는 드문 자료다.
Removing fsync from our local storage engine
FractalBits가 fsync 없이 SSD 전용 KV 스토리지 엔진을 구현해 동일 조건 대비 약 65% 높은 쓰기 성능을 달성한 설계 방법을 공유했다. fsync의 메타데이터 오버헤드를 피하기 위해 사전 할당, O_DIRECT, SSD 원자 쓰기 단위 정렬 저널을 조합한 구조가 핵심이다.
Google Chrome silently installs a 4 GB AI model on your device without consent
Google Chrome이 사용자 동의 없이 Gemini Nano 4GB 모델 파일을 자동 다운로드하고, 삭제해도 재다운로드되는 문제가 발견됐다. GDPR 위반 가능성과 수십억 대 기기에 적용될 때의 환경 비용 문제가 제기되고 있다.
How OpenAI delivers low-latency voice AI at scale
OpenAI redesigned its WebRTC stack to serve real-time voice AI to over 900 million users, detailing the design decisions and trade-offs of a relay + transceiver split architecture.
Efficient Test-Time Inference via Deterministic Exploration of Truncated Decoding Trees
Deterministic Leaf Enumeration (DLE) cuts self-consistency’s redundant sampling by deterministically exploring a tree of possible sequences, simultaneously improving math/code reasoning performance and speed.