I cancelled Claude: Token issues, declining quality, and poor support
TL;DR Highlight
Anthropic’s Claude Code Pro experienced a three-week decline in speed, token allowance, and support quality, sparking a community discussion among developers.
Who Should Read
Developers currently paying for and using AI coding tools like Claude Code, Copilot, and Codex in production environments, particularly those considering alternatives due to recent changes in Claude’s performance or token limits.
Core Mechanics
- The author initially found Claude Code Pro satisfactory in terms of speed, token allowance, and quality, but experienced a rapid deterioration over the following three weeks.
- A sudden spike to 100% token usage occurred after just two simple queries to Claude Haiku following a 10-hour break, with no clear explanation for the consumption.
- Customer support provided only generic responses from an AI bot, followed by a copy-pasted reply from a human agent, and ultimately closed the ticket with a disclaimer that it might not be monitored.
- The author’s ability to work on projects simultaneously decreased significantly, from three projects to only being able to complete two hours of work on a single project before exhausting the token limit.
- When asked to refactor a project, Claude Opus proposed a workaround—adding a generic initializer to ui-events.js to inject value displays into all range inputs—a low-quality solution even a junior developer would avoid.
- Opus consumed approximately 50% of the token allowance in five hours while implementing this workaround, wasting tokens before producing a usable result.
- Conversation cache issues were also present, requiring the model to reload the codebase from scratch after periods of inactivity, effectively doubling the cost of initial loading.
- The author is also comparing Claude Code to GitHub Copilot, OpenAI Codex, and locally-run Qwen3.5-9B models using OMLX and Continue.
Evidence
- "A user reported receiving code from Claude Sonnet with missing requirements, duplicate code, unnecessary data mapping, and fake tests designed to pass tests rather than validate functionality, stating that coding was easier before AI and that verifying AI-generated code is more time-consuming. Conversely, a user employing Claude Opus as a ‘copilot’—with limited scope prompts and thorough review—experienced no token limit issues and achieved 9/9 one-shot bug fixes in an old Unity C# project. Multiple colleagues reported a noticeable decline in Claude’s performance over the past two months, with Claude 4.6 exhibiting forgetfulness and poor decision-making, and 4.7 offering little improvement. Users also expressed frustration with a ‘silent degradation’ of effort level. Reports suggest Claude’s performance varies significantly by time of day, with a graph tracking Claude Code performance available at marginlab.ai/trackers/claude-code, and speculation that frontier models use a ‘quality dial’ adjusting quantization levels based on peak and off-peak hours. A user who switched to OpenAI Codex (GPT 5.4/5.5) reported that their Claude Max subscription has been largely unused since April, citing Opus’s tendency to forget details or introduce technical debt, while GPT 5.4+ considers edge cases and reduces subsequent errors."
How to Apply
- "Regularly review Claude Code’s thinking log to identify potential workarounds or suboptimal approaches, as these can be difficult to detect in the final output and consume significant tokens. Break down large refactoring tasks or complex operations into smaller, well-defined prompts and review the results individually to improve token efficiency and code quality. Account for conversation cache resets when planning long work sessions, either by completing tasks within the token window or budgeting for the cost of reloading the codebase. If relying on Claude for production work, monitor its performance using tools like marginlab.ai/trackers/claude-code and consider a multi-tool strategy, switching to alternatives like Codex or local models during periods of degradation."
Code Example
# Claude Code’s maximum output token setting (environment variable mentioned in the comments)
export CLAUDE_CODE_MAX_OUTPUT_TOKENS=8000
# Local inference alternative (stack used by the author)
# OMLX + Continue extension + Qwen3.5-9B model combination
# When directly prompting the model with the llama_cpp web UI
# Fast one-shot processing without the Claude Code agent layerTerminology
Related Papers
Show HN: Mindwalk – Replay coding-agent sessions on a 3D map of your codebase
Claude Code나 Codex 같은 AI 코딩 에이전트가 세션 중 코드베이스의 어떤 파일을 탐색하고 수정했는지를 3D 지도 형태로 시각화해서 재생해주는 로컬 도구다. 에이전트가 작업을 어떻게 이해했는지 한눈에 파악할 수 있다.
Ghost Font: A font that humans can read but AI cannot
움직임(모션)을 이용해 글자를 표현해서 AI 모델이 정적 이미지 분석으로는 메시지를 해독하지 못하게 막는 실험적 프로젝트인데, 커뮤니티에서는 이미 GPT-5.6, Claude Opus 등으로 해독에 성공한 사례가 속출해 실효성 논쟁이 뜨겁다.
GPT-5.6, Grok 4.5, Claude, and Muse Spark build the same 4 apps
12개 LLM 모델에게 레이캐스터 미로, 루빅스 큐브, 계산기, Game of Life 앱을 각각 5번씩 만들게 해서 성공률·비용·속도를 비교한 실전 벤치마크다. GPT-5.6 Sol이 전반적으로 가장 일관된 결과를 냈고, Grok 4.5는 가성비 면에서 눈에 띄었다.
Benchmarking coding agents on Databricks' multi-million line codebase
Databricks가 자사 실제 코드베이스를 기반으로 여러 AI 코딩 에이전트의 성능과 비용을 직접 측정했고, 모델 토큰 가격과 실제 태스크 비용이 전혀 다르다는 점, 그리고 오픈소스 모델이 이제 최상위 수준에 도달했다는 점을 확인했다.
Estimating Uncertainty from Reasoning: A Large-Scale Study of Multi- and Crosslingual MCQA Performance in LLMs
LLM이 저자원 언어 질문을 받을 때 영어로 추론하게 하면 불확실성 추정 성능이 고자원 언어 수준으로 올라온다.
LLM-as-a-Verifier: A General-Purpose Verification Framework
LLM의 토큰 확률 분포를 활용해 discrete 점수 대신 continuous 점수를 뽑아내면, 추가 학습 없이 코딩·로봇·의료 에이전트 평가 정확도를 SOTA로 끌어올릴 수 있다.