We rewrote JSONata with AI in a day, saved $500k/year
TL;DR Highlight
Reco saved $500K annually by rewriting their Node.js-based JSONata evaluation pipeline in Go using Claude AI — but the HN community fired back with criticism: 'Why did you let this linger so long?' and 'Why didn't you use an existing Go library?'
Who Should Read
Backend engineers whose data pipelines waste money on cross-language RPC calls, or engineers considering using AI code generation tools to replace legacy components.
Core Mechanics
- Reco's security policy engine evaluates JSONata expressions against billions of events, but since JSONata's reference implementation is in JavaScript, it couldn't be used directly in Go services. They ended up running a dedicated Node.js jsonata-js pod on Kubernetes and having Go services call it via RPC — an architecture they maintained for years.
- This architecture required a round-trip of serialization → network transfer → evaluation → result serialization → return for every event, costing roughly $300K per year in compute alone, with costs growing as customers and detection rules increased.
- The solution was to port JSONata directly to Go. The approach mirrored Cloudflare's rapid rewrite strategy: migrate the official jsonata-js test suite to Go, then implement the evaluator until all tests pass.
- Using Claude as the AI tool, the rewrite was completed in a single day at a cost of roughly $400 in Claude tokens. Switching to Go inline execution eliminated RPC overhead, bringing the jsonata-js pod cost from $25K/month down to zero.
- Total savings were announced at $500K annually, which appears to include not only compute costs ($300K) but also deployment complexity and operational overhead from running two language stacks simultaneously.
- JSONata's reference JavaScript implementation is approximately 5,500 lines, while the AI-generated Go implementation is approximately 13,000 lines — the increase likely reflects the effort of expressing JavaScript's dynamic characteristics and JSONata's JS-based grammar nuances in Go.
- The rewritten Go implementation was validated against the official JSONata test suite, and after production deployment the dramatic cost reduction provided immediate internal proof of ROI.
Evidence
- "The core criticism wasn't about the 'AI rewrite' itself, but rather 'why was this left alone for so long?' The fact that the rewrite cost only $400 in Claude tokens implies the codebase wasn't that large — meaning an engineer could have ported it manually at a comparable scale. Many commenters expressed disbelief at years of wasted spending at roughly $300K/year, the equivalent of one full-time employee. Critics also pointed out that two existing Go JSONata implementations already existed, yet Reco never explained why they didn't use them. One of those, `github.com/jsonata-go/jsonata`, was itself built with Claude Code and Codex in early 2025, passes the official test suite, and runs in production — confirmed by a contributor who commented on the post. Many felt it was a shortcoming for an engineering blog not to explain why existing libraries were unsuitable. The benchmarking approach also came under fire: measuring performance at the app level captures the effect of eliminating RPC overhead, not the actual performance of the Go JSONata implementation itself. Without an isolated, apples-to-apples comparison of the JS and Go implementations, concerns arose that 'the AI-generated implementation might actually be slower.' Long-term maintainability of AI-generated code was another concern raised. The JSONata open-source project currently has 15 open PRs and 150 open issues, and Reco now owns a self-maintained fork of 13,000 lines of Go code. Commenters questioned how upstream changes would be tracked and whether that maintenance cost was factored into the savings calculation. There were also cynical predictions that 'posts like this will become more common' — a pattern of reframing basic architectural fixes as AI wins, followed by a vicious cycle of shipping AI-generated code without fully understanding it and accumulating new bugs over time. One commenter warned of a future where 'code output increases 100x and token costs double developer salaries, but actual impact remains minimal.'"
How to Apply
- "If your Go services call out to a Node.js, Python, or other language runtime via RPC or a sidecar, start by calculating the monthly compute cost of that component. If the annual cost exceeds tens of thousands of dollars, it's worth exploring an inline port using an AI coding tool like Claude Code or Cursor. The key prerequisite: secure the official test suite before porting so you have a clear standard for verifying behavioral equivalence. If you need to use JSONata in a Go pipeline, evaluate `github.com/jsonata-go/jsonata` (ported with AI in early 2025, passes the official test suite, production-verified) before rewriting from scratch like Reco did. If an existing library meets your requirements, you can use it without taking on maintenance burden. When using AI to rewrite a legacy component, follow this sequence: port the official test suite to the target language → have AI implement until tests pass → run isolated benchmarks to verify performance before production deployment. The reason the benchmarking in this blog post drew criticism is precisely that it only looked at system-level metrics without isolated verification. When forking an open-source library with AI-generated code, define your maintenance strategy upfront. Either designate someone responsible for periodically syncing upstream updates, or explicitly decide to freeze features at the fork version and manually apply only security patches — failing to do this will create technical debt down the line."
Terminology
Related Papers
Show HN: Smart model routing directly in Claude, Codex and Cursor
프롬프트마다 적합한 AI 모델을 50ms 이내에 자동으로 선택해주는 프록시 라우터로, API 비용을 40~70% 절감할 수 있다고 주장하는 오픈소스 도구다. 단, 프롬프트 캐싱 손실 문제로 커뮤니티 반응은 엇갈린다.
Show HN: Overfitted a 900KB Transformer to Compress a 100MB CSV into 7MB
단일 파일을 통째로 암기하도록 Transformer를 과적합(overfitting)시킨 뒤 arithmetic coding으로 압축하는 실험으로, 100MB CSV를 7MB(~0.5 bits/byte)까지 줄이는 데 성공했다. 모델이 '범용 이해' 대신 '특정 파일 완전 암기'를 목표로 한다는 점에서 전통적 ML 학습과 정반대 방향이라 흥미롭다.
Ask HN: Anthropic banned me from using Claude Code and I don't know what to do
VPN 사용 또는 동일 카드 재사용으로 Anthropic Claude Code 계정이 이유 불명으로 정지당한 사용자의 사례와, 커뮤니티에서 나온 대안 및 우회 방법 논의.
Moebius: 0.2B image inpainting model with 10B-level performance
FLUX.1-Fill-Dev(11.9B) 대비 2% 미만의 파라미터(0.22B)로 동급 또는 그 이상의 인페인팅 품질을 달성하면서 추론 속도는 15배 빠른 경량 모델. 소비자용 GPU나 엣지 디바이스에서도 고품질 인페인팅이 가능해진다.
AI Compute Extensions (ACE) Specification
x86 Ecosystem Advisory Group이 행렬 곱셈과 저정밀도 데이터 포맷을 하드웨어 수준에서 가속하는 새로운 x86 명령어 확장 스펙 ACE를 공개했다. ML 워크로드를 CPU에서 더 효율적으로 돌리기 위한 ISA(명령어 집합 구조) 수준의 변화라 향후 AI 추론 환경에 영향을 줄 수 있다.
Show HN: High-Res Neural Cellular Automata
EPFL과 Google Research가 공동 개발한 Neural Cellular Automata(NCA)를 고해상도로 확장하는 기법으로, 기존 NCA의 해상도 한계를 경량 신경망 디코더로 극복한 SIGGRAPH 2026 논문이다.