Generating Diverse Code Explanations using the GPT-3 Large Language Model

Who Should Read

Developers and researchers interested in automated code documentation, code comprehension tooling, and using LLMs for developer education.

Core Mechanics

• GPT-3 can generate diverse natural language explanations for the same code snippet by varying the prompt perspective (what it does, why it exists, how it works)
• Different prompting strategies yield explanations of varying quality and target audience appropriateness
• Higher-quality explanations are produced when prompts specify the intended audience (beginner vs. expert) and explanation type
• Multi-perspective explanations improve code comprehension more than single explanations in user studies
• Automatic evaluation metrics correlate moderately with human judgments of explanation quality

Evidence

• Human evaluation study comparing single vs. multi-perspective explanations on comprehension tasks
• Tested across multiple GPT-3 variants with different prompt templates
• Correlation analysis between automatic metrics (BLEU, BERTScore) and human ratings

How to Apply

• When auto-generating code comments or documentation, prompt the LLM with specific explanation angles: 'explain what this does', 'explain why this approach was chosen', 'explain this for a junior dev'.
• Generate multiple explanation candidates and use a ranker or human review to select the best for your documentation.
• Tailor the prompt's target audience specification to match your actual readers for better output quality.

Code Example

import openai

code_snippet = """
for i in range(5):
    print(i * 2)
"""

explanation_types = {
    "execution_trace": "Explain step-by-step what happens when this Python code runs, including the value of each variable at each step:",
    "term_definition": "Define the key programming terms and concepts used in this Python code in simple language for a beginner:",
    "hint": "Give a helpful hint about what this Python code does without giving away the full answer, suitable for a student learning to code:"
}

def generate_code_explanation(code, explanation_type):
    prompt = f"{explanation_types[explanation_type]}\n\n{code}"
    response = openai.ChatCompletion.create(
        model="gpt-3.5-turbo",  # or gpt-4
        messages=[
            {"role": "system", "content": "You are a helpful programming tutor."},
            {"role": "user", "content": prompt}
        ],
        max_tokens=300
    )
    return response.choices[0].message.content

# Generate explanations from three perspectives
for etype in explanation_types:
    print(f"=== {etype} ===")
    print(generate_code_explanation(code_snippet, etype))
    print()

Terminology

Related Papers

• Using Claude Code: The unreasonable effectiveness of HTML

  Claude Code 팀이 Markdown 대신 HTML을 LLM 출력 포맷으로 선호하기 시작한 이유와 그 실용적 장점을 정리한 글로, AI와 함께 문서/스펙/대시보드를 만드는 워크플로우에 직접적인 영향을 준다.

• When to Vote, When to Rewrite: Disagreement-Guided Strategy Routing for Test-Time Scaling

  Disagreement-guided routing boosts LLM accuracy on math and code by 3-7% with adaptive problem solving.

• Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application

  Five failure modes and eight practical solutions emerged after five days of running on-device SLMs (Gemma 4 E2B, Qwen3 0.6B) with Wordle.

• Dynamic Context Evolution for Scalable Synthetic Data Generation

  A framework that completely eliminates duplication and repetition in large-scale synthetic data generation with LLMs using three mechanisms (VTS + Semantic Memory + Adaptive Prompt).

• 90%+ fewer tokens per session by reading a pre-compiled wiki instead of exploring files cold. Built from Karpathy's workflow.

  This is a workflow sharing post about how pre-organizing a codebase in Wiki format can reduce token usage per Claude session by more than 90% instead of directly exploring the codebase every time.