Testing Claude Fable 5.1 with Animated Pelicans
This article explores testing Claude Fable 5.1 AI model using animated pelicans as a creative benchmark to evaluate its performance and capabilities.
Generating an animated pelican might not be the first task that comes to mind when evaluating a new AI model, but it reveals something important about how well these systems translate instructions into working code. When Claude Fable 5.1 arrived on September 1st, 2026, I put it through this unconventional test.
Anthropic claims Fable 5.1 “sets a new standard for coding, knowledge work, and long-running problem-solving tasks.” The announcement emphasizes scientific research capabilities, but for developers, the real question is whether these improvements translate to everyday coding tasks.
Benchmarks
The standout number in Anthropic’s announcement is a 52.6% score on Terminal-Bench-Science 0.1, a benchmark first announced on August 27th. This represents a substantial jump from Fable 5’s 24.7% score on the same benchmark. For context, Opus 5 achieved 29.0% and GPT-5.6 Sol scored 22.4%.
Other benchmarks show more modest improvements. While Anthropic reports “slightly improved scores” across the board, none approach the dramatic gains seen in the science-focused benchmark. This raises questions about whether Fable 5.1’s strengths lie primarily in specialized scientific problem-solving rather than general-purpose tasks.
The model offers five reasoning levels: low, medium, high, xhigh, and max. These settings allow developers to balance response quality against computational cost, though the announcement doesn’t specify how these levels affect performance on different types of tasks.
How to Run It
Fable 5.1 is available through Anthropic’s standard API and interface. Developers can access it immediately, with the option to try it for free initially. The reasoning level settings provide granular control over how much computational effort the model applies to each request.
For coding tasks like generating animations, developers can start with lower reasoning levels for simple requests and scale up for more complex implementations. The pelican animation test - a task that requires translating a creative request into functional code with proper syntax and logic - provides a practical gauge of the model’s coding capabilities beyond benchmark scores.
Limitations
The dramatic performance gap between the Terminal-Bench-Science benchmark and other metrics suggests Fable 5.1 may be optimized for specific use cases. The 52.6% science score represents more than double the previous version’s performance, while other improvements are described only as “slightly improved.”
This specialization pattern isn’t necessarily a drawback, but developers should understand where the model excels. Scientific research tasks appear to be a primary focus, which may or may not align with typical development workflows.
The announcement doesn’t provide detailed comparisons for coding benchmarks specifically, making it difficult to predict performance on software development tasks based solely on the published numbers.
Verdict
Fable 5.1 demonstrates that benchmark performance doesn’t always predict real-world utility. A model that excels at scientific problem-solving can also handle creative coding tasks effectively, even if the connection between these capabilities isn’t immediately obvious.
The five-tier reasoning system offers practical flexibility for developers who need to balance quality and cost. For teams working on scientific computing or research-heavy applications, the Terminal-Bench-Science improvements suggest meaningful gains. For general development work, the “slightly improved” scores on other benchmarks indicate incremental rather than revolutionary progress.
Whether generating animated pelicans or solving complex scientific problems, Fable 5.1 represents another step forward in AI coding assistance, with particular strength in specialized domains.
Source: simonwillison.net
Related Tips
Claude Code Schedulers: Local Execution Options
Claude Code Schedulers explores local execution options for automating code tasks, comparing cron jobs, systemd timers, and task scheduling tools to run
Claude Fable 5 Returns with Auto Opus 4.8 Routing
Claude Fable 5 launches with enhanced Auto Opus 4.8 routing capabilities, offering improved performance and intelligent request handling for more efficient AI
Memoriki: A Memory Layer for Claude Code
Memoriki combines an LLM wiki with the MemPalace MCP server to give Claude Code structured notes, semantic search, and an entity graph.