The Self-Ask Trap: Why LLMs Are Unreliable Sources About Their Own Quirks

Calendar May 20, 2026
Agent-Tooling
Intermediate, Advanced
Model-Research, Adapter-Development, Fact-Checking
Self-Ask, Introspection, Model-Research, Kimi, Litellm, Validation, Anti-Patterns
Moonshot, Litellm, Curl

The Self-Ask Trap#

Practitioners ask the LLM about itself as a research shortcut: “What are your common quirks? What temperature should I use? Do you need reasoning_content echoed in multi-turn?” The output looks plausible, often cites specific behaviors, sometimes includes API parameter names. It is often wrong.

The 2026-05-20 kimi-k2.6 tuning research surfaced a clean example. Self-ask said one thing. Documentation, partner adapter source, GitHub issues, and direct API probes said the opposite. The model is provably wrong about itself, and the failure mode is structural — not specific to kimi.