論文 / arXiv:2610.37649
Can LLMs Uncover Hidden Physical Laws through Free Exploration?
PLAIN SUMMARY / やさしい要約
この研究は、いつもの物理とは違う「不思議な世界」をコンピュータ上に作り、AIが自分で気づいて調べられるかを確かめます。AIには「何を調べて」とは指示せず、見つけた変な現象を手がかりに実験して説明を作らせます。12種類のAIを比べたところ、GPT-6-Astraだけが発見率16.7%で、他の11個は0%でした。たとえるなら、答えの書いていない理科室で、まず「変だ」と気づき、次に確かめ方を考えられるかを見るテストです。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
Scientific discovery often begins with an unexpected observation that prompts a new research question. In a world with altered physical laws, can large language models (LLMs) notice unexpected behavior, such as heavier objects falling more slowly, and discover the law through experiments without being told what to investigate? To evaluate this ability, we introduce LongChang, an automated framework that creates simulated worlds with altered physics, where one or more laws differ from ordinary physics. The evaluated LLMs act as explorers, manipulating objects and building tools to investigate their own questions without research tasks or hints about these laws. Separate LLM agents generate and review scenes, review tool designs, and evaluate reports for correctness and experimental support using the altered physical laws and exploration records. These records guide scene evolution for further exploration, allowing the full cycle to run without human intervention. Among 12 LLMs, GPT-6-Astra achieves a discovery rate of 16.7%, while the other 11 score 0%. The exploration records reveal uninvestigated anomalies and only partial identification of the altered physical laws.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
