論文 / arXiv:2611.17332
ArchSpace: Recording, Reviewing, and Referencing LLM Architecture Research
PLAIN SUMMARY / やさしい要約
大きな言語モデルの「作り方」の工夫は、学習のしやすさや使うときのコストに影響します。でも、どの工夫がうまくいったのか、なぜダメだったのかは、外からは追いにくいことがあります。ArchSpaceは、提案とその根拠を同じ場所に残し、みんなで見直して次の研究が参照できるようにする仕組みです。たとえるなら、試作の記録を「あとで読める設計ノート」として整理し、次の人が同じ失敗や遠回りを減らすための場所です。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
Model architecture shapes the scaling behavior, training efficiency, and inference cost of LLMs, making it a central focus of both industry and academia. In industry, teams such as those behind DeepSeek, Qwen, and Kimi routinely introduce architectural innovations, yet public reports rarely document which ideas succeeded, which were abandoned, and why. In academia, limited compute and inconsistent baselines often restrict evaluations to small-scale, single-point comparisons, making it difficult to establish whether improvements hold at larger scales or translate into broader impact. ArchSpace addresses both gaps as a public platform for Recording, Reviewing, and Referencing Architecture Researc}: each proposal is recorded with its experiments and reasoning, reviewed by the community, and referenced by later work. To evaluate ideas before costly large-scale training, ArchSpace leverages scaling laws to predict model loss at larger scales from smaller experiments, a practice widely adopted in industry. We provide initial references that make the platform usable: Qwen3.5 and OLMo3 baselines, fitted scaling laws, and a reusable training recipe. Ideas validated through this review can in turn become new baselines, and ArchSpace thereby aims to broaden the range of ideas that shape the next generation of models.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
