論文 / arXiv:2610.22342
Spark-0: Scaling Spatially Aligned Tactile Pretraining for Robot Dexterous Manipulation
PLAIN SUMMARY / やさしい要約
ロボットはカメラ映像だけだと、指先で「触って分かる」情報を取りこぼしやすく、細かな作業が難しくなります。この研究は、触覚を学習に使うだけでなく、状況に応じて触覚なしでも動かせるモデルを提案しています。学習のために、人が触覚手袋を使って作業した1,000時間分のデータも用意しました。たとえるなら、練習中は手元を触って確かめながら覚え、試合では目だけでも手触り込みでも戦えるようにする、という設計です。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
Generalist robot policies benefit from large-scale visual pretraining but often struggle with contact-rich dexterous manipulation, where force, compliance, and incipient slip are hard to observe from images. We present Spark-0, a spatially aligned vision-tactile-language-action (VTLA) model that uses touch in two complementary ways. During pretraining, image-space contact maps derived from tactile gloves, together with features from a frozen 3D geometry teacher, supervise the visual tokens; these objectives are removed at inference. In parallel, a tactile pathway encodes regional force histories and 3D taxel states to condition the action expert. A single checkpoint therefore supports both vision-only and tactile-conditioned deployment. To scale this supervision, we build HumanTouch, a 1,000-hour dataset of full-hand tactile human manipulation, and pretrain Spark-0 on it together with egocentric video, robot data, and simulation. We also release SparkArena, which pairs vision-only simulated tasks with tactile-conditioned real-robot tasks on one dexterous embodiment. Spark-0 achieves the highest mean success rate on both SparkArena tracks and ranks first on all eight aggregate metrics of the Ego Humanoid Manipulation Benchmark. Compared with vision-only pretraining on the same data and compute with touch discarded, retaining the touch of 1,000 hours of HumanTouch raises vision-only success on Ego Humanoid from 52.5% to 71.7%, and success on SparkArena-Real, where touch is also used at deployment, from 44.0% to 52.0%, indicating that touch serves not only as a policy input but also as scalable supervision for dexterous visuomotor pretraining. The Website is available at: https://xsparkai.com/Spark-0.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
