XCoT-VLA: Executable Chain-of-Thought for Vision-Language-Action Driving· XCoT-VLA:适用于视觉-语言-行动驱动的可执行思维链
Vision-Language-Action (VLA) models can connect scene understanding, semantic reasoning, and trajectory generation for autonomous driving. However, verbose natural-language Chain-of-Thought (CoT) is poorly suited to real-time control because it is open-ended, costly to decode, and difficult to optimize as an action-facing representation. We propose XCoT-VLA, which replaces descriptive rationales with compact executable CoT tokens learned from automatically constructed Reason-Action supervision. Logged trajectories provide action evidence, while scene context supplies causal semantics. The predicted XCoT sequence remains in context and conditions fixed trajectory queries through shared multimodal self-attention. Deterministic token-function routing applies the Reason FFN to XCoT tokens and
提出可执行思维链模型XCoT-VLA用于自动驾驶的视觉-语言-行动结合。
- 核心方法
- 通过自动构建的理据-行动监督学习紧凑可执行思维链令牌,结合场景上下文和行动证据。
- 适合谁读
- 研究者 / 工程师
- 要解决的问题
- 解决传统视觉-语言-行动模型在实时控制中效率低下的问题。
- 关键实验
- 未提供
- 主要贡献
- 提高自动驾驶中场景理解和行动生成的实时性和效率。
- 意义与局限
- 为自动驾驶提供更高效的决策机制,但可能受限于具体应用场景的多样性和复杂性。