Instruction-aligned hierarchical waypoint planner for vision-and-language navigation in continuous environments

• Published in: Pattern analysis and applications : PAA Vol. 27; no. 4
• Main Authors: He, Zongtao, Wang, Naijia, Wang, Liuyi, Liu, Chengju, Chen, Qijun
• Format: Journal Article
• Language: English
• Published: London Springer London 01.12.2024; Springer Nature B.V
• Subjects: Alignment; Computer Science; Intelligent agents; Misalignment; Navigation; Original Article; Pattern analysis; Pattern Recognition; Vision; Waypoints; Vision-and-language navigation in continuous environments; Hierarchical decision models; Embodied cognition; Multi-modal fusion

Developing agents to follow language instructions is a compelling yet challenging research topic. Recently, vision-and-language navigation in continuous environments has been proposed to explore the multi-modal pattern analysis and mapless navigation abilities of intelligent agents. However, current...