Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches

• Published in: Animal cognition Vol. 25; no. 2; pp. 249 - 274
• Main Authors: Varkevisser, Judith M., Simon, Ralph, Mendoza, Ezequiel, How, Martin, van Hijlkema, Idse, Jin, Rozanda, Liang, Qiaoyi, Scharff, Constance, Halfwerk, Wouter H., Riebel, Katharina
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.04.2022; Springer Nature B.V
• Subjects: Animals; Behavioral Sciences; Biomedical and Life Sciences; Birds; Color; Cues; Exposure; Finches; Image enhancement; Juveniles; Learning; Life Sciences; Male; Minors; Original Paper; Playback; Playbacks; Psychology Research; Singing; Social behavior; Social factors; Song; Sound production; Taeniopygia guttata; Video; Visual discrimination learning; Visual observation; Visual stimuli; Vocalization behavior; Vocalization, Animal; Zoology; Vocal development; Video tutors; Multimodal communication; Bird song
• ISSN: 1435-9448; 1435-9456
• DOI: 10.1007/s10071-021-01547-8

Bird song and human speech are learned early in life and for both cases engagement with live social tutors generally leads to better learning outcomes than passive audio-only exposure. Real-world tutor–tutee relations are normally not uni- but multimodal and observations suggest that visual cues related to sound production might enhance vocal learning. We tested this hypothesis by pairing appropriate, colour-realistic, high frame-rate videos of a singing adult male zebra finch tutor with song playbacks and presenting these stimuli to juvenile zebra finches ( Taeniopygia guttata ). Juveniles exposed to song playbacks combined with video presentation of a singing bird approached the stimulus more often and spent more time close to it than juveniles exposed to audio playback only or audio playback combined with pixelated and time-reversed videos. However, higher engagement with the realistic audio–visual stimuli was not predictive of better song learning. Thus, although multimodality increased stimulus engagement and biologically relevant video content was more salient than colour and movement equivalent videos, the higher engagement with the realistic audio–visual stimuli did not lead to enhanced vocal learning. Whether the lack of three-dimensionality of a video tutor and/or the lack of meaningful social interaction make them less suitable for facilitating song learning than audio–visual exposure to a live tutor remains to be tested.