Overview

The Flickr 8k Audio Caption Corpus contains 40,000 spoken captions of 8,000 natural images. It was collected in 2015 to investigate multimodal learning schemes for unsupervised speech pattern discovery. For a description of the corpus, see:

D. Harwath and J. Glass, "Deep Multimodal Semantic Embeddings for Speech and Images," 2015 IEEE Automatic Speech Recognition and Understanding Workshop, pp. 237-244, Scottsdale, Arizona, USA, December 2015 (PDF)

This corpus only includes audio recordings, and not the original text captions or associated images. The original Flickr 8k corpus, containing the original text captions and links to the source images, is available for download here.

If you use this data in your own publications, please cite both our ASRU paper above as well as the Hockenmaier Group's original paper on the Flickr 8k text caption corpus.

This data is distributed under the Creative Commons Attribution-ShareAlike (CC BY-SA) license (link).