Datasets Resource Center

Created and curated for teams working on world-class AI applications

Off-the-Shelf Datasets

Our high-quality licensable datasets to jumpstart your AI projects

We offer an extensive catalog of ‘Off-the-Shelf’ datasets, with over 250 licensable datasets comprising of over 11,000 hours of audio, over 25,000 images and over 8.7 million words across 80 languages and multiple dialects. Our Off-the-Shelf datasets are designed to effectively improve accuracy, overall performance and to quickly deliver high quality datasets at scale for specific AI program needs. Among our offerings, you will find datasets across multiple data types, including image, video, speech, audio, and text. We are constantly building new datasets to meet the needs of our global customer base.

Open-Source Public Datasets

Curated recommendations from our data scientists for your Al projects

Machine Learning and Artificial Intelligence applications require significant amounts of data to train. You can search for open datasets to access, modify, reuse, and share, from our recommended resources. Use these publicly available datasets to influence the development of AI and ML applications or if you want a simple dataset to benchmark a solution or compare different algorithms before tackling a real dataset. These open datasets are a great option to consider for access to data that lies outside the scope of your organization.

Dataset Finders

Use Kaggle to find data sets, explore and build models and work with other data scientists and Machine Learning engineers. Explore and analyze a collection of over 50,000 public datasets on everything from bone x-rays to results from boxing bouts.

Explore over 500 data sets of the Machine Learning Repository from UC Irvine, through a searchable interface. Datasets range across many topics, vary in terms of size, from only a few cases (or “instances”) up to over 43 million and from only 1 or 2 variables (or “attributes”) to over a million variables.

Computer Vision

Computer vision enables computers to identify and process objects in images and videos in the same way that humans do, by emulating parts of the complexity of the human vision system. Leverage Machine Learning for image applications such as enabling self-driving cars to make sense of their surroundings, facial recognition applications, augmented and mixed reality or automate tasks finding symptoms in x-ray and MRI scans in healthcare. Build a robust Computer Vision model using a rich collection of Computer Vision datasets.

Accelerate AI development using 1000+ High-quality Open Datasets. Choose from 50+ application scenarios, 30+ annotation types, and 10+ data formats.

These datasets include diverse topics from recognizing objects to reconstructing a 3D room, from finding a person in a video to identifying a shirt in a photo. The datasets can be sorted by published date or topic, and users can search with keywords to locate images appropriate to their needs.

Use these open datasets to build facial recognition applications, virtual reality gadgets, sensory detection, holographic imaging and much more.

More than 3,000 Machine Learning Datasets. Find datasets by task and modality, compare usage over time, browse benchmarks and more.

Open-source datasets for Computer Vision Machine Learning models across a wide array of domains- animals, board games, self-driving cars, medicine, thermal imagery, aerial drone images, and even synthetically generated data. You can freely download images and annotations in any format: VOC XML, COCO JSON, YOLOv3 flat text files, even TFRecords.

Speech Corpora

Recording and transcribing new Speech Corpora to create acoustic models and train Speech Recognition engines can be time consuming and expensive. Use open databases of speech audio files and text transcriptions to quickly and cheaply building transcribed Speech orpora containing utterances from many speakers in a variety of acoustic conditions.

A central place for speech resources, OpenSLR hosts speech and language resources, such as training Corpora for Speech Recognition, and software related to Speech Recognition.

Candlewill

A collection of Speech Corpus for Automatic Speech Recognition (ASR) and Text-To-Speech (TTS).

Edresson

The dataset has 71,358 total number of words, with 13,311 distinct words, approximately 10 hours and 28 minutes of speech from a single speaker, recorded at 48Khz, containing a total of 3,632 audio files in Wave format. Audio files range from 0.67 to 50.08 seconds.

Designed to provide speech data for the acquisition of acoustic-phonetic knowledge and for the development and evaluation of Automatic Speech Recognition systems. Contains a total of 6300 sentences, 10 sentences spoken by each of 630 speakers from 8 major dialect regions of the United States.

VoxCeleb

Audio-visual dataset consisting of short clips of human speech, extracted from interview videos uploaded to YouTube. This dataset contains 7,000 + speakers, 1 million + utterances and 2,000 + hours of both audio and video.

msang

A Twitter Corpus built with the aim of representing and analyzing hate speech against some minority groups in Italy: immigrants in particular, but also Muslims and Roma. The contains the tweets' ID and their annotation.

VoxForge

Transcribed speech for use in Speech Recognition Engines; categorize and make available all submitted audio files (Speech Corpus) and Acoustic Models.

homink

A Korean read Speech Corpus of about 120 hours from the National Institute of Korean Language (NIKL).

siddiquelatif

URDU dataset contains emotional utterances of Urdu speech gathered from Urdu talk shows. It contains 400 utterances of four basic emotions: Angry, Happy, Neutral, and Emotion. There are 38 speakers (27 male and 11 female).

Common Voice dataset, an open-source dataset of voices, currently consists of over 7,000 validated hours in 60 languages and includes demographic metadata like age, sex, and accent that can help train the accuracy of Speech Recognition engines. Each entry in the dataset consists of a unique MP3 and corresponding text file.

A large database of sentences and translations to see examples of how words are used in the context of a sentence.

Made from audio talks and their transcriptions, the dataset contains 1495 audio talks in NIST sphere format (SPH), 1495 transcripts in STM format, dictionary with pronunciation (159, 848 entries) and selected monolingual data for language modeling.

Data Collection

If a more customized data set is needed for your specific use case, we provide data collection as a standalone service as well as a part of a multi-component deliverable such as an ASR speech database that typically includes audio data, transcription, pronunciation lexicon, and a language-specific document or an annotated image dataset. Our data collection services span a variety of data types and collection methodologies for a range of environments to best meet your unique data requirements.

Latest News and Resources

The Rise in Computer Vision Datasets & How It Benefits Organizations

The Rise in Computer Vision Datasets & How It Benefits Organizations

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2022/01/The-Rise-in-Computer-Vision-Datasets-How-It-Benefits-Organizations-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2022/01/The-Rise-in-Computer-Vision-Datasets-How-It-Benefits-Organizations-330x196.png" alt="The Rise in Computer Vision Datasets & How It Benefits Organizations"/> </picture>

The Rise in Computer Vision Datasets & How It Benefits Organizations

Top 5 Predictions About the Future of AI and Data

Top 5 Predictions About the Future of AI and Data

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2022/01/Top-5-Predictions-About-the-Future-of-AI-and-Data-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2022/01/Top-5-Predictions-About-the-Future-of-AI-and-Data-1-330x196.png" alt="Top 5 Predictions About the Future of AI and Data"/> </picture>

Top 5 Predictions About the Future of AI and Data

Managed Services in AI

Managed Services in AI

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2022/01/Managed-Services-in-AI-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2022/01/Managed-Services-in-AI-1-330x196.png" alt="Managed Services in AI"/> </picture>

What are Managed Services in AI?

Content Relevance

Content Relevance

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/01/Content-Relevance-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/01/Content-Relevance-330x196.png" alt="Content Relevance"/> </picture>

Content Relevance: All You Need To Know About Serving Relevant Content To Your Customers

Johns Hopkins University

Johns Hopkins University

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/12/Johns-Hopkins-University-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/12/Johns-Hopkins-University-330x196.png" alt="Johns Hopkins University"/> </picture>

Johns Hopkins University Uses AI to Study Behavioral Neuroscience Reflected in How Spiders Build Webs

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/12/iStock-1271866338-330x196.jpg.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/12/iStock-1271866338-330x196.jpg" alt=""/> </picture>

Apache Log4J Security Update

What is Synthetic Data?

What is Synthetic Data?

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/07/What-is-Synthetic-Data_-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/07/What-is-Synthetic-Data_-330x196.png" alt="What is Synthetic Data?"/> </picture>

What is Synthetic Data?

natural language processing

natural language processing

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/12/NLP-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/12/NLP-330x196.png" alt="natural language processing"/> </picture>

Natural Language Processing - Connecting The World through Language With AI

Realeyes

Realeyes

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/12/Realeyes-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/12/Realeyes-1-330x196.png" alt="Realeyes"/> </picture>

Realeyes Accelerates Video Attention and Emotion Analysis with Scalable Annotation Solution

Automatic Speech Recognition

Automatic Speech Recognition

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/12/What-is-Automatic-Speech-Recognition-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/12/What-is-Automatic-Speech-Recognition-330x196.png" alt="Automatic Speech Recognition"/> </picture>

What is Automatic Speech Recognition?

What is Active Learning?

What is Active Learning?

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/11/What-is-Active-Learning_-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/11/What-is-Active-Learning_-1-330x196.png" alt="What is Active Learning?"/> </picture>

What is Active Learning?

25 Year Anniversary

25 Year Anniversary

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/11/25-Year-Anniversary-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/11/25-Year-Anniversary-330x196.png" alt="25 Year Anniversary"/> </picture>

25 Year Anniversary

Data Labeling Tools: How to Level Up Your Process

Data Labeling Tools: How to Level Up Your Process

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/11/Data-Labeling-Tools_-How-to-Level-Up-Your-Process-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/11/Data-Labeling-Tools_-How-to-Level-Up-Your-Process-1-330x196.png" alt="Data Labeling Tools: How to Level Up Your Process"/> </picture>

Data Labeling Tools: How to Level up Your Process

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/11/iStock-1061332616-330x196.jpg.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/11/iStock-1061332616-330x196.jpg" alt=""/> </picture>

Appen, a Leader in AI Development with World Class Training Data, Launches Japan-based Team Aimed to Accelerate Growth in the Japanese Market

Data-Centric Computer Vision eBook

Data-Centric Computer Vision eBook

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/09/featured-imagery-computerVision-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/09/featured-imagery-computerVision-330x196.png" alt="Data-Centric Computer Vision eBook"/> </picture>

The Future of Computer Vision is Data-Centric

View All Resources

Website for deploying AI with world class training data