Datasets Resource Center

Created and curated for teams working on world-class AI applications

Off-the-Shelf Datasets

Our high-quality licensable datasets to jumpstart your AI projects

We offer an extensive catalog of ‘Off-the-Shelf’ datasets, with over 250 licensable datasets comprising of over 11,000 hours of audio, over 25,000 images and over 8.7 million words across 80 languages and multiple dialects. Our Off-the-Shelf datasets are designed to effectively improve accuracy, overall performance and to quickly deliver high quality datasets at scale for specific AI program needs. Among our offerings, you will find datasets across multiple data types, including image, video, speech, audio, and text. We are constantly building new datasets to meet the needs of our global customer base.

Open-Source Public Datasets

Curated recommendations from our data scientists for your Al projects

Machine Learning and Artificial Intelligence applications require significant amounts of data to train. You can search for open datasets to access, modify, reuse, and share, from our recommended resources. Use these publicly available datasets to influence the development of AI and ML applications or if you want a simple dataset to benchmark a solution or compare different algorithms before tackling a real dataset. These open datasets are a great option to consider for access to data that lies outside the scope of your organization.

Dataset Finders

Use Kaggle to find data sets, explore and build models and work with other data scientists and Machine Learning engineers. Explore and analyze a collection of over 50,000 public datasets on everything from bone x-rays to results from boxing bouts.

Explore over 500 data sets of the Machine Learning Repository from UC Irvine, through a searchable interface. Datasets range across many topics, vary in terms of size, from only a few cases (or “instances”) up to over 43 million and from only 1 or 2 variables (or “attributes”) to over a million variables.

Computer Vision

Computer vision enables computers to identify and process objects in images and videos in the same way that humans do, by emulating parts of the complexity of the human vision system. Leverage Machine Learning for image applications such as enabling self-driving cars to make sense of their surroundings, facial recognition applications, augmented and mixed reality or automate tasks finding symptoms in x-ray and MRI scans in healthcare. Build a robust Computer Vision model using a rich collection of Computer Vision datasets.

Accelerate AI development using 1000+ High-quality Open Datasets. Choose from 50+ application scenarios, 30+ annotation types, and 10+ data formats.

These datasets include diverse topics from recognizing objects to reconstructing a 3D room, from finding a person in a video to identifying a shirt in a photo. The datasets can be sorted by published date or topic, and users can search with keywords to locate images appropriate to their needs.

Use these open datasets to build facial recognition applications, virtual reality gadgets, sensory detection, holographic imaging and much more.

More than 3,000 Machine Learning Datasets. Find datasets by task and modality, compare usage over time, browse benchmarks and more.

Open-source datasets for Computer Vision Machine Learning models across a wide array of domains- animals, board games, self-driving cars, medicine, thermal imagery, aerial drone images, and even synthetically generated data. You can freely download images and annotations in any format: VOC XML, COCO JSON, YOLOv3 flat text files, even TFRecords.

Speech Corpora

Recording and transcribing new Speech Corpora to create acoustic models and train Speech Recognition engines can be time consuming and expensive. Use open databases of speech audio files and text transcriptions to quickly and cheaply building transcribed Speech orpora containing utterances from many speakers in a variety of acoustic conditions.

A central place for speech resources, OpenSLR hosts speech and language resources, such as training Corpora for Speech Recognition, and software related to Speech Recognition.

Candlewill

A collection of Speech Corpus for Automatic Speech Recognition (ASR) and Text-To-Speech (TTS).

Edresson

The dataset has 71,358 total number of words, with 13,311 distinct words, approximately 10 hours and 28 minutes of speech from a single speaker, recorded at 48Khz, containing a total of 3,632 audio files in Wave format. Audio files range from 0.67 to 50.08 seconds.

Designed to provide speech data for the acquisition of acoustic-phonetic knowledge and for the development and evaluation of Automatic Speech Recognition systems. Contains a total of 6300 sentences, 10 sentences spoken by each of 630 speakers from 8 major dialect regions of the United States.

VoxCeleb

Audio-visual dataset consisting of short clips of human speech, extracted from interview videos uploaded to YouTube. This dataset contains 7,000 + speakers, 1 million + utterances and 2,000 + hours of both audio and video.

msang

A Twitter Corpus built with the aim of representing and analyzing hate speech against some minority groups in Italy: immigrants in particular, but also Muslims and Roma. The contains the tweets' ID and their annotation.

VoxForge

Transcribed speech for use in Speech Recognition Engines; categorize and make available all submitted audio files (Speech Corpus) and Acoustic Models.

homink

A Korean read Speech Corpus of about 120 hours from the National Institute of Korean Language (NIKL).

siddiquelatif

URDU dataset contains emotional utterances of Urdu speech gathered from Urdu talk shows. It contains 400 utterances of four basic emotions: Angry, Happy, Neutral, and Emotion. There are 38 speakers (27 male and 11 female).

Common Voice dataset, an open-source dataset of voices, currently consists of over 7,000 validated hours in 60 languages and includes demographic metadata like age, sex, and accent that can help train the accuracy of Speech Recognition engines. Each entry in the dataset consists of a unique MP3 and corresponding text file.

A large database of sentences and translations to see examples of how words are used in the context of a sentence.

Made from audio talks and their transcriptions, the dataset contains 1495 audio talks in NIST sphere format (SPH), 1495 transcripts in STM format, dictionary with pronunciation (159, 848 entries) and selected monolingual data for language modeling.

Data Collection

If a more customized data set is needed for your specific use case, we provide data collection as a standalone service as well as a part of a multi-component deliverable such as an ASR speech database that typically includes audio data, transcription, pronunciation lexicon, and a language-specific document or an annotated image dataset. Our data collection services span a variety of data types and collection methodologies for a range of environments to best meet your unique data requirements.

Latest News and Resources

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/06/0d809d3f-test-2021-state-of-ai_1000000000000000000028-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/06/0d809d3f-test-2021-state-of-ai_1000000000000000000028-330x196.png" alt=""/> </picture>

Appen’s Annual State of AI Report Finds a Shift to Internal Efficiencies

Building AI in the EU

Building AI in the EU

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/06/Building-AI-in-the-EU-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/06/Building-AI-in-the-EU-1-330x196.png" alt="Building AI in the EU"/> </picture>

How to Get Started: Building Trustworthy AI in the European Union

Overcoming AI Deployment Challenges

Overcoming AI Deployment Challenges

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/05/Overcoming-Deployment-Challenges-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/05/Overcoming-Deployment-Challenges-1-330x196.png" alt="Overcoming AI Deployment Challenges"/> </picture>

Overcoming AI Deployment Challenges

Create Better AI

Create Better AI

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/04/To-Launch-AI-Successfully-Be-Prepared-to-Scale-2-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/04/To-Launch-AI-Successfully-Be-Prepared-to-Scale-2-330x196.png" alt="Create Better AI"/> </picture>

3 Things Business Decision-Makers Must Do to Create Better AI

Secure Transcription Services for Sensitive Data

Secure Transcription Services for Sensitive Data

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/06/How-to-Work-Out-Without-Traditional-Gym-Equipment-1-2-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/06/How-to-Work-Out-Without-Traditional-Gym-Equipment-1-2-330x196.png" alt="Secure Transcription Services for Sensitive Data"/> </picture>

Secure Transcription Services for Sensitive Data

Top Gaming Company Strengthens Customer Support Capabilities with AI

Top Gaming Company Strengthens Customer Support Capabilities with AI

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/05/Top-Gaming-Company-Strengthens-Customer-Support-Capabilities-with-AI-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/05/Top-Gaming-Company-Strengthens-Customer-Support-Capabilities-with-AI-330x196.png" alt="Top Gaming Company Strengthens Customer Support Capabilities with AI"/> </picture>

Top Gaming Company Strengthens Customer Support Capabilities with AI

Value of AI

Value of AI

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/05/The-Value-of-AI-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/05/The-Value-of-AI-330x196.png" alt="Value of AI"/> </picture>

The Value of AI: Exploring Opportunities and Challenges in AI Technology

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/05/Screen-Shot-2021-05-11-at-11.15.35-PM-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/05/Screen-Shot-2021-05-11-at-11.15.35-PM-330x196.png" alt=""/> </picture>

Response: Concerns regarding contractor onboarding

What is LiDAR

What is LiDAR

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/05/What-is-LiDAR-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/05/What-is-LiDAR-1-330x196.png" alt="What is LiDAR"/> </picture>

What is LiDAR?

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/04/iStock-1205026770-330x196.jpg.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/04/iStock-1205026770-330x196.jpg" alt=""/> </picture>

Appen Leads Industry in Creating AI That Works for Everyone

Leading with AI

Leading with AI

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/05/You-Cant-Just-Use-AI-You-Must-Lead-With-AI-1-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/05/You-Cant-Just-Use-AI-You-Must-Lead-With-AI-1-330x196.png" alt="Leading with AI"/> </picture>

You Can’t Just Use AI - You Must Lead With AI

Driving Quality in Your AI Training Data

Driving Quality in Your AI Training Data

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/04/technology-abstract-picture-id1148091792-330x196.jpg.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/04/technology-abstract-picture-id1148091792-330x196.jpg" alt="Driving Quality in Your AI Training Data"/> </picture>

Data-Centric Real World AI

Train AI EMEA 2021 Webinar

Train AI EMEA 2021 Webinar

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/04/Train-AI-EMEA_adobespark-330x196.jpg.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/04/Train-AI-EMEA_adobespark-330x196.jpg" alt="Train AI EMEA 2021 Webinar"/> </picture>

Train AI Summit EMEA 2021

An Introduction to Audio, Speech, and Language Processing

An Introduction to Audio, Speech, and Language Processing

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/04/An-Introduction-to-Audio-Speech-and-Language-Processing-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/04/An-Introduction-to-Audio-Speech-and-Language-Processing-330x196.png" alt="An Introduction to Audio, Speech, and Language Processing"/> </picture>

An Introduction to Audio, Speech, and Language Processing

to launch ai be prepared to scale

to launch ai be prepared to scale

<picture class="attachment-recommended size-recommended wp-post-image"> <source type="image/webp" srcset="https://resources.appen.com/wp-content/uploads/2021/04/To-Launch-AI-Successfully-Be-Prepared-to-Scale-330x196.png.webp"/> <img width="330" height="196" src="https://resources.appen.com/wp-content/uploads/2021/04/To-Launch-AI-Successfully-Be-Prepared-to-Scale-330x196.png" alt="to launch ai be prepared to scale"/> </picture>

To Launch AI Successfully, Be Prepared to Scale

View All Resources

Website for deploying AI with world class training data