Data Products › Off-the-Shelf AI Training Datasets

Off-the-Shelf AI Training Datasets

Not every project requires custom data collection. Appen's off-the-shelf dataset catalogue provides immediately available, pre-licensed training data across speech, image, video, text, and multimodal formats, curated for AI and ML applications and ready to integrate into your training pipeline without a bespoke collection programme.

Explore our datasets Talk to an expert

All datasets are collected under clear consent and licensing terms, with full provenance documentation, so your legal and compliance teams can approve use without ambiguity.

Dataset Categories

Speech and Audio Datasets

Pre-built multilingual speech corpora, read speech collections, conversational recordings, and acoustic scene datasets spanning 80+ languages. Suitable for ASR model training, TTS voice cloning, and speech classifier development. Browse the full speech and audio catalogue for detailed format and licensing information.

Image and Video Datasets

Annotated image classification sets, object detection datasets, video action recognition corpora, and scene understanding collections across diverse environments and lighting conditions. Available in standard annotation formats including COCO, Pascal VOC, and custom schemas.

Text and NLP Datasets

Instruction-following collections, question-answer pairs, sentiment annotation datasets, and multilingual AI text corpora across 100+ languages. Suitable for LLM fine-tuning, classification model training, and evaluation benchmark construction.

Multimodal Datasets

Paired image-text, video-caption, and audio-visual datasets for multimodal AI training. Collections are aligned across modalities and verified for temporal and semantic consistency.

When to choose Off-the-Shelf

Off-the-shelf datasets are the right choice when your model requires broad coverage of common categories and standard conditions, when development timelines do not permit a custom collection cycle, or when budget constraints make bespoke data production impractical for an initial training phase. They are also commonly used to supplement custom data with additional volume or class diversity.

For use cases requiring proprietary demographics, specific acoustic environments, specialist domain coverage, or controlled collection protocols, Appen's custom data services across frontier model alignment, multimodal, and agentic AI provide purpose-built alternatives.

Explore our datasets

Featured datasets

Dataset Name	Dataset ID	Description
Selfie image and video collection	IMG_VID_SELFIE_US	Collection of 2,938 selfie images and videos from 70 participants, capturing varied facial expressions across 1,566 recording sessions.
Action videos	VID_ACTION_US	281 videos of participants and animals completing prompted actions, e.g. zipping a jacket or drinking a beverage.
English (United States) Product labels	IMG_OCR_USE_PRODUCTLABELS	54,350 annotated product label images spanning food, health & beauty, and pet supplies, with bounding box and text transcription.
Hand gesture videos	HUMAN_BODY_VID003	~11 hours of video across 3,099 clips of participants performing hand gestures (e.g. thumbs up, wave), with gesture-type metadata.
English (United States) scripted sentences	USE_ASR005	244 hours of smartphone-recorded speech from participants reading prompted sentences; 9,000 unique sentences across 96 prompts per session.
English (United States) device commands	USE_ASR006	30 hours of smartphone speech of participants saying device commands; 280 unique prompts across 94 prompts per session.
English (United States) answers to questions	USE_ASR007	50 hours of smartphone speech of participants answering prompted questions; 1,000 unique prompts across 100 prompts per session.
English (United States) conversational smartphone	USE_ASR008	2.5 hours of paired conversational speech on selected topics, recorded on smartphones; includes AAVE speakers and some toxic speech.
Astronomy and Astrophysics Academic Journal Corpus	JOURN_ASTRO_001_v1	320.7M-word corpus of peer-reviewed astronomy and astrophysics journals in XML and PDF format, spanning 1984–2025.
Atomic and Molecular Physics Academic Journal Corpus	JOURN_ATOM_001_v1	1.1B-word corpus of academic journals covering atomic, molecular, and optical physics research, spanning 1899–2025.
Bioengineering Academic Journal Corpus	JOURN_BIOENG_001_v1	95.4M-word corpus of journals covering biomedical engineering, biophysics, and biological instrumentation, spanning 1956–2025.
Computational Science Academic Journal Corpus	JOURN_COMPSCI_001_v1	177.1M-word corpus of journals covering computational modelling, numerical analysis, and scientific computing, spanning 1985–2025.
Condensed Matter Academic Journal Corpus	JOURN_CONDMAT_001_v1	1.1B-word corpus of peer-reviewed condensed matter and solid-state physics journals in XML and PDF format, spanning 1930–2025.
Education and Communication Academic Journal Corpus	JOURN_EDUCOM_001_v1	46.7M-word corpus of journals on physics education, pedagogy, and scientific communication, spanning 1966–2025.
Engineering Academic Journal Corpus	JOURN_ENGINE_001_v1	220.2M-word corpus of journals covering applied engineering and scientific instrumentation research, spanning 1973–2025.
Environmental and Earth Science Academic Journal Corpus	JOURN_ENVIRO_001_v1	523M-word corpus of journals covering environmental science, climate science, and earth systems research, spanning 1981–2025.
Instrumentation and Measurement Academic Journal Corpus	JOURN_INSTR_001_v1	105.5M-word corpus of journals covering scientific instrumentation, measurement science, and sensor technologies, spanning 1970–2025.
Machine Learning and AI Academic Journal Corpus	JOURN_MLAI_001_v1	121,772-word corpus of journals covering machine learning, applied AI, and computational intelligence research, spanning 1985–2025.
Materials Science Academic Journal Corpus	JOURN_MATSCI_001_v1	480.5M-word corpus of peer-reviewed journals across materials science and applied materials engineering, spanning 1986–2025.
Mathematical Physics Academic Journal Corpus	JOURN_MATPHYS_001_v1	247.7M-word corpus of journals covering mathematical and theoretical physics research, spanning 1971–2025.
Medical Physics Academic Journal Corpus	JOURN_MEDPHYS_001_v1	200.9M-word corpus of journals covering medical physics, diagnostic imaging, and therapeutic applications, spanning 1956–2025.
Nanoscience Academic Journal Corpus	JOURN_NANO_001_v1	181.4M-word corpus of journals covering nanoscale science and nanotechnology research, spanning 1990–2025.
Nuclear Physics Academic Journal Corpus	JOURN_NUCPHYS_001_v1	9.6M-word corpus of journals covering nuclear physics, nuclear structure, and heavy-ion science research, spanning 1970–2025.
Optics and Photonics Academic Journal Corpus	JOURN_OPTICS_001_v1	224.1M-word corpus of journals covering optics, photonics, and laser science research, spanning 1962–2025.
Particle Physics Academic Journal Corpus	JOURN_PARTPHYS_001_v1	153.7M-word corpus of journals covering particle physics and high-energy interaction research, spanning 1968–2025.
Plasma Science Academic Journal Corpus	JOURN_PLASMA_001_v1	47.2M-word corpus of journals covering plasma physics and fusion science research, spanning 1959–2025.
Quantum Science and Technology Academic Journal Corpus	JOURN_QUANTUM_001_v1	214.7M-word corpus of journals covering quantum science, quantum information, and quantum technologies, spanning 1986–2025.
Astronomy and Astrophysics Course Textbook and Research Reference Text Corpus	TEXTBOOK_ASTRO_001_v1	37 textbooks and reference works covering cosmology, stellar and galactic physics, and gravitational theory; published 2014–2022.
Atomic and Molecular Physics Course Textbook and Research Reference Text Corpus	TEXTBOOK_ATOM_001_v1	32 textbooks and reference works covering AMO physics, spectroscopy, and molecular theory; published 2014–2023.
Biomedical Engineering Course Textbook and Research Reference Text Corpus	TEXTBOOK_BIOMED_001_v1	50 textbooks and references across biomedical engineering, biophysics, imaging sciences, and biosystems modelling; published 2014–2024.
Classical Physics Course Textbook and Research Reference Text Corpus	TEXTBOOK_CLASPHYS_001_v1	45 educational and reference texts covering mechanics, thermodynamics, acoustics, and statistical physics; published 2014–2024.
Condensed Matter Course Textbook and Research Reference Text Corpus	TEXTBOOK_CONDMAT_001_v1	36 textbooks and references covering condensed matter physics, materials properties, low-temperature physics, and many-body theory; 2014–2024.
Culture, History and Society Broad Interest Text and Research Reference Text Corpus	TEXTBOOK_CULHISSOC_001_v1	25 broad-interest and reference texts exploring the intersections of physics with history, culture, ethics, and society; published 2015–2024.
Education and Outreach Broad Interest and Research Reference Text Corpusq	TEXTBOOK_EDUCOM_001_v1	25 texts on physics education, science communication, pedagogy, learning design, and professional development; published 2015–2024.
Engineering Course Textbook and Research Reference Text Corpus	TEXTBOOK_ENGINE_001_v1	26 course and research texts across electronics, electrodynamics, systems engineering, and emerging technology domains; published 2019–2024.
Environment and Energy Course Textbook and Research Reference Text Corpus	TEXTBOOK_ENVIRO_001_v1	47 references and course materials on energy systems, sustainability, atmospheric physics, and environmental modelling; published 2013–2024.
Instrumentation and Measurement Course Textbook and Research Reference Text Corpus	TEXTBOOK_INSTR_001_v1	77 references and course texts covering scientific instrumentation, sensing, imaging systems, and measurement methodologies; published 2014–2024.
Materials Science Course Textbook and Research Reference Text Corpus	TEXTBOOK_MATSCI_001_v1	122 references and course texts on materials properties, semiconductors, nanomaterials, composites, and applied materials engineering; 2013–2024.
Mathematics and Computation Course Textbook and Research Reference Text Corpus	TEXTBOOK_MATHCOMP_001_v1	79 course texts and references in mathematical methods, numerical modelling, computational science, and applied mathematics; published 2014–2024.
Medical Physics and Biophysics Course Textbook and Research Reference Text Corpus	TEXTBOOK_MEDPHYS_001_v1	87 references and course texts covering medical imaging, radiation physics, biophysical modelling, and diagnostic/therapeutic technologies; 2014–2024.
Optics and Photonics Course Textbook and Research Reference Text Corpus	TEXTBOOK_OPTICS_001_v1	113 reference works and course texts in optical science, photonics, laser systems, imaging, and applied optical engineering; published 2014–2024.
Particle and Nuclear Physics Course Textbook and Research Reference Text Corpus	TEXTBOOK_PARTNUCPHYS_001_v1	48 course texts and references across particle physics, nuclear physics, collider physics, and quantum field theory; published 2014–2024.
Plasma Science Course Textbook and Research Reference Text Corpus	TEXTBOOK_PLASMA_001_v1	32 references and course materials in plasma physics, space plasmas, discharges, fusion, and turbulence; published 2014–2024.
Quantum Science and Technology Course Textbook and Research Reference Text Corpus	TEXTBOOK_QUANTUM_001_v1	53 course texts and references in quantum mechanics, quantum optics, quantum information science, and quantum technologies; published 2014–2024.

Related resources

Data Product

Speech & Audio

Expressive TTS synthesis, emotion detection, dialectal speech and paralinguistic labelling across 500+ global locales.

Learn more

Data Product

Multimodal AI

Fine-grained VLM training data, image-text contrastive pairs, spatiotemporal video annotation, audio-visual alignment and structured document labelling for models that reason across heterogeneous input modalities.

Learn more

Data Product

Physical AI

LiDAR point cloud annotation, multi-camera sensor fusion, robot demonstration trajectories, world model rollouts and embodied interaction logs for AI systems operating in unstructured physical environments.

Learn more

Data Product

Frontier Model Alignment

CoT reasoning traces, SME RLHF, SFT demonstrations and adversarial red teaming for the world’s most capable models.

Learn more

DATA Product

Data Annotation Services for AI & ML

Enterprise data annotation services for AI and machine learning , image, text, video, and audio annotation with expert human annotators across 80+ languages.

Learn more

Speech & Audio

Multi-Speaker Audio Transcription

Accurate multi-speaker audio transcription at scale, speaker diarization, 99.5% accuracy, and 165,000+ hours of audio across languages and acoustic environments.

Learn more

Multimodal AI Training Data

Video Action and Intent Recognition Data

Aligned audio-visual training data for vision-language models , precisely synchronized text, image, and audio annotations for multimodal AI that understands the world.

Learn more

Blog

How a Human-in-the-Loop Approach Enhances AI Data Quality

Discover strategies for improving AI data quality with a human-in-the-loop approach to minimizing errors and optimizing AI data preparation.

Read article

Off-the-Shelf AI Training Datasets

Dataset Categories

Speech and Audio Datasets

Image and Video Datasets

Text and NLP Datasets

Multimodal Datasets

When to choose Off-the-Shelf

Featured datasets

Related resources

Speech & Audio

Multimodal AI

Physical AI

Frontier Model Alignment

Data Annotation Services for AI & ML

Multi-Speaker Audio Transcription

Video Action and Intent Recognition Data

How a Human-in-the-Loop Approach Enhances AI Data Quality

Get started with Off-the-Shelf AI Training Datasets

Contact us