MIT Open Dataset Catalogue is a practical documented dataset for Engineering leaders, Developers, Product managers, Technology buyers. It connects mit open dataset catalogue to evidence, ownership, implementation controls, measurable outcomes, and a repeatable review cycle.
MIT Open Dataset Catalogue is a practical documented dataset for Engineering leaders, Developers, Product managers, Technology buyers. It connects mit open dataset catalogue to evidence, ownership, implementation controls, measurable outcomes, and a repeatable review cycle.
Every record was included because its current Hugging Face or Kaggle platform metadata reported MIT. Verify the live dataset card, source provenance, embedded third-party material, privacy constraints, and platform terms before reuse.
Hugging Face | MIT | Global or other
Typed Digital Signatures Dataset This comprehensive dataset contains synthetic digital signatures rendered across 30 different Google Fonts, specifically selected for their handwriting and signature-style characteristics. Each font contributes unique stylistic elements, making this dataset ideal for robust signature analysis and font recognition tasks.…
Publisher: Benjy | Downloads: 2215463 | Topics: image-classification, zero-shot-image-classification, image-feature-extraction, digital-signatures, synthetic-data
Hugging Face | MIT | Global or other
This is a dataset which contains the docs from all the PRs that are updating one of the docs from It is automatically updated by this github action from the doc-buider repo.
Publisher: hf-doc-build | Downloads: 1743084 | Topics: documentation
Hugging Face | MIT | Global or other
ニコニコ実況 過去ログアーカイブ ニコニコ実況 過去ログアーカイブは、ニコニコ実況 のサービス開始から現在までのすべての過去ログコメントを収集したデータセットです。 去る2020年12月、ニコニコ実況は ニコニコ生放送内の一公式チャンネルとしてリニューアル されました。これに伴い、2009年11月から運用されてきた旧システムは提供終了となり（事実上のサービス終了）、torne や BRAVIA などの家電への対応が軒並み終了する中、当時の生の声が詰まった約11年分の過去ログも同時に失われることとなってしまいました。 そこで 5ch の DTV 板の住民が中心となり、旧ニコニコ実況が終了するまでに11年分の全チャンネルの過去ログをアーカイブする計画が立ち上がりました。紆余曲折あり Nekopanda…
Publisher: KakologArchives | Downloads: 1555895 | Topics: text-classification
Hugging Face | MIT | Global or other
Prophet's Mosque Library 📖 Overview Prophet’s Mosque Library is one of the primary resources for Islamic books. It hosts more than 48,000 PDF books across over 70 categories. In this dataset, we processed the original PDF files using Google Document AI APIs and extracted their contents into two additional formats: TXT and DOCX. 📊 Dataset Contents The…
Publisher: mhaamh19 | Downloads: 378816 | Topics: image-to-text
Hugging Face | MIT | Global or other
arXiv Papers by Subject A reorganised version of the nick007x/arxiv-papers dataset, partitioned by subject code, year, and month for efficient selective access. Dataset Description This dataset contains metadata for over 2.5 million arXiv papers, organised into a hierarchical directory structure that allows users to download only the specific subjects and…
Publisher: permutans | Downloads: 347863 | Topics: text-generation, feature-extraction, arxiv, academic-papers, scientific-literature
Hugging Face | MIT | Global or other
MIT-licensed dataset published by world-igr-plum for data analysis and machine learning.
Publisher: world-igr-plum | Downloads: 311651 | Topics: Not specified
Hugging Face | MIT | Global or other
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.1", "robottype": "R1Pro", "totalepisodes": 10000, "totalframes": 119094660, "totaltasks": 50, "totalvideos": 90000, "chunkssize": 10000, "fps": 30, "splits": { "train": "0:10000" }, "datapath": "data/task-{episodechunk:04d}/episode{episodeindex:08d}.parquet",…
Publisher: behavior-1k | Downloads: 214957 | Topics: robotics, LeRobot, v, 2, .
Hugging Face | MIT | Global or other
MIT-licensed dataset published by meihualuomanxueshan for data analysis and machine learning.
Publisher: meihualuomanxueshan | Downloads: 208242 | Topics: Not specified
Hugging Face | MIT | Global or other
This repo contains all the docs published on The docs are generated with
Publisher: hf-doc-build | Downloads: 208018 | Topics: Not specified
Hugging Face | MIT | Global or other
Ettin Pre-training Data Phase 1 of 3: Diverse pre-training data mixture (1.7T tokens) used to train the Ettin model suite. This dataset contains the pre-training phase data used to train all Ettin encoder and decoder models. The data is provided in MDS format ready for use with Composer and the ModernBERT training repository. 📊 Data Composition Data…
Publisher: jhu-clsp | Downloads: 186537 | Topics: text-generation, fill-mask, text-classification, retrieval, pretraining
Hugging Face | MIT | Global or other
Prophet's Mosque Library 📖 Overview Prophet’s Mosque Library is one of the primary resources for Islamic books. It hosts more than 48,000 PDF books across over 70 categories. In this dataset, we processed the original PDF files using Google Document AI APIs and extracted their contents into two additional formats: TXT and DOCX. 📊 Dataset Contents The…
Publisher: ieasybooks-org | Downloads: 179063 | Topics: image-to-text
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Yarina for data analysis and machine learning.
Publisher: Yarina | Downloads: 176033 | Topics: Not specified
Hugging Face | MIT | Global or other
ニコニコ実況 過去ログアーカイブ ニコニコ実況 過去ログアーカイブは、ニコニコ実況 のサービス開始から現在までのすべての過去ログコメントを収集したデータセットです。 去る2020年12月、ニコニコ実況は ニコニコ生放送内の一公式チャンネルとしてリニューアル されました。これに伴い、2009年11月から運用されてきた旧システムは提供終了となり（事実上のサービス終了）、torne や BRAVIA などの家電への対応が軒並み終了する中、当時の生の声が詰まった約11年分の過去ログも同時に失われることとなってしまいました。 そこで 5ch の DTV 板の住民が中心となり、旧ニコニコ実況が終了するまでに11年分の全チャンネルの過去ログをアーカイブする計画が立ち上がりました。紆余曲折あり Nekopanda…
Publisher: echodict | Downloads: 174792 | Topics: text-classification
Hugging Face | MIT | Global or other
MIT-licensed dataset published by boltzgen for data analysis and machine learning.
Publisher: boltzgen | Downloads: 172401 | Topics: Not specified
Hugging Face | MIT | Global or other
Badges A set of badges you can use anywhere. Just update the anchor URL to point to the correct action for your Space. Light or dark background with 4 sizes available: small, medium, large, and extra large. How to use? With markdown, just copy the badge from: With HTML, inspect this page with your web browser and copy the outer html. Available sizes Small…
Publisher: huggingface | Downloads: 165058 | Topics: Not specified
Hugging Face | MIT | Global or other
MMLU-Pro Dataset MMLU-Pro dataset is a more robust and challenging massive multi-task understanding dataset tailored to more rigorously benchmark large language models' capabilities. This dataset contains 12K complex questions across various disciplines. Github | 🏆Leaderboard | 📖Paper | 🚀 What's New [2026.03.11] Added more cutting-edge frontier models…
Publisher: TIGER-Lab | Downloads: 159076 | Topics: question-answering, evaluation
Hugging Face | MIT | Global or other
ProgramBench Generated Tests This dataset contains the AI-generated behavioral test suites used to evaluate model solutions in ProgramBench. ProgramBench is a benchmark that evaluates whether language models can rebuild programs from scratch. Given only a compiled binary and its documentation, AI agents must architect and implement a complete codebase that…
Publisher: programbench | Downloads: 144250 | Topics: text-generation, code, software-engineering, reverse-engineering, benchmark
Hugging Face | MIT | Global or other
HaGRID Gesture Recognition Subset Dataset Description A curated subset of the HaGRID (Hand Gesture Recognition Image Dataset) containing 24 gesture classes for training gesture recognition models. Dataset Summary Total Images: 19,200 Gesture Classes: 24 Samples per Class: 800 Image Format: JPEG Average Image Size: 302 KB Splits Split Images Percentage…
Publisher: schwein69 | Downloads: 131461 | Topics: image-classification, object-detection, gesture-recognition, computer-vision, hand-gestures
Hugging Face | MIT | Global or other
American Sign Language (ASL) Dataset Description:This dataset contains 108,618 videos representing 2,208 ASL words, with each word having a minimum of 30 videos. The videos were scraped, collected from multiple sources, and preprocessed to ensure consistency, quality, and usability for machine learning and gesture recognition tasks. Each video is ≤10 MB,…
Publisher: simplyyousef | Downloads: 123292 | Topics: ASL, American Sign Language, Gesture Recognition, Video Dataset
Hugging Face | MIT | Global or other
ReActor Assets The Fast and Simple Face Swap Extension ComfyUI-ReActor (ex. comfyui-reactor-node) sd-webui-reactor Models file source license buffalol.zip DeepInsight codeformer-v0.1.0.pth sczhou GFPGANv1.3.pth TencentARC GFPGANv1.4.pth TencentARC GPEN-BFR-512.onnx harisreedhar RestoreFormerPP.onnx netrunner.exe inswapper128.onnx DeepInsight…
Publisher: Gourieff | Downloads: 119605 | Topics: Not specified
Hugging Face | MIT | Global or other
Dataset Summary MATH dataset from Citation Information @article{hendrycksmath2021, title={Measuring Mathematical Problem Solving With the MATH Dataset}, author={Dan Hendrycks and Collin Burns and Saurav Kadavath and Akul Arora and Steven Basart and Eric Tang and Dawn Song and Jacob Steinhardt}, journal={NeurIPS}, year={2021} }
Publisher: EleutherAI | Downloads: 116404 | Topics: Not specified
Hugging Face | MIT | Global or other
The sp500stockdatadescription.csv file provides detailed information on the existence of four modalities (text, image, time series, and table) for 4,213 S&P 500 stocks. The hs300stockdatadescription.csv file provides detailed information on the existence of four modalities (text, image, time series, and table) for 858 HS 300 stocks. If you find our…
Publisher: tishtakalita | Downloads: 115852 | Topics: Not specified
Hugging Face | MIT | Global or other
American Sign Language (ASL) Dataset Description:This dataset contains 108,618 videos representing 2,208 ASL words, with each word having a minimum of 30 videos. The videos were scraped, collected from multiple sources, and preprocessed to ensure consistency, quality, and usability for machine learning and gesture recognition tasks. Each video is ≤10 MB,…
Publisher: just-me7ss | Downloads: 109992 | Topics: ASL, American Sign Language, Gesture Recognition, Video Dataset
Hugging Face | MIT | Global or other
MIT-licensed dataset published by jacobbieker for data analysis and machine learning.
Publisher: jacobbieker | Downloads: 109919 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by mabo7237 for data analysis and machine learning.
Publisher: mabo7237 | Downloads: 103558 | Topics: Not specified
Hugging Face | MIT | Global or other
What is Symato CC? To download all WARC data from Common Crawl then filter out Vietnamese in Markdown and Plaintext format. There is 1% of Vietnamse in CC, extract all of them out should be a lot (10TB of plaintext). Main contributors Simple quality filters To make use of raw data from common crawl, you need to do filtering… See the full description on the…
Publisher: Symato | Downloads: 103334 | Topics: Not specified
Kaggle | MIT | Global or other
Classify MRI images into four classes
Publisher: Sartaj | Downloads: 102725 | Topics: celebrities, movies and tv shows, health, medicine, classification
Hugging Face | MIT | Global or other
TOFU: Task of Fictitious Unlearning 🍢 The TOFU dataset serves as a benchmark for evaluating unlearning performance of large language models on realistic tasks. The dataset comprises question-answer pairs based on autobiographies of 200 different authors that do not exist and are completely fictitiously generated by the GPT-4 model. The goal of the task is…
Publisher: locuslab | Downloads: 101994 | Topics: question-answering, unlearning, question answering, TOFU, NLP
Hugging Face | MIT | Global or other
MIT-licensed dataset published by labofsahil for data analysis and machine learning.
Publisher: labofsahil | Downloads: 99655 | Topics: Not specified
Hugging Face | MIT | Global or other
RealCam-Vid Dataset News /04/08: We provide torch dataset demo code for example usage of our RealCam-Vid. /03/26: Release our dataset RealCam-Vid v1 for metric-scale camera-controlled video generation, containing 100K video clips with dedicated short/long captions and metric-scale camera annotations. /02/18: Initial commit of the project, we plan to…
Publisher: MuteApo | Downloads: 97764 | Topics: image-to-video
Hugging Face | MIT | Global or other
Dataset Summary This dataset is comprised of the LAMBADA test split as pre-processed by OpenAI (see relevant discussions here and here). It also contains machine translated versions of the split in German, Spanish, French, and Italian. LAMBADA is used to evaluate the capabilities of computational models for text understanding by means of a word prediction…
Publisher: EleutherAI | Downloads: 94774 | Topics: Not specified
Hugging Face | MIT | Global or other
Data cleaning, stay tuned! Please refer to first for general info. Checkout the paper EgoLife ( for more information. Code:
Publisher: lmms-lab | Downloads: 91639 | Topics: video-text-to-text, video
Hugging Face | MIT | Global or other
The sp500stockdatadescription.csv file provides detailed information on the existence of four modalities (text, image, time series, and table) for 4,213 S&P 500 stocks. The hs300stockdatadescription.csv file provides detailed information on the existence of four modalities (text, image, time series, and table) for 858 HS 300 stocks. If you find our…
Publisher: Y123-wed | Downloads: 91378 | Topics: Not specified
Hugging Face | MIT | Global or other
Load with 🤗 Datasets You can download this dataset through HuggingFace datasets (which requires you to install the extra Vision packages with pip install datasets[vision]). Then you will be able to load specific parts of this dataset with: from datasets import loaddataset ds = loaddataset("ORG/REPOID", name="flsim") # or arcgis/bingmaps/ges/xplane print(ds)
Publisher: Xbox186 | Downloads: 90724 | Topics: object-detection, image-segmentation, aircraft, landing, simulator
Hugging Face | MIT | Global or other
Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied Exploration CVPR 2026 [arXiv] LMEE-Bench lmeebenchsub: Includes 58 tasks. lmeebench: Includes the full 166 tasks. tasktest: Trajectory data test set.
Publisher: QMX548682 | Downloads: 87736 | Topics: Not specified
Hugging Face | MIT | Global or other
BEHAVIOR-1K 2026 Challenge Demos This dataset contains BEHAVIOR-1K 2026 challenge demonstration trajectories in LeRobotDataset v3 format. Dataset Statistics Tasks: 100 Episodes: 20,000 Frames: 210,916,774 Size: approximately 3.0 TB Data shards: 955 Parquet files Video files: 17,093 MP4 files Video features: 6 Format The repository follows the…
Publisher: behavior-1k | Downloads: 82667 | Topics: lerobot, lerobot-v3, behavior-1k, omnigibson, robotics
Hugging Face | MIT | Global or other
Waqfeya Library 📖 Overview Waqfeya is one of the primary online resources for Islamic books, similar to Shamela. It hosts more than 10,000 PDF books across over 80 categories. In this dataset, we processed the original PDF files using Google Document AI APIs and extracted their contents into two additional formats: TXT and DOCX. 📊 Dataset Contents The…
Publisher: ieasybooks-org | Downloads: 81252 | Topics: image-to-text
Hugging Face | MIT | Global or other
RoadmapBench A benchmark for evaluating AI coding agents on multi-target, long-horizon software development tasks derived from open-source project version upgrades. Overview RoadmapBench contains 115 tasks spanning 17 open-source repositories across 5 programming languages (Python, TypeScript, Go, Rust, C++). Each task requires an agent to implement…
Publisher: UnipatAI | Downloads: 78846 | Topics: text-generation, code-generation, software-engineering, benchmark, multi-step-reasoning
Hugging Face | MIT | Global or other
CommitPackFT is is a 2GB filtered version of CommitPack to contain only high-quality commit messages that resemble natural language instructions.
Publisher: bigcode | Downloads: 77579 | Topics: Not specified
Hugging Face | MIT | Global or other
Annotation We resized the dataset to 1080p for easier uploading. Therefore, the original annotation file might not match the video names. Please refer to this Pexels Pexels consists of multiple folders, but each folder exceeds the size limit for Huggingface uploads. Therefore, we divided each folder into 5 parts. You need to merge the 5 parts of each…
Publisher: LanguageBind | Downloads: 74097 | Topics: Not specified
Kaggle | MIT | Global or other
44000 products with category labels and images.
Publisher: Param Aggarwal | Downloads: 73561 | Topics: arts and entertainment, clothing and accessories, classification, image
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Kllove for data analysis and machine learning.
Publisher: Kllove | Downloads: 73125 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by chen-space for data analysis and machine learning.
Publisher: chen-space | Downloads: 69348 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by kkail8 for data analysis and machine learning.
Publisher: kkail8 | Downloads: 66634 | Topics: Not specified
Hugging Face | MIT | Global or other
UniOcc: A Unified Benchmark for Occupancy Forecasting and Prediction in Autonomous Driving Paper | Project Page | Code Autonomous Driving researchers, have you ever been bothered by the fact that popular datasets all have their different formats, and standardizing them is a pain? Have you ever been frustrated by the difficulty of just understanding the…
Publisher: tasl-lab | Downloads: 65724 | Topics: image-to-3d, autonomous-driving, occupancy-prediction, occupancy-forecasting, 3d
Hugging Face | MIT | Global or other
Dataset Card for UltraChat 200k Dataset Description This is a heavily filtered version of the UltraChat dataset and was used to train Zephyr-7B-β, a state of the art 7b chat model. The original datasets consists of 1.4M dialogues generated by ChatGPT and spanning a wide range of topics. To create UltraChat 200k, we applied the following logic: Selection of…
Publisher: HuggingFaceH4 | Downloads: 64912 | Topics: text-generation
Hugging Face | MIT | Global or other
MIT-licensed dataset published by klieret for data analysis and machine learning.
Publisher: klieret | Downloads: 64645 | Topics: Not specified
Hugging Face | MIT | Global or other
T-Rex Dataset A large-scale, tactile-reactive bimanual manipulation dataset, collected via teleoperation on a Dexmate Vega-1 robot with two Sharpa Wave dexterous hands. Stored as a LeRobotDataset v3.0. 🌐 Project Page · ✍️ Paper (arXiv) · 💻 Code (T-Rex) · 🚀 Dataset Quickstart · 📓 Colab notebook One episode from each of 20 motor primitives (head-camera…
Publisher: zekaiwang | Downloads: 61716 | Topics: robotics, LeRobot, robotics, manipulation, tactile
Hugging Face | MIT | Global or other
MIT-licensed dataset published by TianxingChen for data analysis and machine learning.
Publisher: TianxingChen | Downloads: 61220 | Topics: Not specified
Hugging Face | MIT | Global or other
This dataset contains a copy of the cais/mmlu HF dataset but without the auxiliarytrain split that takes a long time to generate again each time when loading multiple subsets of the dataset. Please visit for more information on the MMLU dataset.
Publisher: hails | Downloads: 58618 | Topics: question-answering
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Genesis-Intelligence for data analysis and machine learning.
Publisher: Genesis-Intelligence | Downloads: 56708 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by SWE-bench for data analysis and machine learning.
Publisher: SWE-bench | Downloads: 56312 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Zihao334 for data analysis and machine learning.
Publisher: Zihao334 | Downloads: 54685 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by kkail8 for data analysis and machine learning.
Publisher: kkail8 | Downloads: 54324 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by kkail8 for data analysis and machine learning.
Publisher: kkail8 | Downloads: 53764 | Topics: Not specified
Hugging Face | MIT | Global or other
Dataset for the evaluation of data-unlearning techniques using KLOM (KL-divergence of Margins). How KLOM works: KLOM works by: training N models (original models) Training N fully-retrained models (oracles) on forget set F unlearning forget set F from the original models Comparing the outputs of the unlearned models from the retrained models on different…
Publisher: machine-unlearning-bench | Downloads: 53663 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by kkail8 for data analysis and machine learning.
Publisher: kkail8 | Downloads: 53087 | Topics: Not specified
Hugging Face | MIT | Global or other
Dexora: Open-Source VLA for High-DoF Bimanual Dexterity 🔥 News & Updates Released the full Real-World Dataset (12.2K episodes) on Hugging Face. Released the task-level view of the Real-World Dataset (one folder per high-level task) on Hugging Face. Coming soon: We will open-source the full 100K-episode simulation dataset. 📊 Dataset Overview The Dexora…
Publisher: Dexora | Downloads: 52873 | Topics: Not specified
Hugging Face | MIT | Global or other
Shamela Waqfeya Library 📖 Overview Shamela Waqfeya is one of the primary online resources for Islamic books, similar to Shamela. It hosts more than 4,500 PDF books across over 40 categories. In this dataset, we processed the original PDF files using Google Document AI APIs and extracted their contents into two additional formats: TXT and DOCX. 📊 Dataset…
Publisher: ieasybooks-org | Downloads: 52173 | Topics: image-to-text
Kaggle | MIT | Global or other
Loan Approval Dataset used for Prediction Models
Publisher: Kai | Downloads: 52024 | Topics: banking, artificial intelligence, classification, gradient boosting, random forest
Hugging Face | MIT | Global or other
SWE-Gym contains 2438 instances sourced from 11 Python repos, following SWE-Bench data collection procedure. Get started at project page github.com/SWE-Gym/SWE-Gym
Publisher: SWE-Gym | Downloads: 51328 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by zhang-yl for data analysis and machine learning.
Publisher: zhang-yl | Downloads: 50803 | Topics: Not specified
Hugging Face | MIT | Global or other
View the project page: see our paper at Note All MetaMathQA data are augmented from the training sets of GSM8K and MATH. None of the augmented data is from the testing set. You can check the originalquestion in meta-math/MetaMathQA, each item is from the GSM8K or MATH train set. Model Details MetaMath-Mistral-7B is fully fine-tuned on the MetaMathQA…
Publisher: meta-math | Downloads: 49952 | Topics: math, math-qa
Hugging Face | MIT | Global or other
RMISC: A Large-scale Real-world Multivariate Corpus for Time Series Foundation Models This dataset card describes the main branch of RMISC. RMISC is a large-scale, real-world multivariate time-series corpus for pretraining and benchmarking time series foundation models (TSFMs). The complete corpus contains around 200 sub-datasets, 2 million original…
Publisher: nju-zhangsq | Downloads: 49602 | Topics: time-series-forecasting, time series, multivariate time series, multivariate time series foundation model
Hugging Face | MIT | Global or other
RobotWin 2.0 (Preprocessed LeRobot v2.1 Release) This repository releases our preprocessed RoboTwin / RobotWin 2.0 dataset in LeRobot v2.1 format for the open-source release of Fast-WAM: Do World Action Models Need Test-time Future Imagination? This is not the official upstream RoboTwin release. It is our paper-specific processed version prepared to…
Publisher: yuanty | Downloads: 47194 | Topics: robotics, robot-learning, imitation-learning, lerobot, video
Hugging Face | MIT | Global or other
MIT-licensed dataset published by huggingfacejs for data analysis and machine learning.
Publisher: huggingfacejs | Downloads: 46921 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by jacobbieker for data analysis and machine learning.
Publisher: jacobbieker | Downloads: 46310 | Topics: Not specified
Hugging Face | MIT | Global or other
commaCarSegments commaCarSegments is a dataset of raw CAN bus data recorded from our fleet of openpilot users driving over 300 different production vehicles, around the USA and rest of the world. Structure ├── segments/ # drectory containing all data │ ├── / # unique device ID directory │ │ └── / # unique route (aka drive directory) │ │ └── / # unique…
Publisher: colaoverdrive | Downloads: 46082 | Topics: comma, openpilot
Hugging Face | MIT | Global or other
MIT-licensed dataset published by TianxingChen for data analysis and machine learning.
Publisher: TianxingChen | Downloads: 45323 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by kkail8 for data analysis and machine learning.
Publisher: kkail8 | Downloads: 45087 | Topics: Not specified
Hugging Face | MIT | Global or other
Dataset Card for JFK Archives This dataset is a collection of all records pertaining to the assassination of the US president, John F. Kennedy, released until April 2025 through archives.org by the US government. Dataset Details Dataset Description The original data downloaded from archives.org consists of 56,300 scanned documents in PDF format, released…
Publisher: farhanhubble | Downloads: 44538 | Topics: question-answering, legal
Hugging Face | MIT | Global or other
MVBench Important Update [18/10/2024] Due to NTU RGB+D License, 320 videos from NTU RGB+D need to be downloaded manually. Please visit ROSE Lab to access the data. We also provide a list of the 320 videos used in MVBench for your reference. We introduce a novel static-to-dynamic method for defining temporal-related tasks. By converting static tasks into…
Publisher: OpenGVLab | Downloads: 42775 | Topics: visual-question-answering, video-classification
Hugging Face | MIT | Global or other
Large-scale Multi-modality Models Evaluation Suite Accelerating the development of large-scale multi-modality models (LMMs) with lmms-eval 🏠 Homepage | 📚 Documentation | 🤗 Huggingface Datasets This Dataset This is a formatted version of GQA. It is used in our lmms-eval pipeline to allow for one-click evaluations of large multi-modality models.…
Publisher: lmms-lab | Downloads: 42011 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by zhoujt1994 for data analysis and machine learning.
Publisher: zhoujt1994 | Downloads: 41096 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by jacobbieker for data analysis and machine learning.
Publisher: jacobbieker | Downloads: 40620 | Topics: Not specified
Hugging Face | MIT | Global or other
🔥 VoiceAssistant-Eval: Benchmarking AI Assistants across Listening, Speaking, and Viewing [🌐 Homepage] [🔮 Visualization] [💻 Github] [📖 Paper] [📊 Leaderboard ] [📊 Detailed Leaderboard ] [📊 Roleplay Leaderboard ] 🚀 Data Usage from datasets import loaddataset for split in ['listeninggeneral', 'listeningmusic', 'listeningsound', 'listeningspeech',…
Publisher: MathLLMs | Downloads: 39299 | Topics: question-answering, visual-question-answering, audio-to-audio, any-to-any, multiple-choice
Hugging Face | MIT | Global or other
MIT-licensed dataset published by shfaiof for data analysis and machine learning.
Publisher: shfaiof | Downloads: 37829 | Topics: Not specified
Hugging Face | MIT | Global or other
Dataset Card for HH-RLHF Dataset Summary This repository provides access to two different kinds of data: Human preference data about helpfulness and harmlessness from Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback. These data are meant to train preference (or reward) models for subsequent RLHF training. These data…
Publisher: Anthropic | Downloads: 36917 | Topics: human-feedback
Hugging Face | MIT | Global or other
Reproducing ICML 2026 — Challenge Guide (for agents) You are a coding agent contributing to a community effort organized by Hugging Face and AlphaXiv to reproduce the major claims of every ICML 2026 paper. Task Your task is to reproduce a given research paper accepted to ICML 2026 based on the available context (paper PDF, Github repository if available,…
Publisher: ICML-2026-agent-repro | Downloads: 36489 | Topics: trackio, open-reproductions, icml2026
Hugging Face | MIT | Global or other
MIT-licensed dataset published by karpathy for data analysis and machine learning.
Publisher: karpathy | Downloads: 35950 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ZhangHanXD for data analysis and machine learning.
Publisher: ZhangHanXD | Downloads: 35929 | Topics: Not specified
Hugging Face | MIT | Global or other
MCPMark Trajectory Logs (mcpmark-v1-0905) These logs are publicly available for research use. They capture end-to-end trajectories (prompts, tool calls, and outcomes) for MCPMark tasks across multiple MCP services and models. Contents Each task run produces a trajectory folder containing three files: meta.json: Metadata (task id, model, timestamps, status,…
Publisher: Jakumetsu | Downloads: 35711 | Topics: agent
Hugging Face | MIT | Global or other
LA-33K Language-Action Pretraining Data for Vision-Language-Action Models ,116 episodes | M frames | ,532 language tasks | LeRobot v2.1 format | Franka robot Dataset Summary | Download | Use with LA4VLA | Citation LA-33K is a Language-Action (LA) pretraining dataset for robot manipulation. It contains 33,116…
Publisher: MINT-SJTU | Downloads: 34274 | Topics: robotics, robot-learning, vision-language-action, language-action, imitation-learning
Hugging Face | MIT | Global or other
Innovator-VL-Instruct-46M Paper | Code 🤗🤗 The data is being uploaded continuously Introduction To further enhance the model’s ability to handle a broad range of visual tasks with accurate, grounded, and instruction-aligned responses, we perform full-parameter visual instruction supervised fine-tuning (SFT).This SFT stage serves as a critical bridge…
Publisher: InnovatorLab | Downloads: 33826 | Topics: image-text-to-text, multimodal, vision-language, visual-instruction-tuning, supervised-fine-tuning
Hugging Face | MIT | Global or other
WildClawBench Hard, practical, end-to-end evaluation for AI agents — in the wild. WildClawBench is an agent benchmark that tests what actually matters: can an AI agent do real work, end-to-end, without hand-holding? We drop agents into a live OpenClaw environment — the same open-source personal AI assistant that real users rely on daily — and throw 60…
Publisher: internlm | Downloads: 33623 | Topics: visual-question-answering, image-text-to-text, question-answering, agents, benchmark
Hugging Face | MIT | Global or other
BSRN MERRA-2 Atmospheric Inputs Point-extracted MERRA-2 reanalysis data for Baseline Surface Radiation Network (BSRN) stations. These parquet files provide atmospheric and aerosol inputs for the REST2 clear-sky radiation model [2]. Dataset Description Each file contains hourly MERRA-2 variables [1] at a single BSRN station location. Extraction is performed…
Publisher: dazhiyang | Downloads: 33322 | Topics: solar, radiation, bsrn
Hugging Face | MIT | Global or other
BrowseComp-Plus BrowseComp-Plus is a new benchmark for Deep-Research system, isolating the effect of the retriever and the LLM agent to enable fair, transparent comparisons of Deep-Research agents. The benchmark sources challenging, reasoning-intensive queries from OpenAI's BrowseComp. However, instead of searching the live web, BrowseComp-Plus evaluates…
Publisher: Tevatron | Downloads: 33294 | Topics: question-answering, retrieval-augmented-generation, rag, benchmark, llm
Hugging Face | MIT | Global or other
Dataset Card for WMDP The Weapons of Mass Destruction Proxy (WMDP) benchmark is a dataset of multiple-choice questions that serve as a proxy measurement of hazardous knowledge in biosecurity, cybersecurity, and chemical security. WMDP serves two roles: first, as an evaluation for hazardous knowledge in LLMs, and second, as a benchmark for unlearning…
Publisher: cais | Downloads: 33146 | Topics: text-generation
Hugging Face | MIT | Global or other
USDT-M Perpetual Futures (Binance) Binance USDT-margined perpetual futures historical data, including OHLCV klines, mark / index / premium-index prices, open-interest & long/short ratios, and funding rates. Auto-updated daily from the official Binance public data mirror. 币安 U 本位永续合约 历史数据集，包含 K 线、标记价格、指数价格、溢价指数、持仓量及多空比、资金费率， 每日从 Binance 官方数据镜像自动更新。 Last…
Publisher: linxy | Downloads: 33108 | Topics: time-series-forecasting, finance, cryptocurrency, futures, perpetual
Hugging Face | MIT | Global or other
Dataset Card for Mathematics Aptitude Test of Heuristics (MATH) dataset in lighteval format Dataset Summary The Mathematics Aptitude Test of Heuristics (MATH) dataset consists of problems from mathematics competitions, including the AMC 10, AMC 12, AIME, and more. Each problem in MATH has a full step-by-step solution, which can be used to teach models to…
Publisher: DigitalLearningGmbH | Downloads: 32660 | Topics: text2text-generation, explanation-generation
Hugging Face | MIT | Global or other
MIT-licensed dataset published by lmms-lab for data analysis and machine learning.
Publisher: lmms-lab | Downloads: 32122 | Topics: Not specified
Hugging Face | MIT | Global or other
ResearchClawBench Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery Quick Start | Submit Tasks | How It Works | Domains | Leaderboard | Add Your Agent ResearchClawBench is a benchmark that measures whether AI coding agents can independently conduct scientific research — from reading raw data…
Publisher: InternScience | Downloads: 32084 | Topics: other, autonomous-agents, scientific-research, benchmark
Hugging Face | MIT | Global or other
This dataset was converted from using the following script. import json import os from datasets import Dataset, DatasetDict, Sequence from datasets import Image as ImageData from PIL import Image MAPPING = {"A": 0, "B": 1, "C": 2, "D": 3} def generatedata(datapath: str): for folder in os.listdir(datapath): folderpath = os.path.join(datapath, folder) image…
Publisher: hiyouga | Downloads: 31290 | Topics: visual-question-answering
Hugging Face | MIT | Global or other
AIME 2024 Dataset Dataset Description This dataset contains problems from the American Invitational Mathematics Examination (AIME) 2024. AIME is a prestigious high school mathematics competition known for its challenging mathematical problems. Dataset Details Format: JSONL Size: 30 records Source: AIME 2024 I & II Language: English Data Fields Each record…
Publisher: Maxwell-Jia | Downloads: 30477 | Topics: text-generation, explanation-generation
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ChilleD for data analysis and machine learning.
Publisher: ChilleD | Downloads: 29761 | Topics: Not specified
Hugging Face | MIT | Global or other
This is the OSS-Instruct dataset generated by gpt-3.5-turbo-1106 developed by OpenAI. Please pay attention to OpenAI's usage policy when adopting this dataset:
Publisher: ise-uiuc | Downloads: 28751 | Topics: text-generation, conversational
Kaggle | MIT | Global or other
This notebook is a processed version of the Global SuperStore dataset.
Publisher: Fatih İlhan | Downloads: 28430 | Topics: marketing, computer science, classification, regression, sql
Hugging Face | MIT | Global or other
Flood Detection Dataset Introduction This dataset accompanies the paper Mapping global floods with 10 years of satellite radar data (Nature Communications, 2025) and contains global flood detections derived from Sentinel-1 Synthetic Aperture Radar (SAR) imagery using a deep learning change detection model. The dataset spans October 2014 – September 2024,…
Publisher: ai-for-good-lab | Downloads: 27829 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Sylvest for data analysis and machine learning.
Publisher: Sylvest | Downloads: 27530 | Topics: Not specified
Hugging Face | MIT | Global or other
Bangumi Image Base of One Piece This is the image base of bangumi One Piece, we detected 303 characters, 35000 images in total. The full dataset is here. Please note that these image bases are not guaranteed to be 100% cleaned, they may be noisy actual. If you intend to manually train models using this dataset, we recommend performing necessary…
Publisher: BangumiBase | Downloads: 26658 | Topics: art
Hugging Face | MIT | Global or other
BrowseComp-Plus Project Page | Paper | Code BrowseComp-Plus is a new benchmark for Deep-Research system, isolating the effect of the retriever and the LLM agent to enable fair, transparent comparisons of Deep-Research agents. The benchmark sources challenging, reasoning-intensive queries from OpenAI's BrowseComp. However, instead of searching the live web,…
Publisher: Tevatron | Downloads: 26515 | Topics: question-answering, retrieval-augmented-generation, benchmark, llm, deep-research
Hugging Face | MIT | Global or other
An Open Robustness Benchmark for Jailbreaking Language Models NeurIPS 2024 Datasets and Benchmarks Track Paper | Leaderboard | Benchmark code What is JailbreakBench? Jailbreakbench is an open-source robustness benchmark for jailbreaking large language models (LLMs). The goal of this benchmark is to comprehensively track progress toward (1) generating…
Publisher: JailbreakBench | Downloads: 25376 | Topics: jailbreaks, large language models, harmful behaviors, ml safety
Hugging Face | MIT | Global or other
Swarming Morphogenesis Evolution (SwarmEvo) Forecasting the evolution of bacterial swarming colonies is a challenging task. Unlike conventional natural scenes, swarming expansion is governed by the propagation of irregular, anisotropic morphological fronts rather than by appearance continuity or pixel-level motion. These fronts undergo rapid…
Publisher: ShengyouDuan | Downloads: 24744 | Topics: feature-extraction, biology, medical
Hugging Face | MIT | Global or other
OmniEdit In this paper, we present OMNI-EDIT, which is an omnipotent editor to handle seven different image editing tasks with any aspect ratio seamlessly. Our contribution is in four folds: (1) OMNI-EDIT is trained by utilizing the supervision from seven different specialist models to ensure task coverage. (2) we utilize importance sampling based on the…
Publisher: TIGER-Lab | Downloads: 24389 | Topics: image
Hugging Face | MIT | Global or other
Data Our training dataset consists of approximately 40,000 unique mathematics problem-answer pairs compiled from: AIME (American Invitational Mathematics Examination) problems (1984-2023) AMC (American Mathematics Competition) problems (prior to 2023) Omni-MATH dataset Still dataset Format Each row in the JSON dataset contains: problem: The mathematical…
Publisher: agentica-org | Downloads: 24072 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ProgramerSalar for data analysis and machine learning.
Publisher: ProgramerSalar | Downloads: 23937 | Topics: Not specified
Hugging Face | MIT | Global or other
The Anthropic Economic Index Overview The Anthropic Economic Index provides insights into how AI is being incorporated into real-world tasks across the modern economy. Data Releases This repository contains multiple data releases, each with its own documentation: Labor market impacts: Job exposure and task penetration data Release: Updated analysis with…
Publisher: Anthropic | Downloads: 23813 | Topics: AI, LLM, Economic Impacts, Anthropic
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Pai3dot14 for data analysis and machine learning.
Publisher: Pai3dot14 | Downloads: 23754 | Topics: Not specified
Hugging Face | MIT | Global or other
Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models Project Page | Paper | GitHub Repository Deform360 is a massive multi-view visuotactile dataset for deformable-object research, featuring 198 daily-life objects, 1,980 interaction sequences, and over 215 hours of observations from 41 surround-view cameras and bimanual tactile…
Publisher: brownu | Downloads: 23460 | Topics: robotics
Hugging Face | MIT | Global or other
natgillin/translations-raw Frozen, canonical raw bitext consolidated from upstream alvations/mtdata-raw snapshots (since deleted). This is the read-only source-of-truth for downstream quality-filtering pipelines. ,663 parquet files (1566.8 GB) language pairs under data/ / Schema: 5 columns — see below Read-only for downstream pipelines. Do not delete or…
Publisher: natgillin | Downloads: 23274 | Topics: translation, parallel-text, mtdata, opus
Kaggle | MIT | Global or other
Blinkit Sales Data: Analyzing Trends and Consumer Behavior
Publisher: Akshit Vaghasiya | Downloads: 22659 | Topics: business, data analytics, retail and shopping, e-commerce services
Hugging Face | MIT | Global or other
MIT-licensed dataset published by sparklabutah for data analysis and machine learning.
Publisher: sparklabutah | Downloads: 22580 | Topics: Not specified
Hugging Face | MIT | Global or other
Anime Character Index This dataset if for collecting all the hot characters from the internet, and extract their features and core tags. It will be useful for automatically testing the character generating ability of the anime-style base models. characters in total. Copyrights Copyright Count kantaicollection pokemon fate(series) hololive bluearchive234…
Publisher: deepghs | Downloads: 22478 | Topics: not-for-all-audiences
Hugging Face | MIT | Global or other
CAR-Bench Dataset CAR-Bench is a benchmark for evaluating AI voice assistants in a realistic automotive (car) environment. It tests an agent's ability to correctly use vehicle control tools, handle disambiguation, and avoid hallucinations. Dataset Structure The dataset is organized into task configs and mock data configs: Tasks Each task defines a user…
Publisher: johanneskirmayr | Downloads: 22166 | Topics: text-generation, question-answering, benchmark, car, voice-assistant
Hugging Face | MIT | Global or other
Dataset Card for CuratedMNIST This dataset is a curated version of the classic MNIST dataset, enriched with model predictions, embeddings, and various analytical fields generated using the FiftyOne library. It was created as part of the "Image Classification and Dataset Curation with FiftyOne and PyTorch" tutorial to demonstrate practical computer vision…
Publisher: Voxel51 | Downloads: 22035 | Topics: image-classification, fiftyone, image, image-classification
Hugging Face | MIT | Global or other
Torch Version of RE10K Dataset This repository contains preprocessed data for the paper TriSplat, VolSplat and ZPressor Citation If you find TriSplat, VolSplat and ZPressor useful for your research, please consider citing: @article{wang2026trisplat, title={TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction}, author={Wang, Weijie and Li, Zimu…
Publisher: lhmd | Downloads: 21859 | Topics: image-to-3d
Hugging Face | MIT | Global or other
MIT-licensed dataset published by behavior-1k for data analysis and machine learning.
Publisher: behavior-1k | Downloads: 21846 | Topics: Not specified
Hugging Face | MIT | Global or other
nd International Chinese Word Segmentation Bakeoff - Data Release Release 1, 2005-11-18 Introduction This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also included is the script used to score the results submitted by the bakeoff participants and the simple segmenter used to…
Publisher: zeroMN | Downloads: 20846 | Topics: text-classification, code
Hugging Face | MIT | Global or other
PIAST Dataset This repo is for downloading transcribed MIDI & and text data of the PIAST Dataset. The audio files can be downloaded by following the process in the github. UPDATES Nov 13, 2024: The MIDI files and text data for both PIAST-AT and PIAST-YT have been uploaded! However, due to a data preprocessing issue, some files are missing compared to the…
Publisher: Hayeonbang | Downloads: 20655 | Topics: music, audio, MIDI, text
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ChilleD for text-generation.
Publisher: ChilleD | Downloads: 20164 | Topics: text-generation
Hugging Face | MIT | Global or other
📦 FreeTacman Robot-free Visuo-Tactile Data Collection System for Contact-rich Manipulation [ICRA 2026] 🎯 Overview This dataset supports the paper FreeTacman: Robot-free Visuo-Tactile Data Collection System for Contact-rich Manipulation. It contains a large-scale, high-precision visuo-tactile manipulation dataset with over 3000k visuo-tactile image pairs,…
Publisher: OpenDriveLab | Downloads: 20143 | Topics: robotics, tactile
Hugging Face | MIT | Global or other
Aesthetic-4K Dataset We introduce Aesthetic-4K, a high-quality dataset for ultra-high-resolution image generation, featuring carefully selected images and captions generated by GPT-4o. Additionally, we have meticulously filtered out low-quality images through manual inspection, excluding those with motion blur, focus issues, or mismatched text prompts. For…
Publisher: zhang0jhon | Downloads: 20101 | Topics: Not specified
Hugging Face | MIT | Global or other
📂 matitie/image-bank-202601 Dataset Description This dataset is part of the Top10Fans monthly archival system, designed to store and deliver processed visual assets for blog content, historical reference, and automated publishing workflows. Each month, a new dataset is created to isolate and version image collections by time period. 📅 Timeframe Month:…
Publisher: matitie | Downloads: 20068 | Topics: image-dataset, webdataset, archival, blog-assets, webp
Kaggle | MIT | Global or other
Comprehensive Statistics and Advanced Metrics for World Cup Player Analysis
Publisher: Ra'uf Fauzan Rambe | Downloads: 19761 | Topics: sports, artificial intelligence, data visualization, data analytics, classification
Hugging Face | MIT | Global or other
MIT-licensed dataset published by bambok for data analysis and machine learning.
Publisher: bambok | Downloads: 19645 | Topics: Not specified
Hugging Face | MIT | Global or other
Face Classification Dataset Dataset de clasificación binaria de rostros para detectar si se trata de imágenes reales o falsas (deepfakes/sintéticas). Descripción Este dataset contiene imágenes clasificadas en dos categorías: REAL: Fotografías reales de rostros FAKE: Imágenes falsas, deepfakes o rostros generados sintéticamente Estructura del Dataset…
Publisher: djramirezp | Downloads: 19329 | Topics: image-classification, face-classification, deepfake-detection, real-vs-fake, image-classification
Hugging Face | MIT | Global or other
VoxCeleb2 Dataset This is the VoxCeleb2 dataset, a large-scale speaker identification dataset. Dataset Description VoxCeleb2 contains over 1 million utterances for 6,112 celebrities, extracted from videos uploaded to YouTube. Files vox2devmp4part: Multipart archive containing MP4 video files vox2devtxt: Text files with speaker/utterance metadata…
Publisher: Reverb | Downloads: 19036 | Topics: automatic-speech-recognition, speaker-verification, audio-classification
Hugging Face | MIT | Global or other
🐋 The OpenOrca Dataset! 🐋 We are thrilled to announce the release of the OpenOrca dataset! This rich collection of augmented FLAN data aligns, as best as possible, with the distributions outlined in the Orca paper. It has been instrumental in generating high-performing model checkpoints and serves as a valuable resource for all NLP researchers and…
Publisher: Open-Orca | Downloads: 18903 | Topics: conversational, text-classification, token-classification, table-question-answering, question-answering
Hugging Face | MIT | Global or other
Persona Cartography — artifact monorepo Artifact store for the paper Persona Cartography: Charting Language Model Personality Traits in Weight Space (arXiv:2607.07916). Code: persona-cartography/persona-cartography. This is not a loaddataset-able dataset — it is a single shared repo holding every artifact the paper's pipeline produces: trained LoRA…
Publisher: persona-cartography | Downloads: 18722 | Topics: lora, peft, llama, personality, big-five
Hugging Face | MIT | Global or other
Bangumi Image Base of Bleach This is the image base of bangumi Bleach, we detected 181 characters, 30903 images in total. The full dataset is here. Please note that these image bases are not guaranteed to be 100% cleaned, they may be noisy actual. If you intend to manually train models using this dataset, we recommend performing necessary preprocessing on…
Publisher: BangumiBase | Downloads: 18553 | Topics: art
Hugging Face | MIT | Global or other
MIT-licensed dataset published by MartinGuo for data analysis and machine learning.
Publisher: MartinGuo | Downloads: 18348 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by jacobbieker for data analysis and machine learning.
Publisher: jacobbieker | Downloads: 18200 | Topics: Not specified
Hugging Face | MIT | Global or other
SWE-smith Dataset Code • Paper • Site [12/14/2025] NOTE: We will no longer actively update this dataset. While this dataset is still functional and usable, we recommend you use the SWE-bench/SWE-smith-[lang] datasets. For better maintainability and ease-of-use, we are maintaining language-specific datasets in lieu of this mono-repo. The SWE-smith Dataset…
Publisher: SWE-bench | Downloads: 18045 | Topics: text-generation, code, agents, software-engineering
Hugging Face | MIT | Global or other
simplipy assets Rule sets and engine configurations for simplipy, a fast, contract-sound simplification engine for symbolic mathematical expressions. Install an engine by name (downloads this repository's files on first use): pip install simplipy import simplipy as sp engine = sp.SimpliPyEngine.fromconfig(sp.getpath("2-1")) # or "3-2", "dev7-3", ... (x0^2…
Publisher: psaegert | Downloads: 17633 | Topics: Not specified
Hugging Face | MIT | Global or other
Cloth-Folding Dataset for X-VLA Paper This dataset contains 1,500 episodes of cloth folding, collected using Agilex's robotic arm. It was used in the X-VLA paper for cloth-folding tasks, showcasing a near-perfect success rate in folding accuracy. Dataset Overview Total Episodes: ～1,500 Task: Automated cloth folding Robot: Agilex Aloha Performance: Near…
Publisher: Facebear | Downloads: 17567 | Topics: robotics
Hugging Face | MIT | Global or other
Dataset Card for UltraFeedback Binarized Dataset Description This is a pre-processed version of the UltraFeedback dataset and was used to train Zephyr-7Β-β, a state of the art chat model at the 7B parameter scale. The original UltraFeedback dataset consists of 64k prompts, where each prompt is accompanied with four model completions from a wide variety of…
Publisher: HuggingFaceH4 | Downloads: 17532 | Topics: text-generation
Hugging Face | MIT | Global or other
Variant Foundation Embeddings Here we present the variant level embeddings for large-scale genetic analyis as described in 'Incorporating LLM Embeddings for Variation Across the Human Genome,' based on curated annotations using high quality functional data from FAVOR, ClinVar, and GWAS Catalog. We currently present embeddings using either OpenAI's…
Publisher: LiLabUNC | Downloads: 17247 | Topics: genetics, LLM, embeddings
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Efficient-Large-Model for data analysis and machine learning.
Publisher: Efficient-Large-Model | Downloads: 17106 | Topics: Not specified
Hugging Face | MIT | Global or other
Topological Traps Dataset TAU Algorithmic Robotics - Fall 2025/2026 - Daniel Simanovsky Pre-processed occupancy grids and Oracle viability labels derived from the HouseExpo residential floor-plan dataset, used to train DanielDDDs/topological-traps. Contents Path Description Size data/processed/ ,001 binary occupancy grids (512x512 px, .npy) 262 MB…
Publisher: DanielDDDS | Downloads: 17037 | Topics: image-segmentation, robotics, occupancy-grid, motion-planning, topological-traps
Hugging Face | MIT | Global or other
Speaker embeddings extracted from CMU ARCTIC There is one .npy file for each utterance in the dataset, 7931 files in total. The speaker embeddings are 512-element X-vectors. The CMU ARCTIC dataset divides the utterances among the following speakers: bdl (US male) slt (US female) jmk (Canadian male) awb (Scottish male) rms (US male) clb (US female) ksp…
Publisher: Matthijs | Downloads: 16930 | Topics: text-to-speech, audio-to-audio
Hugging Face | MIT | Global or other
MIT-licensed dataset published by kjj0 for data analysis and machine learning.
Publisher: kjj0 | Downloads: 16890 | Topics: Not specified
Hugging Face | MIT | Global or other
Yinan Chen 1★ · Jiangning Zhang 1,2★ · Teng Hu 3 · Yuxiang Zeng 4 · Zhucun Xue 1 · Qingdong He 2 · Chengjie Wang 2,3 · Yong Liu 1 · Xiaobin Hu 2 · Shuicheng Yan 5 Zhejiang University YouTu Lab, Tencent Shanghai Jiao Tong University University of Auckland National University of Singapore 😊 Dataset… See the full description on the dataset page:
Publisher: Coraxor | Downloads: 16863 | Topics: Not specified
Hugging Face | MIT | Global or other
MMBERT Decay Phase Data Phase 3 of 3: Annealed language learning decay phase (100B tokens) with massive multilingual expansion to 1833 languages. 📊 Data Composition NOTE: there are multiple decay data mixtures: this mixture described below is the Decay-Cont mixture. However, the data in this repository is the Decay-Eng. If you are interested in the…
Publisher: jhu-clsp | Downloads: 16820 | Topics: fill-mask, pretraining, encoder, multilingual
Hugging Face | MIT | Global or other
GroundCUA: Grounding Computer Use Agents on Human Demonstrations 🌐 Website | 📑 Paper | 🤗 Dataset | 🤖 Models GroundCUA Dataset GroundCUA is a large and diverse dataset of real UI screenshots paired with structured annotations for building multimodal computer use agents. It covers 87 software platforms across productivity tools, browsers, creative tools,…
Publisher: ServiceNow | Downloads: 16573 | Topics: image-to-text, computer_use, agents, grounding, multimodal
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ffzeroHua for data analysis and machine learning.
Publisher: ffzeroHua | Downloads: 16388 | Topics: Not specified
Hugging Face | MIT | Global or other
Latent-SR Embeddings: Precomputed VAE Latents for Medical Image Super-Resolution Precomputed VAE latent embeddings from the paper: "Domain-Specific Latent Representations Improve the Fidelity of Diffusion-Based Medical Image Super-Resolution"Sebastian Cajas, Ashaba Judith, Rahul Gorijavolu, Sahil Kapadia, Hillary Clinton Kasimbazi, Leo Kinyera, Emmanuel…
Publisher: sebasmos | Downloads: 16201 | Topics: image-to-image, medical-imaging, super-resolution, embeddings, MRI
Hugging Face | MIT | Global or other
Danbooru2023: A Large-Scale Crowdsourced and Tagged Anime Illustration Dataset Danbooru2023 is a large-scale anime image dataset with over 5 million images contributed and annotated in detail by an enthusiast community. Image tags cover aspects like characters, scenes, copyrights, artists, etc with an average of 30 tags per image. Danbooru is a veteran…
Publisher: nyanko7 | Downloads: 15993 | Topics: image-classification, image-to-image, text-to-image
Hugging Face | MIT | Global or other
AIME 2025 Dataset Dataset Description This dataset contains problems from the American Invitational Mathematics Examination (AIME) 2025-I & II.
Publisher: opencompass | Downloads: 15930 | Topics: question-answering
Hugging Face | MIT | Global or other
Measuring Multimodal Mathematical Reasoning with the MATH-Vision Dataset [💻 Github] [🌐 Homepage] [📊 Main Leaderboard ] [📊 Open Source Leaderboard ] [🌿 Wild Leaderboard ] [🔍 Visualization] [📖 Paper] 🌿 NEW: MATH-Vision-Wild MATH-Vision-Wild is a photographic, real-world variant of MATH-Vision. The same testmini problems are physically captured on…
Publisher: MathLLMs | Downloads: 15915 | Topics: question-answering, multiple-choice, visual-question-answering, text-generation, image-to-text
Hugging Face | MIT | Global or other
SiftFormer2 Data K400 / SSv2 video classification 학습용 데이터. 구성 siftformer2-data/ ├── k400/ │ ├── trainmanifest.jsonl │ ├── valmanifest.jsonl │ ├── labelmap.json (400 classes) │ ├── train/ # ★ 부분만 업로드 (10K mp4) │ └── val/ # 19,881 mp4 ├── ssv2/ │ ├── trainmanifest.jsonl │ ├── valmanifest.jsonl │ ├── labelmap.json (174 classes) │ └── videos/ # ★ 부분만 업로드 (10K…
Publisher: koreashin | Downloads: 15896 | Topics: video-classification, video, action-recognition, kinetics, something-something
Hugging Face | MIT | Global or other
Danbooru2023: A Large-Scale Crowdsourced and Tagged Anime Illustration Dataset Danbooru2023 is a large-scale anime image dataset with over 5 million images contributed and annotated in detail by an enthusiast community. Image tags cover aspects like characters, scenes, copyrights, artists, etc with an average of 30 tags per image. Danbooru is a veteran…
Publisher: jpft | Downloads: 15838 | Topics: image-classification, image-to-image, text-to-image
Hugging Face | MIT | Global or other
MIT-licensed dataset published by jacobbieker for data analysis and machine learning.
Publisher: jacobbieker | Downloads: 15645 | Topics: Not specified
Hugging Face | MIT | Global or other
Dataset Card for TaskCraft TaskCraft is a multi-modal benchmark dataset featuring tasks ranging from simple (1-step) to expert-level (4-step+). It contains over 40,000 meticulously curated task instances designed to advance research in: Agent-based task processing Tool invocation systems Multi-step reasoning Dataset Details Tool Utilization Tool Category…
Publisher: PersonalAILab | Downloads: 15593 | Topics: synthetic
Hugging Face | MIT | Global or other
Bangumi Image Base of Dungeon Ni Deai Wo Motomeru No Wa Machigatteiru Darou Ka V: Houjou No Megami-hen This is the image base of bangumi Dungeon ni Deai wo Motomeru no wa Machigatteiru Darou ka V: Houjou no Megami-hen, we detected 132 characters, 6223 images in total. The full dataset is here. Please note that these image bases are not guaranteed to be…
Publisher: BangumiBase | Downloads: 15470 | Topics: art
Hugging Face | MIT | Global or other
Bangumi Image Base of A-rank Party Wo Ridatsu Shita Ore Wa, Moto Oshiego-tachi To Meikyuu Shinbu Wo Mezasu. This is the image base of bangumi A-Rank Party wo Ridatsu shita Ore wa, Moto Oshiego-tachi to Meikyuu Shinbu wo Mezasu., we detected 168 characters, 15579 images in total. The full dataset is here. Please note that these image bases are not…
Publisher: BangumiBase | Downloads: 15403 | Topics: art
Hugging Face | MIT | Global or other
All rights and obligations of the dataset are with original authors of the paper/dataset. I have merely made this dataset with a MIT licence available on HuggingFace. BIG-Bench Hard Dataset This repository contains a copy of the BIG-Bench Hard dataset. Small edits to the formatting of the dataset are made to integrate it into the Inspect Evals repository,…
Publisher: Joschka | Downloads: 15339 | Topics: question-answering, text2text-generation, multiple-choice, text-generation, mathematical-reasoning
Hugging Face | MIT | Global or other
Synthetic Veterinary Ultrasound Dataset -- AFAST/POCUS (Dogs & Cats) Procedurally generated synthetic ultrasound images for 4-class AFAST window classification (CC, DH, HR, SR) in small-animal veterinary medicine. NOT real ultrasound. NOT clinically usable. Generator: numpy/PIL with Rayleigh speckle noise + geometric anatomical primitives. Intended for…
Publisher: koscielnamarta | Downloads: 15321 | Topics: image-classification, ultrasound, veterinary, synthetic, AFAST
Hugging Face | MIT | Global or other
Dataset Card for SAR2Opt A collection of 600x600 SAR/EO image pairs at a spatial resolution of 1m. Dataset Details Dataset Description From the paper: We used TerraSAR-X to collect SAR images at the spatial resolution of 1 m of ten cities in Asia, North America, Oceania, and Europe from 2007 to 2013. The corresponding optical images collected from Google…
Publisher: umkc-mcc | Downloads: 15153 | Topics: image-to-image
Hugging Face | MIT | Global or other
Full Modality Dataset Statistics Video Statistics Total Videos: 28,472 Total Duration: 1422.33 hours Average Duration: 179.84 seconds Median Duration: 160.08 seconds Duration Range: 10.04s - 1780.03s QA Statistics Total Questions: 1,444,526 Average Questions per Video: 50.7 Questions per Video Range: 14 - 450 Question Type Distribution OE: 1,444,526…
Publisher: lmms-lab | Downloads: 15098 | Topics: question-answering, multimodal, video-qa, audio-visual
Hugging Face | MIT | Global or other
Banking77Classification An MTEB dataset Massive Text Embedding Benchmark Dataset composed of online banking queries annotated with their corresponding intents. Task category t2c Domains Written Reference How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =…
Publisher: mteb | Downloads: 15006 | Topics: text-classification, mteb, text
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ait4x for data analysis and machine learning.
Publisher: ait4x | Downloads: 14950 | Topics: Not specified
Hugging Face | MIT | India
Chitralekha Dataset Details Dataset Version Some of the fonts do not have proper letters/rendering of different telugu letter combinations. Those have been removed as much as I can find them. If there are any other mistakes that you notice, please raise an issue and I will try my best to look into it Dataset Description This extensive dataset, hosted on…
Publisher: gksriharsha | Downloads: 14833 | Topics: image-to-text
Hugging Face | MIT | Global or other
New to OctoSense? A getting-started Colab notebook walks through loading a sequence and using each modality. Click Open in Colab above to run it in your browser, no setup required. OctoSense is a time-synchronized, calibrated, multi-sensor dataset spanning multiple platforms, all sharing the same sensor rig. The bulk of the data is large-scale driving…
Publisher: anthonytec2 | Downloads: 14652 | Topics: depth-estimation, image-segmentation, robotics, robotics, multimodal
Hugging Face | MIT | Global or other
MIT-licensed dataset published by vaishaal for data analysis and machine learning.
Publisher: vaishaal | Downloads: 14643 | Topics: Not specified
Hugging Face | MIT | Global or other
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "unknown", "totalepisodes": 206, "totalframes": 25650, "totaltasks":1, "totalvideos": 206, "totalchunks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:206" }, "datapath":…
Publisher: lerobot | Downloads: 14495 | Topics: robotics, LeRobot
Hugging Face | MIT | Global or other
Dataset Card for Docmatix Dataset description Docmatix is part of the Idefics3 release (stay tuned). It is a massive dataset for Document Visual Question Answering that was used for the fine-tuning of the vision-language model Idefics3. Load the dataset To load the dataset, install the library datasets with pip install datasets. Then, from datasets import…
Publisher: HuggingFaceM4 | Downloads: 14407 | Topics: visual-question-answering, docvqa
Hugging Face | MIT | Global or other
Bangumi Image Base of Rock Wa Lady No Tashinami Deshite This is the image base of bangumi Rock wa Lady no Tashinami deshite, we detected 104 characters, 7595 images in total. The full dataset is here. Please note that these image bases are not guaranteed to be 100% cleaned, they may be noisy actual. If you intend to manually train models using this…
Publisher: BangumiBase | Downloads: 14331 | Topics: art
Hugging Face | MIT | Global or other
Paper This dataset is released as part of our ECCV 2026 paper: Interpretation-Oriented Cloud Removal via Observation-Anchored Residual Flow with Geo-Contextual Alignment Paper page: arXiv: Code:
Publisher: wzy6055 | Downloads: 14059 | Topics: image-to-image, image-segmentation, depth-estimation, remote-sensing, cloud-removal
Hugging Face | MIT | Global or other
GenPairs GenPairs is a dataset of synthetic images created to probe the impact of concept pairs on multimodal model task accuracy. Each image features at least two concepts, one of which is an ImageNet class, and the model is tasked with producing the correct ImageNet classification in the presence of the other concept(s). We connect the model accuracy to…
Publisher: helenqu | Downloads: 14044 | Topics: Not specified
Hugging Face | MIT | Global or other
ROD-Dataset: Real-Time Obstacle Detection for Smartphone-Based Assistive Vision ,326-image, 25-class YOLO dataset for obstacle detection This dataset is the data product of our Real-Time Obstacle Detection (ROD) project at Amirkabir University of Technology, Tehran. The project addresses two related public-safety problems on the city sidewalk: the limited…
Publisher: jiasea | Downloads: 14006 | Topics: object-detection, yolo, yolov8, object-detection, obstacle-detection
Hugging Face | MIT | Global or other
Complete FABLE.5 Traces 2M Provenance-cleaned FABLE.5 / Claude corpus — trimmed to content-verified traces only. Dataset Viewer | Parquet This dataset is a post-closure compilation of FABLE.5 / Claude trace datasets found on Hugging Face after the closure of Fable and Mythos. It is deduplicated at the normalized-row level and keeps row-level provenance…
Publisher: Crownelius | Downloads: 13978 | Topics: text-generation, agent-traces, traces, claude-code, fable-5
Hugging Face | MIT | Global or other
MIT-licensed dataset published by hwjiang for data analysis and machine learning.
Publisher: hwjiang | Downloads: 13889 | Topics: Not specified
Hugging Face | MIT | Global or other
UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction Introduction Autonomous agents that navigate Graphical User Interfaces (GUIs) to automate tasks like document editing and file management can greatly enhance computer workflows. While existing research focuses on online settings, desktop environments, critical for many…
Publisher: ServiceNow | Downloads: 13762 | Topics: image-text-to-text
Hugging Face | MIT | India
Dataset Card for ruralindiatriageprotocols Dataset Summary ruralindiatriageprotocols is a specialized, multilingual healthcare instruction-tuning dataset designed for training clinical decision-support AI systems deployed in resource-constrained rural settings. It contains 11,217 high-quality medical reasoning pairs covering 14+ critical emergency…
Publisher: Saurabhkumarozp61 | Downloads: 13649 | Topics: medical, healthcare, instruction-tuning
Hugging Face | MIT | Global or other
DROID 1.0.1 — native 720p, packed (LeRobot v3.0) A native 1280×720 re-encode of the DROID robot-manipulation dataset in LeRobot v3.0 format, with videos packed into 500 MB files like the original lerobot/droid1.0.1. It reuses droid1.0.1's exact tabular data (states / actions / camera extrinsics / task instructions) and replaces the low-resolution (320×180)…
Publisher: XinxuanLuM | Downloads: 13424 | Topics: robotics, robotics, manipulation, droid, lerobot
Hugging Face | MIT | Global or other
MIT-licensed dataset published by lzw1008 for data analysis and machine learning.
Publisher: lzw1008 | Downloads: 13403 | Topics: Not specified
Hugging Face | MIT | Global or other
Reverse-Text-RL A small, scrappy RL dataset used in prime-rl's CI to debug RL training asking a model to reverse small sentences character-by-character. Follows the general format of PrimeIntellect/Reverse-Text-SFT The following script was used to generate the dataset. from datasets import Dataset, loaddataset dataset =…
Publisher: PrimeIntellect | Downloads: 13366 | Topics: question-answering, text-generation, rl
Hugging Face | MIT | Global or other
AutoLibra ⚖️ Agent Metric Induction from Open-Ended Human Feedback Hao Zhu, Phil Cuvin, Xinkai Yu, Charlotte Ka Yee Yan, Jason Zhang, Diyi Yang, Arxiv AutoLibra Dataset Organization Annotation Format Contact Hao Zhu: zhuhao@stanford.edu Acknowledgement Citation <!-- bibtex @misc{rezaei2025egonormiabenchmarkingphysicalsocial, title={EgoNormia: Benchmarking…
Publisher: open-social-world | Downloads: 13182 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by julien-c for time-series-forecasting.
Publisher: julien-c | Downloads: 13084 | Topics: time-series-forecasting
Hugging Face | MIT | Global or other
MIT-licensed dataset published by mxgx110 for data analysis and machine learning.
Publisher: mxgx110 | Downloads: 13009 | Topics: Not specified
Hugging Face | MIT | Global or other
UltraFeedback - Binarized using the Average of Preference Ratings (Cleaned) This dataset represents a new iteration on top of argilla/ultrafeedback-binarized-preferences, and is the recommended and preferred dataset by Argilla to use from now on when fine-tuning on UltraFeedback. Read more about Argilla's approach towards UltraFeedback binarization at…
Publisher: argilla | Downloads: 12946 | Topics: text-generation, dpo, preference, ultrafeedback
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ermu2001 for data analysis and machine learning.
Publisher: ermu2001 | Downloads: 12913 | Topics: Not specified
Hugging Face | MIT | Global or other
SpreadsheetBench 2 Home Page SpreadsheetBench 2 is a benchmark for evaluating agents on end-to-end business spreadsheet workflows. Unlike existing benchmarks that focus on isolated manipulations, SpreadsheetBench 2 requires agents to (1) complete workflow-level goals through multi-step coordinated operations, (2) perform cross-sheet reasoningwithin complex…
Publisher: KAKA22 | Downloads: 12492 | Topics: Not specified
Hugging Face | MIT | Global or other
SummEvalSummarization.v2 An MTEB dataset Massive Text Embedding Benchmark News Article Summary Semantic Similarity Estimation. This version fixes a bug in the evaluation script that caused the main score to be computed incorrectly. Task category t2t Domains News, Written Reference How to evaluate on this task You can evaluate an embedding model on this…
Publisher: mteb | Downloads: 12366 | Topics: summarization, mteb, text
Hugging Face | MIT | Global or other
MIT-licensed dataset published by KROX777 for data analysis and machine learning.
Publisher: KROX777 | Downloads: 12276 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by charatan for data analysis and machine learning.
Publisher: charatan | Downloads: 12257 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by xuanlinli17 for data analysis and machine learning.
Publisher: xuanlinli17 | Downloads: 12252 | Topics: Not specified
Hugging Face | MIT | Global or other
🚧 Update (Sep 29th, 2025) We updated our paper, where we removed some in-efficient and high-cost samples. We also added a sub-sample of DetectiveQA. (July 7th, 2025) We released the initial version of our datasets. (July 22nd, 2025) We modify the datasets slightly, adding the keypoints in LRU and change the uuid into qapairids. The questionids is only…
Publisher: ai-hyz | Downloads: 12245 | Topics: question-answering, zero-shot-classification, summarization, text-classification, text-generation
Hugging Face | MIT | Global or other
This dataset replaces the original LongMemEval dataset. The main difference is that this version removes noisy history sessions that interfere with the answer correctness. More detailed session processing information can be found here.
Publisher: xiaowu0162 | Downloads: 12117 | Topics: Not specified
Hugging Face | MIT | Global or other
DeepMath-103K 🔥 News May 8, 2025: We found that 48 samples contained hints that revealed the answers. The relevant questions have now been revised to remove the leaked answers. April 14, 2025: We release DeepMath-103K, a large-scale dataset featuring challenging, verifiable, and decontaminated math problems tailored for RL and SFT. We open source:… See…
Publisher: zwhe99 | Downloads: 12090 | Topics: text-generation, text2text-generation, math, reasoning, rl
Hugging Face | MIT | Global or other
GUI-360°: A Comprehensive Dataset And Benchmark For Computer-Using Agents Paper | Code GUI-360° is a large-scale, comprehensive dataset and benchmark suite designed to advance Computer-Using Agents (CUAs). 🎯 Key Features 🔢 1.2M+ executed action steps across thousands of trajectories 💼 Popular Windows office applications (Word, Excel, PowerPoint) 📸…
Publisher: vyokky | Downloads: 12085 | Topics: image-text-to-text
Hugging Face | MIT | Global or other
ModelNet40 Auto Aligned Auto-aligned version of the ModelNet40 3D CAD dataset. Each sample is an OFF mesh file organized by class and train/test split. This dataset mirrors the layout of naderalfares/ModelNet40, but uses the auto-aligned meshes from the Princeton ModelNet release. Dataset structure modelnet40autoaligned/ {class}/ train/{class}{id}.off…
Publisher: naderalfares | Downloads: 11980 | Topics: image-classification, 3d, point-cloud, mesh, modelnet40
Hugging Face | MIT | Global or other
MIT-licensed dataset published by zrchen03 for data analysis and machine learning.
Publisher: zrchen03 | Downloads: 11945 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by Graphite-AI for data analysis and machine learning.
Publisher: Graphite-AI | Downloads: 11925 | Topics: Not specified
Hugging Face | MIT | Global or other
VITRA-1M: Human Hand V-L-A Dataset Dataset Summary VITRA-1M is a large-scale Human Hand Visual-Language-Action (V-L-A) dataset constructed as described in the paper Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videos. It contains 1.2 million short episodes with segmented language annotations,…
Publisher: VITRA-VLA | Downloads: 11868 | Topics: Embodied-AI, Robotic manipulation, Vision-Language-Action model, Human Video, Dexterous Hand
Hugging Face | MIT | Global or other
populace-us The populace-built US population: a calibrated synthetic microdataset for PolicyEngine-US, built by the populace stack entirely from primary sources — the enhanced CPS appears only as the benchmark this file is scored against, never as a build input. It loads anywhere the enhanced CPS loads (an API-compatible alternative population), with its…
Publisher: policyengine | Downloads: 11810 | Topics: policyengine, microsimulation, synthetic-population, tax-benefit, united-states
Hugging Face | MIT | Global or other
RoboCerebra VideoQA Benchmark This directory contains the Video Question Answering benchmark for evaluating RoboCerebra models on action progress and task completion understanding. Files eval.py: Evaluation template script. test.json: Test set for progress estimation. qwen25vlvlmdata/: Training data.
Publisher: qiukingballball | Downloads: 11806 | Topics: Not specified
Hugging Face | MIT | Global or other
MIT-licensed dataset published by InternRobotics for data analysis and machine learning.
Publisher: InternRobotics | Downloads: 11737 | Topics: Not specified
Hugging Face | MIT | Global or other
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 20000, "totaltasks": 1, "totalvideos": 50, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
Publisher: lerobot | Downloads: 11641 | Topics: robotics, LeRobot, aloha
Hugging Face | MIT | Global or other
🛠️ Flat-Pack Bench Misc This repository contains auxiliary artifacts for Flat-Pack Bench: ablation questions with scrambled part IDs, corresponding prompt-mask variants, cached TVA segmentation tracks, and TVA agent traces. The main benchmark data and evaluation outputs live in the companion Flat-Pack Bench repositories; this repo keeps the heavier or…
Publisher: justachetan | Downloads: 11568 | Topics: visual-question-answering, video-text-to-text, multiple-choice, vision-language, video-understanding
Hugging Face | MIT | Global or other
MIT-licensed dataset published by oshaban for data analysis and machine learning.
Publisher: oshaban | Downloads: 11529 | Topics: Not specified
Kaggle | MIT | India
Indian Kids Screen Time Dataset (Ages 8–18) – Urban & Rural Insights
Publisher: Ankush Panday | Downloads: 11509 | Topics: education, exploratory data analysis, data cleaning, data visualization, data analytics
Hugging Face | MIT | Global or other
OpenMedallion Financial Dataset Comprehensive financial dataset for quantitative research, machine learning, and trading strategy backtesting. ,609 Parquet files · 18 categories · 1,500+ unique assets · 87+ countries · Up to 100 years of history Quick Start import pandas as pd Load BTC 1h data (5 years) df = pd.readparquet("data/BTC-BTCUSD1h.parquet") Load…
Publisher: oyi77 | Downloads: 11486 | Topics: tabular-regression, time-series-forecasting, finance, trading, crypto
Hugging Face | MIT | Global or other
ImageNet-R This repo is made to facilitate the evaluation of various pretraining models. It's constructed from the source file provided by official implementation. Usage from datasets import loaddataset dataset = loaddataset('axiong/imagenet-r') Dataset Summary ImageNet-R(endition) contains art, cartoons, deviantart, graffiti, embroidery, graphics,…
Publisher: axiong | Downloads: 11413 | Topics: Not specified
Hugging Face | MIT | Global or other
Companion dataset for the AI-vs-human rubric study This dataset is the data side of an anonymous NeurIPS submission. It pairs with a separate anonymous code repository that contains the runnable scripts, validators, and documentation. The two artifacts together reproduce every paper-facing headline number without re-running any API-backed stage. The code…
Publisher: forreview43 | Downloads: 11379 | Topics: moral-reasoning, llm-evaluation, rubric, morebench
Hugging Face | MIT | Global or other
Video training data of LongVU downloaded from Video Please download the original videos from the provided links: BDD100K: bdd.zip ShareGPTVideo: CLEVRER: clevrerqa.zip DiDeMo: didemo.zip EgoQA: k400.zip MovieChat: moviechat.zip… See the full description on the dataset page:
Publisher: shenxq | Downloads: 11225 | Topics: video-text-to-text
Hugging Face | MIT | Global or other
The GrandTour Dataset A project brought to you by RSL - ETH Zurich. References • Contributing • Citation References Official dataset webpage: grand-tour.leggedrobotics.com Getting started & examples: github.com/leggedrobotics/grandtourdataset Boxi used to collect the data: github.com/leggedrobotics/grandtourbox Contributing We warmly welcome contributions…
Publisher: leggedrobotics | Downloads: 11211 | Topics: robotics, robotics, lidar, camera, vision
Hugging Face | MIT | Global or other
Dataset Description Dataset Summary The NeedleBench dataset is a part of the OpenCompass project, designed to evaluate the capabilities of large language models (LLMs) in processing and understanding long documents. It includes a series of test scenarios that assess models' abilities in long text information extraction and reasoning. The dataset is…
Publisher: opencompass | Downloads: 11210 | Topics: question-answering
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ccl4u for data analysis and machine learning.
Publisher: ccl4u | Downloads: 11125 | Topics: Not specified
Hugging Face | MIT | Global or other
Comet-1.5k — RFT Dataset (Openpi-Comet) This repository releases Comet-1.5k, an RFT (Rejection Sampling Fine-Tuning) dataset generated by Team Comet’s post-training pipeline on the BEHAVIOR-1K simulator (OmniGibson).It is intended to support reproducible research on post-training for VLA policies, dataset construction via rejection sampling, and efficient…
Publisher: delinqu | Downloads: 11100 | Topics: robotics, behavior-1k-challenge, omnigibson, embodied-ai, vla
Hugging Face | MIT | Global or other
Introduction This repository contains the data for Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources. Project page: Code: Dataset ccsebdataset: CC3M-CC12M-SBU filtered by CLIP, we directly download the webdataset based on the released of curated subset of BLIP-1 datacompmediumdfnwebdataset:…
Publisher: weizhiwang | Downloads: 11078 | Topics: image-text-to-text
Hugging Face | MIT | Global or other
P&ID Line Detection Dataset This dataset contains cropped images from P&ID (Piping and Instrumentation Diagrams) with line segment annotations for line detection and segmentation tasks. Dataset Splits The dataset is split by source image to prevent data leakage: Split Source Images Samples Line Segments Train (80%) ,000 ,483 Validation (10%) ,000 ,485 Test…
Publisher: prasatee | Downloads: 11060 | Topics: image-segmentation, object-detection, P&ID, lines, pipelines
Hugging Face | MIT | Global or other
Importance Matrix Calibration Datasets This repository provides calibration datasets used to generate importance matrices (imatrix), which are required to minimize errors when quantizing models with LLaMA C++. The llama-imatrix program cannot handle parquet files directly and thus requires them to be converted into text format first. There are many ways to…
Publisher: eaddario | Downloads: 11013 | Topics: text-generation
Kaggle | MIT | Global or other
Social Media Impact On Teen Mental Health Prediction
Publisher: sunil kumar | Downloads: 5955 | Topics: artificial intelligence, exploratory data analysis, data visualization, data analytics, classification
Kaggle | MIT | India
Motorcycle Sales Data Across Indian
Publisher: Akshay Kumar | Downloads: 5583 | Topics: water bodies, india, cycling, beginner, urban planning
Kaggle | MIT | India
In-depth constituency-wise results of the 2024 Indian parliamentary elections
Publisher: Nuhman PK | Downloads: 5067 | Topics: government, politics, beginner, statistical analysis, classification
Kaggle | MIT | India
Comprehensive Accident Data for Risk Assessment and Prediction
Publisher: Khushi Yadav | Downloads: 5015 | Topics: Not specified
Kaggle | MIT | India
Rising Phone Usage in India
Publisher: AkashSharma0105 | Downloads: 5007 | Topics: india, science and technology, internet, mobile and wireless, python
Kaggle | MIT | India
import data of india and export data
Publisher: Harinkl | Downloads: 4028 | Topics: research, india, education, economics, transportation
Kaggle | MIT | India
Comprehensive Cardiovascular Health Data Covering Risk Factors, Demographics.
Publisher: Ankush Panday | Downloads: 3792 | Topics: health, heart conditions
Kaggle | MIT | India
Small Multiclass Image Classification on food Dataset
Publisher: Pushkar Jain | Downloads: 3612 | Topics: deep learning, neural networks, cnn, multiclass classification, transfer learning
Kaggle | MIT | Global or other
Introduction to the Titanic Dataset
Publisher: Amn Amine | Downloads: 3589 | Topics: artificial intelligence, beginner, tabular, binary classification, english
Kaggle | MIT | Global or other
30,000 e-commerce orders for customer analytics, sales forecasting, and ML.
Publisher: Muhammad Umair | Downloads: 3431 | Topics: business, classification, model explainability, retail and shopping, online communities
Kaggle | MIT | India
Indian Traffic Violation Dataset (2023-2024) 🚦📊
Publisher: Khushi Yadav | Downloads: 3152 | Topics: law
Kaggle | MIT | India
Comprehensive Dataset of Indian Pharmaceutical Product with Prices & Composition
Publisher: Rishabh Sharma | Downloads: 3110 | Topics: india, health, medicine, tabular, drugs and medications
Kaggle | MIT | India
A Dataset ofCars Across Major Brands in India
Publisher: Akshay Kumar | Downloads: 2959 | Topics: finance, beginner, insurance, automl
Kaggle | MIT | India
Understanding Applicant Details for Loan Approval in India
Publisher: Yamin Hossain | Downloads: 2467 | Topics: finance, economics, tabular, investing, english
Kaggle | MIT | India
"cyber crime in india from a certain time span"
Publisher: Sevenzee7 | Downloads: 2432 | Topics: india, crime, bigquery, english, cyber security
Kaggle | MIT | India
Indian Cities Distance Dataset for Route Finding.
Publisher: K.B. Dharun Krishna | Downloads: 2417 | Topics: india, artificial intelligence, beginner, optimization, python
Kaggle | MIT | India
A multi-year dataset for water quality research and analysis.
Publisher: Rishab Chitloor | Downloads: 2306 | Topics: water bodies, india, environment, pollution, agriculture
Kaggle | MIT | Global or other
Synthetic E-Commerce Dataset for Recommendation Systems and Graph ML
Publisher: Anuj Saha | Downloads: 2282 | Topics: nlp, recommender systems, e-commerce services, synthetic
Kaggle | MIT | India
A comprehensive labelled dataset of Road Damages in India
Publisher: Rohit Suresh15 | Downloads: 2220 | Topics: law, automobiles and vehicles, image, video, eyes and vision
Kaggle | MIT | India
Track air pollution trends across Indian cities with 235,000+ AQI records from 3
Publisher: Sai Kiran Udayana | Downloads: 2127 | Topics: india, health and fitness, healthcare, earth and nature, environment
Kaggle | MIT | India
Residential Rental Listings in Major Indian Cities Why this fits
Publisher: Pranav Shinde | Downloads: 2005 | Topics: computer science, exploratory data analysis, data cleaning, python, ml ethics
Kaggle | MIT | Global or other
Gen-Z College Admission Prediction
Publisher: Stable Space | Downloads: 1981 | Topics: people, people and society, education, exploratory data analysis, survey analysis
Kaggle | MIT | India
DEATH REASON ANALYSE IN INDIA
Publisher: Harinkl | Downloads: 1829 | Topics: india, diseases, health, data analytics, tabular
Kaggle | MIT | India
Data gathered and compiled from the official NTA Website
Publisher: Abdullah Sheriff | Downloads: 1825 | Topics: india, education, tabular, standardized testing, english
Kaggle | MIT | India
A Dataset of Marriages Analyzing Social, Economic, and Cultural Factors
Publisher: Akshay Kumar | Downloads: 1759 | Topics: india, astronomy, gender, health, beginner
Kaggle | MIT | Global or other
Predict the Price of Used Phone with this Dataset
Publisher: Stable Space | Downloads: 1486 | Topics: people, people and society, business, education
Kaggle | MIT | Global or other
A synthetic automobile dataset containing vehicle specifications, ownership hist
Publisher: DeepLumiere | Downloads: 1424 | Topics: classification, tabular, synthetic
Hugging Face | MIT | Global or other
MIT-licensed dataset published by ai4bharat for data analysis and machine learning.
Publisher: ai4bharat | Downloads: 1404 | Topics: Not specified
Kaggle | MIT | Global or other
The Data Behind the World's Electric Future
Publisher: AI Explorer | Downloads: 1402 | Topics: people and society, exploratory data analysis, data analytics, classification, regression
Kaggle | MIT | India
Data Analyst Job Opening in India scraped from Ambition Box
Publisher: ISHAQ BASHA | Downloads: 1377 | Topics: india, employment, computer science, programming, data cleaning
Kaggle | MIT | India
The Ultimate Indian Railways Dataset
Publisher: Rohan Patel | Downloads: 1323 | Topics: india, government, automobiles and vehicles, rail transport, json
Kaggle | MIT | Global or other
Comprehensive Vehicle Specifications and Market Price Data for Machine Learning
Publisher: Muhammad Musharraf | Downloads: 1304 | Topics: intermediate, data cleaning, recommender systems, tabular, regression
Kaggle | MIT | India
Comprises of Electricity consumption of each sector in Indian cities
Publisher: Aniket | Downloads: 1288 | Topics: cities and urban areas, india, energy, electricity
Kaggle | MIT | Global or other
Best dataset to practice data cleaning
Publisher: Satyaki Das | Downloads: 1246 | Topics: data cleaning, data visualization, data analytics, tabular, data storytelling
Kaggle | MIT | India
Impact of different types of food on India people
Publisher: MOHAMMAD HARIS | Downloads: 1244 | Topics: health
Kaggle | MIT | Global or other
Student lifestyle habits and their impact on academic performance data
Publisher: Rafi003 | Downloads: 1107 | Topics: categorical, tabular, multimodal
Kaggle | MIT | India
Clean CSV Dataset of Weather & Air Quality Metrics (India)
Publisher: Aatif Ahmad | Downloads: 1104 | Topics: cities and urban areas, india, pollution, weather and climate
Kaggle | MIT | India
MIT-licensed public dataset covering categorical, marketing, mobile and wireless.
Publisher: Prathamesh Mistry | Downloads: 1074 | Topics: categorical, marketing, mobile and wireless, electronics, retail and shopping
Kaggle | MIT | Global or other
📊 FIFA World Cup 2026 – Dataset
Publisher: Wasiq Ali | Downloads: 1053 | Topics: games, football, advanced, data visualization
Kaggle | MIT | Global or other
MIT-licensed public dataset covering analytics and machine learning.
Publisher: Jeroen Cottaar | Downloads: 1036 | Topics: Not specified
Kaggle | MIT | India
A Comprehensive Dataset of India's Top Tourist Destinations with Ratings
Publisher: Kirtan Dwivedi | Downloads: 984 | Topics: india, beginner, holidays and cultural events, ratings and reviews, travel
Kaggle | MIT | India
The (encouraged) goal is to predict the delivery time for each order.
Publisher: changle.changsu | Downloads: 949 | Topics: india, business, data analytics, text, regression
Kaggle | MIT | India
20,000 synthetic patient records covering 32 diseases across 7 categories.
Publisher: Ashutosh Singh | Downloads: 861 | Topics: india, mental health, medicine, tabular, ml ethics
Kaggle | MIT | India
Unveil the Colors of Culture: Explore the Rich Tapestry of Indian Art 🎨✨
Publisher: ajg117 | Downloads: 830 | Topics: arts and entertainment, art, categorical, deep learning, image
Kaggle | MIT | Global or other
80K+ Apple product prices, discounts, ratings & stock data from Amazon and Flipk
Publisher: Aleesha Nadeem | Downloads: 773 | Topics: automobiles and vehicles, exploratory data analysis, data cleaning, data visualization, data analytics
Kaggle | MIT | Global or other
A comprehensive, automatically updated dataset of trending YouTube videos
Publisher: Samyakraj Bayar | Downloads: 768 | Topics: data cleaning, data analytics, social networks
Kaggle | MIT | India
5,000 job listings across MNCs, Unicorns, Startups & PSUs with salary and skills
Publisher: Sridip Basu | Downloads: 741 | Topics: india, employment, classification, regression, jobs and career
Kaggle | MIT | Global or other
"Beginner-friendly synthetic dataset for practicing EDA, classification
Publisher: Gaurav Jha (eigen vector) | Downloads: 737 | Topics: artificial intelligence, beginner, data analytics, classification, tabular
Kaggle | MIT | India
Preparation and Cooking Times for Indian Dishes
Publisher: Decent Sanage | Downloads: 732 | Topics: categorical, cooking and recipes
Kaggle | MIT | India
Indian Tourist Places
Publisher: Dhrubang Talukdar | Downloads: 650 | Topics: cities and urban areas, india, geography, people and society, travel
Kaggle | MIT | Global or other
This is real Airline Passenger Satisfaction Dataset.
Publisher: Рустам Раджабов | Downloads: 582 | Topics: aviation, beginner, tabular, binary classification, english
Kaggle | MIT | Global or other
A cleaned dataset of Steam games with 30000 rows
Publisher: New Nguyễn | Downloads: 553 | Topics: beginner, exploratory data analysis, deep learning, tabular, question answering
Kaggle | MIT | India
Exploring the Rich Heritage: Indian Forts Dataset
Publisher: Ayush Khaire | Downloads: 523 | Topics: india, history, travel, json, english
Kaggle | MIT | Global or other
A Comprehensive Global of RPA Technologies, Vendors, Industry, and Automation
Publisher: Ra'uf Fauzan Rambe | Downloads: 507 | Topics: business, robotics, artificial intelligence, data analytics, optimization
Kaggle | MIT | India
User Preferences & Ratings for 20 Iconic Indian OTT Originals
Publisher: The Dataset Engineer | Downloads: 502 | Topics: movies and tv shows, india, recommender systems, pca, ratings and reviews
Kaggle | MIT | Global or other
\Trains a Random Forest regressor on Dataset/train.csv.
Publisher: Mussab | Downloads: 497 | Topics: mobile and wireless, data storytelling
Kaggle | MIT | India
Structured list of Indian universities with type, location, and founding year
Publisher: aaaditya56 | Downloads: 484 | Topics: universities and colleges
Kaggle | MIT | India
NSE/BSE Master Dataset: 1.6M+ Records & Time-Series Matrix
Publisher: krish Chaudhary | Downloads: 479 | Topics: Not specified
Kaggle | MIT | Global or other
A Synthetic Digital Twin for Sustainable Cloud Infrastructure, AI Workload Optim
Publisher: DeepLumiere | Downloads: 423 | Topics: tabular, benchmark
Kaggle | MIT | India
Collections of Data on Laws and Acts of India
Publisher: Kausthub Kannan | Downloads: 405 | Topics: india, government, nlp, social issues and advocacy
Kaggle | MIT | Global or other
Simulated Mortgage Dataset for loan limit prediction
Publisher: Osegbo Chukwuemeka | Downloads: 382 | Topics: finance, regression
Kaggle | MIT | India
Synthetic dataset of 22,000 street food vendors for survival prediction modeling
Publisher: SINAN SHEREEF | Downloads: 359 | Topics: cities and urban areas, india, artificial intelligence, classification, synthetic
Kaggle | MIT | India
Occurrence of HIV patients in India
Publisher: atultiwari01 | Downloads: 352 | Topics: healthcare, public health, health, health conditions, heart conditions
Kaggle | MIT | India
Structured JSON of Indian labour, employment & corporate law sections — LLM/RAG
Publisher: Vinayak Mishra | Downloads: 337 | Topics: law, retrieval question answering, sentence similarity, summarization, general knowledge and reasoning
Kaggle | MIT | India
On Time or Not? A Year of Indian Railways Delay Data
Publisher: RXYDENXD | Downloads: 312 | Topics: india, transportation, tabular, english
Kaggle | MIT | Global or other
This dataset merges two public sources to enable cross-analysis of crime pattern
Publisher: Luca Guerra | Downloads: 292 | Topics: united states, crime, government, tabular, social issues and advocacy
Kaggle | MIT | Global or other
1000 films scored across 25+ criterias that viewers actually care about.
Publisher: Pome Grenade | Downloads: 249 | Topics: movies and tv shows, artificial intelligence, feature engineering, ratings and reviews, synthetic
Hugging Face | MIT | Global or other
Focus Dataset Focus is meta-evaluation benchmark designed to assess the robustness of evaluator VLMs across diverse Image-to-Text (I2T) and Text-to-Image (T2I) tasks. Please refer to our paper for more details. Code The code to generate the perturbations and run evaluations are available on our github repository: ai4bharat/focus Subsets Subset Description…
Publisher: ai4bharat | Downloads: 249 | Topics: image-to-text, visual-question-answering
Kaggle | MIT | Global or other
MIT-licensed public dataset covering synthetic.
Publisher: Igor Zharov | Downloads: 230 | Topics: synthetic
Kaggle | MIT | Global or other
LeetCode problem analytics with topics, difficulty stats, and ML-ready structure
Publisher: Krishna Yadu | Downloads: 223 | Topics: education, programming, exploratory data analysis, ml ethics, data storytelling
Kaggle | MIT | Global or other
Global country indicators dataset (2000–2026) for 217 sovereign nations.
Publisher: Ashutosh Singh | Downloads: 218 | Topics: earth and nature, education, economics, intermediate, text
Kaggle | MIT | India
A collection of news articles from India, covering diverse categories
Publisher: jatinkalra17 | Downloads: 215 | Topics: india, beginner, nlp, tabular, news
Kaggle | MIT | Global or other
A Large-Scale Synthetic Dataset for Detecting AI-Generated vs Human-Written Text
Publisher: Shanza Shakeel | Downloads: 213 | Topics: artificial intelligence, nlp, deep learning, python, synthetic
Kaggle | MIT | Global or other
Solar Plant Power Generation and Performance Monitoring Dataset (2023-2025)
Publisher: juan schafle | Downloads: 204 | Topics: china , environment, energy, tabular, electricity
Kaggle | MIT | Global or other
Vienna rental listings from popular websites
Publisher: Thomas Gaehtgens | Downloads: 192 | Topics: europe, real estate, tabular
Kaggle | MIT | Global or other
E-Commerce Customer Behavior and Logistics Dataset
Publisher: DeepLumiere | Downloads: 191 | Topics: tabular, e-commerce services, tabular classification
Kaggle | MIT | Global or other
18 VHDL design tasks + 216 toolchain-backed LLM-evaluation results (GHDL/Yosys)
Publisher: Clara Ureche | Downloads: 177 | Topics: benchmark
Kaggle | MIT | Global or other
30,000 English comments with toxicity labels for content moderation, NLP, and ma
Publisher: Muhammad Umair | Downloads: 173 | Topics: artificial intelligence, nlp, deep learning, online communities, text classification
Kaggle | MIT | Global or other
Annual population estimates for countries and regions from World Bank API
Publisher: Adarsh Salukhe | Downloads: 156 | Topics: banking, intermediate, data analytics, tabular, news
Kaggle | MIT | India
87 High-Res (512x512) image chips of dense urban foliage with binary masks.
Publisher: Asim | Downloads: 152 | Topics: india, earth and nature, computer vision, urban planning, image segmentation
Kaggle | MIT | Global or other
Optuna and RFE parameters used in PS-S06E07 model notebooks
Publisher: Stephen Tarter | Downloads: 147 | Topics: Not specified
Kaggle | MIT | Global or other
Synthetic climate observations with temperature, precipitation, CO₂, humidity
Publisher: Mirza Yasir Abdullah Baig | Downloads: 127 | Topics: artificial intelligence, data cleaning, computer vision, data analytics, synthetic
Hugging Face | MIT | India
🌏 Multilingual Indic RAG Suite A comprehensive multilingual question-answering dataset covering 18 Indian languages with 21,439,886 total samples, designed for RAG (Retrieval-Augmented Generation) applications and multilingual NLP research. 🚀 Quick Start from datasets import loaddataset Load specific language (recommended) dataset =…
Publisher: ai4bharat | Downloads: 126 | Topics: question-answering, text-generation, indian-languages, multilingual, indic
Hugging Face | MIT | India
🔍 IndicMSMARCO: Multilingual Information Retrieval Benchmark A comprehensive multilingual variant of MS MARCO specifically tailored for Indian languages, featuring carefully selected queries and corresponding passages with high-quality translations. 🚀 Quick Start - Load Individual Languages from datasets import loaddataset Load ONLY Hindi data (fast and…
Publisher: ai4bharat | Downloads: 121 | Topics: text-retrieval, question-answering, indian-languages, multilingual, indic
Kaggle | MIT | Global or other
Vegetable Object Detection Dataset (YOLO Format)
Publisher: Denuwan Wijesinghe | Downloads: 111 | Topics: agriculture, advanced, computer vision, food, image classification
Kaggle | MIT | India
Electoral Bonds were a mode of funding for political parties in India.
Publisher: Thunder | Downloads: 107 | Topics: finance, politics, banking
Kaggle | MIT | Global or other
Bitcoin News Headlines Sentiment Dataset (2011-2024) + 500 synthetic data
Publisher: HiyawTaken | Downloads: 106 | Topics: finance, text, currencies and foreign exchange
By Rusaka Research · Published 2026-07-27 · Updated 2026-07-27 · 3260 words
MIT Open Dataset Catalogue helps teams make a consequential use-case selection, data readiness, model choice, deployment, or responsible operation decision without confusing a polished document or tool with reliable evidence. The resource is designed for Engineering leaders, Developers, Product managers, Technology buyers and provides a structured path from a bounded question to an accountable decision, controlled implementation, and measurable review.
Use this resource as a working system. Adapt it to the organisation, but retain the evidence fields, owners, dates, assumptions, limitations, controls, and approval points. The objective is not uniform paperwork. It is to make decisions easier to inspect, challenge, operate, and update as conditions change.
The recurring problem in Machine Learning Engineering is not a shortage of ideas. It is the distance between an attractive idea and the evidence required to act responsibly. Teams may begin with undefined scope, mixed units, weak baselines, optimistic benefits, or technology choices made before requirements are clear.
That creates model error, bias, privacy, security, drift, unsupported automation, and unclear accountability. A recommendation can sound precise while hiding who owns the outcome, which claims are verified, what happens when assumptions fail, and how the organisation will operate the result after launch. MIT Open Dataset Catalogue closes those gaps by making the decision chain explicit.
The correct starting point is representative data, process volumes, error rates, human effort, current outcomes, and documented data rights. If that baseline cannot be assembled, treat the absence as a finding. Do not replace missing evidence with a more elaborate model. Define the minimum evidence needed for the next reversible step and assign responsibility for obtaining it.
A well-governed documented dataset reduces rework because scope, evidence, ownership, and acceptance criteria are agreed before expensive execution. It also improves review quality: specialists can challenge the assumptions relevant to their discipline without reconstructing the entire decision from meetings and messages.
The business value should be visible through task quality, groundedness, error severity, latency, adoption, cost per outcome, and human override rates. These measures need calculation rules, owners, data sources, and review dates. Activity measures may help manage delivery, but they should not be presented as proof that the intended organisational or user outcome has been achieved.
Define leading and lagging indicators, data owners, calculation rules, reporting frequency, and thresholds that trigger action. In MIT Open Dataset Catalogue, this means linking the recommendation to representative data, process volumes, error rates, human effort, current outcomes, and documented data rights, then recording how it affects use-case selection, data readiness, model choice, deployment, or responsible operation. The concept is useful only when it produces an observable decision, control, artefact, or measure.
Set acceptance criteria, independent review points, test evidence, exception handling, and release authority before execution begins. In MIT Open Dataset Catalogue, this means linking the implementation choice to representative data, process volumes, error rates, human effort, current outcomes, and documented data rights, then recording how it affects use-case selection, data readiness, model choice, deployment, or responsible operation. The concept is useful only when it produces an observable decision, control, artefact, or measure.
Plan communication, training, adoption support, role changes, feedback loops, and resistance handling as delivery work. In MIT Open Dataset Catalogue, this means linking the recommendation to representative data, process volumes, error rates, human effort, current outcomes, and documented data rights, then recording how it affects use-case selection, data readiness, model choice, deployment, or responsible operation. The concept is useful only when it produces an observable decision, control, artefact, or measure.
Maintain a durable decision record containing assumptions, sources, approvals, changes, limitations, and the current operating procedure. In MIT Open Dataset Catalogue, this means linking the implementation choice to representative data, process volumes, error rates, human effort, current outcomes, and documented data rights, then recording how it affects use-case selection, data readiness, model choice, deployment, or responsible operation. The concept is useful only when it produces an observable decision, control, artefact, or measure.
Test a defensible base case and named downside cases without hiding weak assumptions inside a single blended forecast. In MIT Open Dataset Catalogue, this means linking the recommendation to representative data, process volumes, error rates, human effort, current outcomes, and documented data rights, then recording how it affects use-case selection, data readiness, model choice, deployment, or responsible operation. The concept is useful only when it produces an observable decision, control, artefact, or measure.
Design least privilege, recovery, monitoring, incident ownership, and continuity measures in proportion to the consequence of failure. In MIT Open Dataset Catalogue, this means linking the implementation choice to representative data, process volumes, error rates, human effort, current outcomes, and documented data rights, then recording how it affects use-case selection, data readiness, model choice, deployment, or responsible operation. The concept is useful only when it produces an observable decision, control, artefact, or measure.
During discovery, use MIT Open Dataset Catalogue to reuse data with clear provenance, structure, quality, and limitations. Start with representative data, process volumes, error rates, human effort, current outcomes, and documented data rights. Name the accountable owner, the evidence reviewer, the decision deadline, and the output that proves this stage is complete. Record exclusions and unresolved questions rather than allowing them to disappear into narrative. The stage closes only when its evidence can be reproduced by someone who did not prepare it.
Required output: a data dictionary, provenance record, quality report, and licence notes.
During design, use MIT Open Dataset Catalogue to reuse data with clear provenance, structure, quality, and limitations. Start with representative data, process volumes, error rates, human effort, current outcomes, and documented data rights. Name the accountable owner, the evidence reviewer, the decision deadline, and the output that proves this stage is complete. Record exclusions and unresolved questions rather than allowing them to disappear into narrative. The stage closes only when its evidence can be reproduced by someone who did not prepare it.
Required output: a data dictionary, provenance record, quality report, and licence notes.
During pilot, use MIT Open Dataset Catalogue to reuse data with clear provenance, structure, quality, and limitations. Start with representative data, process volumes, error rates, human effort, current outcomes, and documented data rights. Name the accountable owner, the evidence reviewer, the decision deadline, and the output that proves this stage is complete. Record exclusions and unresolved questions rather than allowing them to disappear into narrative. The stage closes only when its evidence can be reproduced by someone who did not prepare it.
Required output: a data dictionary, provenance record, quality report, and licence notes.
During scale, use MIT Open Dataset Catalogue to reuse data with clear provenance, structure, quality, and limitations. Start with representative data, process volumes, error rates, human effort, current outcomes, and documented data rights. Name the accountable owner, the evidence reviewer, the decision deadline, and the output that proves this stage is complete. Record exclusions and unresolved questions rather than allowing them to disappear into narrative. The stage closes only when its evidence can be reproduced by someone who did not prepare it.
Required output: a data dictionary, provenance record, quality report, and licence notes.
During operations, use MIT Open Dataset Catalogue to reuse data with clear provenance, structure, quality, and limitations. Start with representative data, process volumes, error rates, human effort, current outcomes, and documented data rights. Name the accountable owner, the evidence reviewer, the decision deadline, and the output that proves this stage is complete. Record exclusions and unresolved questions rather than allowing them to disappear into narrative. The stage closes only when its evidence can be reproduced by someone who did not prepare it.
Required output: a data dictionary, provenance record, quality report, and licence notes.
Consider a cross-functional team deciding whether an AI-supported workflow creates measurable value without transferring unacceptable risk to users. The team first writes the decision in one sentence, identifies the accountable executive, and records the current baseline. It separates confirmed facts from estimates and creates named base, downside, and stop scenarios rather than blending uncertainty into one headline number.
The team then uses the documented dataset to compare options. Each option is assessed against outcome, feasibility, cost, time, control, reversibility, and operating ownership. Material assumptions are assigned to reviewers. A recommendation is accepted only when the evidence pack and the decision record tell the same story.
During the pilot, the team measures task quality, groundedness, error severity, latency, adoption, cost per outcome, and human override rates. It records exceptions and user or operator feedback, then decides whether to stop, revise, repeat, or scale. The example is intentionally hypothetical: organisations should replace every assumption with their own evidence and obtain review from domain, data, engineering, security, privacy, legal, risk, and operational specialists as applicable.
Assign data ownership, permitted uses, quality rules, retention, lineage, access controls, and deletion responsibilities. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Map the skills, capacity, external support, budget, and leadership attention required to sustain the intended outcome. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Identify which controls, processes, interfaces, and cost drivers change materially as users, transactions, geographies, or data volumes grow. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Set a dated review cycle and define the regulatory, market, technology, performance, or organisational changes that require earlier reassessment. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Define the decision this work must support, the choices that are genuinely open, and the conditions that would require escalation. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Identify the accountable owner, affected operators, subject-matter reviewers, control functions, and people who will use the output. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Record the present process, cost, timing, quality, risk, and service level before proposing a future state. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Specify which facts require primary evidence, how evidence will be dated, and where assumptions must be labelled instead of presented as facts. Apply the practice with a named owner, evidence location, completion date, and exception process. Keep the control proportionate to the consequence of error and confirm that it still works after the initial implementation team has moved on.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the current-state baseline decision visible, identify its owner, and record the evidence. Mistake 1 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the evidence design decision visible, identify its owner, and record the evidence. Mistake 2 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the operating model decision visible, identify its owner, and record the evidence. Mistake 3 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the architecture and integration decision visible, identify its owner, and record the evidence. Mistake 4 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the risk and compliance decision visible, identify its owner, and record the evidence. Mistake 5 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the economics and value decision visible, identify its owner, and record the evidence. Mistake 6 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the delivery sequencing decision visible, identify its owner, and record the evidence. Mistake 7 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
Do not assume that experienced participants share the same definition, evidence threshold, or risk tolerance. In MIT Open Dataset Catalogue, make the vendor and partner assessment decision visible, identify its owner, and record the evidence. Mistake 8 is resolved only when the correction appears in the operating artefact, not merely in meeting notes.
MIT Open Dataset Catalogue is complete when the organisation can trace a bounded question through evidence, assumptions, options, decision rights, implementation controls, measured outcomes, and a dated review. The downloadable workbook preserves that chain and should be maintained with the operating record.
Start with representative data, process volumes, error rates, human effort, current outcomes, and documented data rights; assess model error, bias, privacy, security, drift, unsupported automation, and unclear accountability; measure task quality, groundedness, error severity, latency, adoption, cost per outcome, and human override rates; and obtain review from domain, data, engineering, security, privacy, legal, risk, and operational specialists as applicable. Use related Rusaka resources to deepen specialist areas without breaking the shared decision record.
MIT Open Dataset Catalogue is designed for Engineering leaders, Developers, Product managers, Technology buyers. The accountable decision owner should involve domain, data, engineering, security, privacy, legal, risk, and operational specialists as applicable when the decision touches their area.
Begin with representative data, process volumes, error rates, human effort, current outcomes, and documented data rights. Record missing evidence as an explicit gap, with an owner and a plan to resolve or test it.
Label every material assumption, record its source and rationale, identify the decision it affects, test a downside, and define the trigger that requires reassessment.
Use task quality, groundedness, error severity, latency, adoption, cost per outcome, and human override rates. Define calculation rules, sources, owners, frequency, segmentation, and action thresholds before implementation.
The scheduled frequency is every 6 months. Review sooner after a material regulatory, market, technology, security, performance, or organisational change.
No. It is an educational and implementation resource. Decisions should be reviewed by domain, data, engineering, security, privacy, legal, risk, and operational specialists as applicable, and formal organisational approvals remain required.
Submit an email to download the MIT Open Dataset Catalogue implementation workbook