Flagship Dataset of Type 2 Diabetes from the AI-READI Project
The AI-READI project seeks to create and share a flagship ethically-sourced dataset of type 2 diabetes
Overview of the study
The Artificial Intelligence Ready and Equitable Atlas for Diabetes Insights (AI-READI) project seeks to create a flagship ethically-sourced dataset to enable future generations of artificial intelligence/machine learning (AI/ML) research to provide critical insights into type 2 diabetes mellitus (T2DM), including salutogenic pathways to return to health. The ability to understand and affect the course of complex, multi-organ diseases such as T2DM has been limited by a lack of well-designed, high quality, large, and inclusive multimodal datasets. The AI-READI team of investigators will aim to collect a cross-sectional dataset of 4,000 people and longitudinal data from 10% of the study cohort across the US. The study cohort will be balanced for self-reported race/ethnicity, gender, and diabetes disease stage. Data collection will be specifically designed to permit downstream pseudo-time manifold analysis, an approach used to predict disease trajectories by collecting and learning from complex, multimodal data from participants with differing disease severity (normal to insulin-dependent T2DM). The long-term objective for this project is to develop a foundational dataset in T2DM, agnostic to existing classification criteria or biases, which can be used to reconstruct a temporal atlas of T2DM development and reversal towards health (i.e., salutogenesis). Data will be optimized for downstream AI/ML research and made publicly available. This project will also create a roadmap for ethical and equitable research that focuses on the diversity of the research participants and the workforce involved at all stages of the research process (study design and data collection, curation, analysis, and sharing and collaboration).
Description of the dataset
This dataset contains data from 204 participants from the pilot period of the AI-READI project (July 19, 2023 to November 30, 2023). Data from multiple modalities are included. A full list is provided in the Data Standards section below. The data in this dataset contain no protected health information (PHI). Information related to the sex and race/ethnicity of the participants as well as medication used has also been removed.
The dataset contains 21,669 files and is around 310 GB in size.
A detailed description of the dataset is available in the AI-READI documentation for v1.0.0 of the dataset at docs.aireadi.org.
Protocol
The protocol followed for collecting the data can be found in the AI-READI documentation for v1.0.0 of the dataset at docs.aireadi.org.
Dataset access/restrictions
Accessing the dataset requires several steps, including:
- Login in through a verified ID system
- Agreeing to use the data only for type 2 diabetes related research.
- Agreeing to the license terms which set certain restrictions and obligations for data usage (see
Licensesection below).
Data standards followed
This dataset is organized following the Clinical Dataset Structure (CDS) v0.1.0. We refer to the CDS documentation for more details. Briefly, data is organized at the root level into one directory per datatype (c.f. Table below). Within each datatype folder, there is one folder per modality. Within each modality folder, there is one folder per device used to collect that modality. Within each device folder, there is one folder per participant. Each datatype, modality, and device folder is named using a name that best defines it. Each participant folder is named after the participant's ID number used in the study. For each datatype, the data files follow the standards listed in the Table below. More details are available in the dataset_structure_description.json metadata file included in this dataset.
| Datatype directory name | Description | File format standard followed |
|---|---|---|
| cardiac_ecg | This directory contains electrocardiogram data collected by a 12 lead protocol (the current standard), Holter monitor, or smartwatch. The terms ECG and EKG are often used interchangeably. | WaveForm DataBase (WFDB) |
| clinical_data | This directory contains clinical data collected through REDCap. Each CSV file in this directory is a one-to-one mapping to the OMOP CDM tables. | Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) |
| environment | This directory contains data collected through an environmental sensor device custom built for the AI-READI project. | Earth Science Data Systems (ESDS) format |
| retinal_flio | This directory contains data collected through fluorescence lifetime imaging ophthalmoscopy (FLIO), an imaging modality for in vivo measurement of lifetimes of endogenous retinal fluorophores. | Digital Imaging and Communications in Medicine (DICOM) |
| retinal_oct | This directory contains data collected using optical coherence tomography (OCT), an imaging method using lasers that is used for mapping subsurface structure. | Digital Imaging and Communications in Medicine (DICOM) |
| retinal_octa | This directory contains data collected using optical coherence tomography angiography (OCTA), a non-invasive imaging technique that generates volumetric angiography images. | Digital Imaging and Communications in Medicine (DICOM) |
| retinal_photography | This directory contains retinal photography data, which are 2D images. They are also referred to as fundus photography. | Digital Imaging and Communications in Medicine (DICOM) |
| wearable_activity_monitor | This directory contains data collected through a wearable fitness tracker. | Open mHealth |
| wearable_blood_glucose | This directory contains data collected through a continuous glucose monitoring (CGM) device. | Open mHealth |
Resources
All of our data files are in formats that are accessible with free software commonly used for such data types so no specific software is required. Some useful resources related to this dataset are listed below:
- Documentation of the dataset: docs.aireadi.org (see 'Dataset v1.0.0' for this version of the dataset)
- AI-READI project website: aireadi.org
- Zenodo community of the AI-READI project: zenodo.org/communities/aireadi
- GitHub organization of the AI-READI project: github.com/AI-READI
License
This work is licensed under a custom license specifically tailored to enable the reuse of the AI-READI dataset (and other clinical datasets) for commercial or research purposes while putting strong requirements around data usage, security, and secondary sharing to protect study participants, especially when data is reused for artificial intelligence (AI) and machine learning (ML) related applications. More details are available in the License file included in the dataset and also available at https://doi.org/10.5281/zenodo.10642459.
How to cite
If you use this dataset for any purpose, please cite the resources specified in the AI-READI documentation for version 1.0.0 of the dataset at https://docs.aireadi.org.
Contact
For any questions, suggestions, or feedback related to this dataset, please email contact@aireadi.org. We refer to the study_description.json and dataset_description.json metadata files included in this dataset for additional information about the contact person/entity, authors, and contributors of the dataset.
Acknowledgement
The AI-READI project is supported by NIH grant 1OT2OD032644 through the NIH Bridge2AI Common Fund program.
310.0 GB
21,669 Files
License
Health Data LicenseKeywords
Citation
When using this resource, please cite: