Overview
FAIR MAST is a public facing repository of experimental diagnostic data from the M05-M09 campaigns of the MAST experiment. The data is presented in two parts 1) a JSON API service for querying shot metadata and 2) a public S3 bucket containing Zarr formatted diagnostic data.
Who FAIR MAST is for
Public access to an archive of diagnostic data is useful for:
- international collaborators in the fusion energy domain – the repository provides a restriction free way to access curated data
- data scientists / non-fusion collaborators – provides a way to access diagnostic data in a format that is more accessible for collaborators and industry partners who are not fusion energy specialists
Key benefits
Benefits of using FAIR MAST include:
- public access to a large collection of diagnostic data
- access curated and consolidated data which has FAIR-er metadata and structure
FAIR MAST details
Technical specifications
FAIR MAST consists of two components:
- Postgres database with a JSON API provided by fastapi for accessing metadata describing shots in the datastore
- s3 bucket with zarr data stores containing diagnostic data from the history of MAST
Programming language
Python
Compatible platforms / systems
Web service
Dependencies
Fastapi, zarr, xarray, pandas.
System requirements
Internet access
Key features
- interactive access to data with xarray over the network
- download large amounts of data using tools such a s5cmd
- search and query relevant data stores using JSON API
Use cases
FAIR MAST is used:
- in various summer schools with European and the US collaborators
- by the IAEA as a test case for developing their Fusion data lake service
- as part of a UKAEA / IBM collaboration on developing foundation models for fusion diagnostic data.
- by ITER / ignition computing for exploration of developing ‘fusion conventions’, similar to ‘cf conventions’
Licence information
The FAIR MAST software is available under an MIT open source licence.
For the MAST Data Catalog, except where otherwise noted, the data hosted in the archive, the contents of the metadata database, and the content of the site is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Support and resources
Documentation
The MAST Data Catalog site provides documentation for accessing historical data and meta data from MAST. It includes descriptions and examples of how to use the different APIs and endpoints that we provide for accessing data from MAST.
Community
FAIR MAST has a GitHub issues space at: https://github.com/ukaea/fair-mast/issues.
Technical support
For help and advice, please contact us.
Publications
- An Open Data Service for Supporting Research in Machine Learning on Tokamak Data – DOI: 10.1109/TPS.2025.3583419
- FAIR-MAST: A fusion device data management system – DOI: 10.1016/j.softx.2024.101869
Development status
Active
Contributors
Nathan Cummings, Samuel Jackson, Larisa Dorman-Gajic, Khalid Lawal
Collaboration opportunities
We welcome collaborations to:
utilise FAIR MAST in your fusion research
contribute improvements to schema / data quality
integrate with downstream open source tooling