PSDI Data Conversion Service
The PSDI Data Conversion Service is a one-stop shop for scientific file format conversion. The service enables users to seamlessly convert between different file formats and view information about the quality of the proposed conversion.
Background
A key challenge in the physical sciences is a lack of FAIR (Findable, Accessible, Interoperable, Re-usable) data. PSDI recognises that there is a strong need within the physical sciences community for a simple and effective way to convert between data types and file formats for researcher collaboration and to facilitate data exchange between different services. Research workflows often require the use of different data formats between different processes and software in research pipelines making interoperability a significant challenge. Many instruments and software vendors provide data in bespoke formats making it complex and time-consuming to convert between different formats. Conversion is often required again to get data into a standard format to facilitate collaboration, publication, and preservation. The accessibility and usability of tools that already exist for data conversion is variable, and it is often not easily apparent what the quality of the conversion will be without significant manual testing.
The PSDI Data Conversion Service aims to address these interoperability issues by providing an easy mechanism for researchers to convert between different scientific data formats, thus removing barriers to interoperability and facilitating easier data sharing and collaboration. The service addresses several key challenges with managing data in the physical sciences:
- difficulty in reusing data due to incompatible formats or unsupported software
- the effort needed to determine which data conversions are possible
- challenges involved in installing and operating conversion software
- the time required to understand which conversion tools provide the best results for a selected conversion
Benefits of the PSDI Data Conversion Service
There are a number of advantages of the PSDI Data Conversion Service over other data conversion services that already exist.
Comprehensive information aggregation
PSDI has compiled information about scientific file formats from multiple sources, providing not only more potential conversions than other services but also detailed information about the range of conversion options available across different platforms.
Quality measures
The service provides conversion information including quality metrics, enabling users to gauge the likely success of their conversions and identify which services are most effective.
Simplified conversion process
The PSDI Data Conversion Service makes data conversion simpler for users, giving them a way to easily transform their data without the complexities involved in finding, installing, and running existing data conversion tools.
Exploratory information
Users can easily explore the possible conversions, helping them to understand the full range of options available.
Access online or run locally
The PSDI Data Conversion Service provides alternative modes of operation, so that users can choose to upload their data directly to the online service on PSDI, or to run the service on their own computer infrastructure to keep the data in-house, or to incorporate data conversion into their own research pipelines.
Taking user feedback
PSDI enables users to easily submit requests for additional data conversions or file formats, or to report any unexpected problems with the conversions. PSDI will use the feedback provided to help prioritise future developments.
Options for using the PSDI Data Conversion Service
This functionality is available through four different mechanisms. Each offers unique benefits tailored to different needs, ensuring flexibility, privacy, and comprehensive data conversion capabilities.
| Option | Why use it | Who should use it | How to use |
|---|---|---|---|
| PSDI Data Conversion Service | This service is ideal for exploring different file formats and performing singular conversions. It provides quality measures where possible for available converters and directs users to external services if a conversion cannot be performed. | Researchers and scientists who need a user-friendly, web-based solution for exploring the conversion options of different scientific file formats and performing occasional file format conversions without the need for technical expertise. | Access the online service, at PSDI Data Conversion Service. No coding knowledge is required. Simply upload your data and select the desired conversion format. |
| PSDI Data Conversion Command Line Application | This service provides all the conversion functionalities of the web application without file cap limits, as it runs locally. It is ideal for users who prefer command line tools. | Technically proficient users who are comfortable with command line interfaces and need to handle large datasets without file size restrictions. | Install the command line interface using the instructions in the PSDI Data Conversion PyPI page. Run the command-line tool on your local computer infrastructure. Text-based commands can be used to perform file format conversions. |
| PSDI Data Conversion Python Library | This library offers the same conversion functionalities as the web application and command line version, without file cap limits. It is perfect for automating conversions within custom data workflows. | Researchers, Data scientists and developers who want to incorporate file format conversion into their Python-based data processing pipelines. | Download the Python library using the instructions in the PSDI Data Conversion PyPI page. Use the Python library to integrate the data conversion capabilities into your data pipelines. Run the library on your local infrastructure. |
How can I provide feedback?
You can report any missing formats or conversions that you need for your research using the Report Missing Format/Conversion form. If you have general feedback, such as any problems you encounter using the service or any suggestions for new functionality, complete our Feedback form.
Related links:
- Creator: Cerys Willoughby, Samantha Pearman-Kanza, Raymond Whorley
- Last modified date: 2025-04-14
If you would like to contribute content to the PSDI Knowledge Base or have feedback you would like to give on this guidance, please contact us.