MetaXtract: Extracting Metadata from Raw Files for FAIR Data Practices and Workflow Optimisation

MetaXtract is an open-source tool that extracts structured acquisition metadata directly from Thermo Fisher raw mass spectrometry files to enhance FAIR data practices, enable real-time quality control, and support reproducible, large-scale data analysis workflows.

The Gist

Imagine you have a high-tech camera that takes incredibly detailed photos of the microscopic world. Every time you snap a picture, the camera doesn't just save the image; it also writes a massive, secret diary entry about exactly how it took the photo: the lighting, the lens settings, the battery level, the temperature, and the exact moment the shutter clicked.

In the world of science, this "camera" is a Mass Spectrometer (a machine that identifies proteins), and the "photos" are data files called RAW files.

The problem? These secret diaries are written in a language only the camera manufacturer (Thermo Fisher) understands. If you want to share your photos with the world or check if your camera is working correctly, you have to use their specific, expensive software to read the diary. If you don't have that software, or if you have thousands of photos, reading the diaries one by one is a nightmare.

Enter MetaXtract.

Think of MetaXtract as a universal translator and a super-efficient librarian rolled into one. It's a free, open-source tool that instantly reads those secret manufacturer diaries and translates them into simple, easy-to-read spreadsheets (like Excel or CSV files).

Here is how it works, broken down into everyday concepts:

1. The "Receipt" Analogy

When you buy groceries, you get a receipt. It tells you what you bought, the price, the time, and the store. In mass spectrometry, the "receipt" is the metadata.

• Before MetaXtract: The receipt was hidden inside a locked, encrypted box (the RAW file). You couldn't see it unless you had the specific key (proprietary software).
• With MetaXtract: It opens the box, copies the receipt, and hands you a clean, typed-up list. Now, anyone can see exactly what happened during the experiment without needing the expensive key.

2. The "Car Dashboard" (Quality Control)

Imagine you are driving a car. Usually, you only know if the engine is broken when the car stops moving (the experiment fails).

• The Old Way: Scientists had to wait until the end of a long, expensive experiment to analyze the results. If the machine was acting up, they wouldn't know until days later, wasting time and money.
• The MetaXtract Way: This tool acts like a real-time dashboard. It looks at the "engine signals" (like how much fuel was injected or how fast the car was going) while the experiment is happening.
  • Example from the paper: The researchers used MetaXtract to spot a broken machine part immediately. The "engine" (the machine) was running, but the "fuel injection" (ion transmission) was weak. Because MetaXtract showed this immediately, they could stop the experiment before wasting hours on a broken run.

3. The "FAIR" Library

Scientists want their data to be FAIR: Findable, Accessible, Interoperable (works with other tools), and Reusable.

• Currently, most data is stuck in the "locked box" format. It's hard to find, hard to read, and hard to mix with other data.
• MetaXtract takes that locked data and turns it into open books. Now, a computer program can easily search through thousands of experiments to find specific patterns, or a scientist in a different country can use the data without needing the original manufacturer's software.

4. The "Two Modes"

MetaXtract is designed for everyone, not just computer wizards:

• The GUI (Graphical User Interface): Think of this as a touchscreen app. You click buttons, drag and drop files, and see pretty charts and graphs. It's great for a scientist sitting at their desk, looking at one experiment and saying, "Hmm, why did this spike happen?"
• The CLI (Command Line Interface): Think of this as a robot assistant. You give it a list of 1,000 files, and it processes them all automatically in the background while you sleep. This is perfect for big labs running massive projects.

Why Does This Matter?

In the past, if a scientist wanted to check if their machine was working, they had to wait for a complex computer search to finish analyzing the proteins. It was like waiting for a mechanic to rebuild your engine just to check the oil pressure.

MetaXtract lets them check the oil pressure before they even start the engine. It makes science faster, cheaper, and more reliable. It turns a locked, confusing mess of data into a clear, open story that anyone can read, share, and learn from.

In short: MetaXtract is the tool that unlocks the "black box" of scientific data, turning secret manufacturer notes into open, useful information for everyone.

Technical Summary

1. Problem Statement

Mass spectrometry (MS) experiments generate vast amounts of binary raw files containing critical acquisition metadata (e.g., precursor charge states, retention times, ion injection times, fragmentation energies). However, several significant barriers exist:

• Proprietary Formats: This metadata is stored in vendor-specific formats (primarily Thermo Fisher .RAW files), making it inaccessible without proprietary software.
• Lack of Standardization: Existing tools for metadata extraction are often outdated, unsupported, or limited in scope (e.g., requiring database search results, lacking method settings, or unable to handle batch processing).
• FAIR Data Deficit: The inability to easily extract structured metadata hinders the FAIR principles (Findable, Accessible, Interoperable, Reusable), particularly for public repositories like PRIDE.
• Delayed Quality Control (QC): Current QC often relies on post-acquisition database search results, preventing real-time detection of instrument malfunctions or sample issues.

2. Methodology

The authors developed MetaXtract, a lightweight, open-source Python-based tool designed to bridge the gap between raw vendor files and structured, analysis-ready data.

• Core Technology:
  • Utilizes the Thermo Fisher RawFileReader library (C#) to directly parse .RAW files without needing the full vendor software suite.
  • Built with PySide6 for a Graphical User Interface (GUI) and supports Command-Line Interface (CLI) for automation.
• Data Extraction & Processing:
  • Extracts sample information, LC-MS method settings, and scan-level metrics (MS1 and MS2).
  • Captures specific parameters: retention time, total ion current (TIC), ion injection time, precursor intensity, charge states, and resolution.
  • Output Formats: Generates structured tabular data in CSV/TSV for general metadata and Parquet format for MS1/MS2 peak lists. Parquet is chosen for memory efficiency and compatibility with data science ecosystems (Python, R, SQL).
• Visualization:
  • Provides interactive plots (via Plotly) for MS1 and MS2 scan details, allowing users to visualize precursor intensity, injection times, and charge state distributions.
• Workflow Integration:
  • Designed to integrate seamlessly into workflow management systems like Snakemake and Nextflow.
  • Includes a pre-built Snakemake workflow to automatically download and annotate files from PRIDE.

3. Key Contributions

• Search-Free, Near Real-Time QC: Unlike tools requiring peptide identification, MetaXtract enables performance monitoring immediately after data acquisition by analyzing acquisition-side signals (e.g., MS2 TIC vs. MS1 TIC).
• Comprehensive Metadata Extraction: It is one of the few tools that extracts LC-MS method settings and sample information directly from the raw file, not just scan headers.
• Machine Learning Readiness: By exporting indexed MS1/MS2 peak lists linked to acquisition parameters in Parquet format, the tool facilitates downstream machine learning applications (e.g., spectral quality assessment, retention time prediction, anomaly detection).
• FAIR Compliance: Transforms proprietary binary data into open, non-proprietary formats, significantly improving data interoperability and reusability.
• Accessibility: Available as free open-source software (Apache-2.0 license) with both a user-friendly GUI for manual inspection and a CLI for high-throughput batch processing.

4. Results

• Validation: The tool was manually validated against Thermo Fisher's Freestyle software (v1.7), confirming that extracted metadata matches the source data accurately.
• Performance Benchmarking:
  • Tested on a Windows 11 laptop (32 GB RAM, Intel i9, RTX 4070).
  • Achieved an average processing time of ~40 seconds per file for full metadata extraction.
  • Successfully processed the last 20 files submitted to PRIDE in January 2025 from three different laboratories, demonstrating robustness across diverse datasets.
• Case Study: Instrument Failure Detection:
  • The authors analyzed four datasets of HeLa protein digest. Two reference runs yielded ~5,000 peptide identifications, while two "underperforming" runs yielded only 5–31.
  • MetaXtract Analysis: While MS1 signals (chromatography) remained stable, the tool detected a 9.2-fold reduction in MS2 signal intensity and a drop in MS2 TIC in the underperforming runs.
  • Conclusion: This allowed the researchers to pinpoint the issue as a precursor isolation or fragment ion transmission failure before running database searches, saving significant computational time and highlighting the value of acquisition-side QC.

5. Significance

MetaXtract addresses a critical bottleneck in modern proteomics by democratizing access to raw file metadata. Its significance lies in:

1. Enhancing Reproducibility: By ensuring that essential acquisition details accompany published data in structured formats.
2. Optimizing Workflows: Enabling automated, high-throughput QC that can flag failing runs early, preventing wasted resources on low-quality data.
3. Enabling Advanced Analytics: Providing the structured, machine-readable data necessary for training AI/ML models on spectral profiles and instrument behavior.
4. Community Impact: Specifically addressing the needs of the crosslinking MS community and the broader proteomics field to adhere to FAIR data principles, with a roadmap to expand support to other vendor formats (e.g., Bruker, Sciex) in future versions.