diffpy.morph: Python tools for model independent comparisons between sets of 1D functions

`diffpy.morph` is an open-source Python package designed to reveal meaningful scientific insights from 1D spectra by applying "morphs" to datasets to remove uninteresting differences, such as experimental inconsistencies or thermal expansion, during model-independent comparisons.

The Gist

Imagine you are trying to compare two photographs of a growing forest to see if a new species of tree has appeared.

The problem is that the two photos were taken at different times: one was taken in the bright morning sun, and the other was taken in the hazy afternoon. One photo might be slightly zoomed in, and the other might be a bit blurry because the photographer’s hand shook. If you simply subtract one photo from the other to see what changed, you won't see "new trees"—you’ll just see a messy, confusing image of light differences and blurriness.

diffpy.morph is like a high-tech "smart filter" for scientists. It allows them to take one set of data and "morph" it—stretching it, brightening it, or sharpening it—until it perfectly matches the "vibe" of the second set. Once the boring differences (like lighting and blur) are canceled out, the truly important changes (like the new species of tree) pop out clearly.

Here is a breakdown of how it works using everyday analogies:

1. The "Morphs": The Scientist's Magic Wands

The software uses several "wands" to fix data without needing to know exactly what the material is made of:

• The Stretch Morph (The Accordion): Imagine you have a rubber band with markings on it. If you stretch the band, the markings move further apart. In science, when materials get hot, they expand. This morph "stretches" the data to account for that expansion so you can compare a cold sample to a hot one fairly.
• The Scale Morph (The Dimmer Switch): Sometimes one measurement is just "louder" or brighter than another. This morph acts like a dimmer switch, turning the intensity up or down so the two datasets are at the same volume.
• The Smear Morph (The Soft Focus Lens): Heat makes atoms wiggle, which makes scientific data look "blurry." This morph applies a controlled blur to the data to mimic that thermal wiggling, allowing a sharp, cold measurement to match a fuzzy, hot one.
• The Shape Morph (The Cookie Cutter): If you are studying tiny nanoparticles, they don't behave like big chunks of metal; they have "edges" because they are so small. This morph acts like a cookie cutter, shaping the data to account for the specific geometry (like a sphere) of a tiny particle.

2. Why is this a big deal? (The "Model-Independent" Superpower)

Usually, to understand a material, scientists have to build a complex mathematical "model"—a digital puppet that they try to make move exactly like the real material. This is incredibly slow and difficult.

diffpy.morph is "model-independent." This means the software doesn't care if you are studying gold, plastic, or a new battery material. It doesn't try to build a puppet; it just manipulates the data itself. It’s like being able to fix a blurry photo using a filter rather than having to rebuild the entire camera from scratch.

3. Real-World Wins

The paper shows that this tool can solve several "detective" problems:

• Finding Phase Transitions: It can detect exactly when a material "flips" from one state to another (like water turning to ice) just by watching when the "morphing" becomes difficult.
• Thermometry (The Digital Thermometer): If you know how much a material usually expands, you can use the "Stretch Morph" to work backward and figure out exactly how hot a sample is during a high-powered laser experiment.
• Fixing Mistakes: If a scientist accidentally moves a detector by a fraction of a millimeter, they don't have to redo the whole experiment. They can use a "Shift Morph" to digitally nudge the data back into place.

Summary

In short, diffpy.morph is a digital toolkit that cleans up the "noise" of the physical world—heat, expansion, blur, and misalignment—so that scientists can see the true, underlying secrets of the materials they are studying.

Technical Summary

Technical Summary: diffpy.morph: Python tools for model-independent comparisons between sets of 1D functions

1. The Problem: Distinguishing Signal from Artifact

In materials science, researchers frequently compare 1D scientific spectra—such as X-ray/neutron diffraction patterns $I(Q)$ or atomic pair distribution functions (PDFs) $G(r)$—to identify structural changes (e.g., phase transitions). A common method is to analyze the "difference curve" between two datasets.

However, difference curves are often dominated by "uninteresting" variations that mask the actual scientific signal of interest. These include:

• Thermal effects: Lattice expansion/contraction (peak shifting) and increased thermal motion (peak broadening/smearing).
• Experimental inconsistencies: Misalignments in detector distance, beam center offsets, or variations in incident flux.
• Data reduction artifacts: Sub-optimal background subtraction or improper polynomial corrections during Fourier transforms.

Traditional solutions involve complex structural modeling (refinement), which is computationally expensive, requires a prior structural hypothesis, and is often too slow for real-time analysis during high-throughput experiments.

2. Methodology: The "Morphing" Approach

The authors introduce diffpy.morph, an open-source Python package that employs a model-independent approach. Instead of fitting a physical model to the data, the software applies a series of mathematical transformations, called "morphs," to one dataset to make it match a "target" dataset. By minimizing the residual (using the profile-weighted agreement factor, $R_w$) through least-squares regression, the software extracts the parameters of these transformations.

Key Morphing Transformations:

• Scaling: Adjusts intensity to account for flux or scaling differences.
• Stretching/Squeezing: Linearly or non-linearly transforms the $x$-axis (e.g., $r$ or $Q$) to simulate lattice expansion/contraction or geometric detector misalignments.
• Smearing: Applies Gaussian broadening to simulate thermal motion (specifically via the Radial Distribution Function for PDFs).
• Shifting: Adjusts horizontal or vertical offsets.
• Shape Morphs: Uses characteristic functions to transform bulk PDFs into nanoparticle PDFs (modeling size/shape effects).
• General Morphs (funcxy, funcx, funcy): Allows users to define arbitrary Python functions to transform either the $x$-array, the $y$-array, or both simultaneously.

3. Key Contributions and Results

The paper demonstrates the versatility of diffpy.morph through several real-world applications:

• Phase Transition Identification: In $IrTe_2$ samples, the software successfully distinguished between samples undergoing a structural phase transition and those where substitution suppressed the transition. It identified the transition temperature range (approx. 263–283 K) purely through model-independent $R_w$ and Pearson correlation coefficient (PCC) analysis.
• Extraction of Material Properties:
  • Thermal Expansion: By analyzing the "stretch" parameter $\eta$ across temperatures, the authors extracted the linear thermal expansion coefficient ($\beta$) without structural modeling.
  • Debye Temperature: By examining the temperature dependence of $\beta$, they estimated the Debye temperature ($\Theta_D$), successfully identifying significant anharmonicity in pure $IrTe_2$.
• In Situ Thermometry: Using a known $\beta$, the software can estimate the absolute temperature of a sample during laser-heating experiments (e.g., YSZ) by measuring the induced strain.
• Nanoparticle Characterization: The "shape morph" allowed for the rapid estimation of the radius of $PbS$ nanocrystals, achieving results within 1.3% of intensive structural refinements but in a fraction of the time.
• High-Throughput Data Correction: The software can correct for experimental errors (like sample-to-detector distance) and optimize data reduction parameters (like $r_{poly}$ in PDFgetX3) automatically, making it suitable for synchrotron and XFEL environments.

4. Significance

The significance of diffpy.morph lies in its speed, generality, and model-independence.

1. Speed: It provides results in seconds, enabling "on-the-fly" data interrogation during experiments.
2. Generality: While optimized for diffraction and PDF data, the mathematical framework is applicable to any 1D function (e.g., Raman, NMR, or even 1D image profiles).
3. Scientific Insight: It allows researchers to "strip away" known physical effects (like thermal expansion) to reveal hidden, non-trivial structural changes that would otherwise be lost in the noise of a standard difference curve.

The package is open-source (BSD license) and available via conda-forge and PyPI, making it a highly accessible tool for the broader scientific community.