AutoEMXSp

Automated Electron Microscopy X-Ray Spectroscopy for Compositional Characterization of Materials

AutoEMXSp is a fully automated framework for SEM-EDS workflows — from spectral acquisition and quantification to data filtering and compositional analysis — all in one click.

🎥 Watch AutoEMXSp in action on a desktop SEM-EDS system at https://youtu.be/Bym58gNxlj0

📖 This work is described in:
A. Giunto et al., Harnessing Automated SEM-EDS and Machine Learning to Unlock High-Throughput Compositional Characterization of Powder Materials, 2025.
DOI: https://doi.org/10.21203/rs.3.rs-7837297/v1

✨ Key Features

• Automated acquisition & quantification of X-ray spectra using the peak-to-background method. Single spectrum quantification also available
• Automated rule-based filtering of compositions to discard poorly quantified spectra from the analysis
• Automated machine learning–based compositional analysis to identify the compositions of individual phases in the sample
• Automated experimental standard collection scripts included
• Extensible architecture — adaptable to other techniques such as
  • Wavelength Dispersive Spectroscopy (WDS)
  • Scanning Transmission Electron Microscopy (STEM) with EDS
• Extensible hardware support — includes driver for ThermoFisher Phenom Desktop SEM series, and can be extended to any electron microscope with a Python API

📊 Performance

• Benchmarked on 74 single-phase samples with compositions spanning 38 elements (from nitrogen to bismuth), it achieved <5–10% relative deviation from expected values
• Machine learning compositional analysis detects individual phase composition in multi-phase samples, including minor phases
• Intermixed phases can also be resolved

🧪 Supported Use Cases

• Powders and rough samples, e.g. rough films, or pellets.
• Scanning Electron Microscopy (SEM) with Energy-Dispersive Spectroscopy (EDS)

⚙️ Requirements

• Cross-platform: runs on Linux, macOS, and Windows
• Quick installation
• Requires calibration for use with different electron microscopes

---

📑 Table of Contents

• 📘 Documentation
• 📦 Requirements
• 🆕 Coming Soon
• 📂 Project Structure
• 📁 Scripts
• 🤝 Contributing
• 📄 License
• 📖 Citation
• 📂 Paper Data
• 📬 Contact

---

📘 Documentation

Installation instructions, usage examples, and workflow descriptions are available in the AutoEMXSp documentation:

👉 https://cedergrouphub.github.io/AutoEMXSp/

---

📦 Requirements

• Python 3.11 or newer
• All dependencies are installed automatically via pip or conda.
• Tested versions of dependencies are specified in pyproject.toml.

  The package may work with more recent versions, but these have not been tested.

---

Electron Microscope Support

• ✅ Developed and tested for Thermo Fisher Phenom Desktop SEMs.
• ✅ Compatible with any Phenom microscope equipped with PPI (Phenom Programming Interface).
• ⚠️ For other microscope models, the driver must be adapted to the appropriate API commands.

---

🆕 Coming Soon

Here’s what’s planned for future releases of AutoEMXSp:

• 🐍 Verify with the latest Python version for improved compatibility with current scientific libraries
• 📏 New scripts for spectral parameter calibration to extend the XSp_calibs library to your own instrument.

---

📂 Project Structure

The repository is organized as follows:

AutoEMXSp/
├── autoemxsp/                 # Main package source code
│   ├── core/                   # Core objects and source code
│   ├── runners/                # Runner functions calling on core objects
│   ├── data/                   # Libraries of X-ray data
│   ├── _custom_plotting.py     # Customizable clustering plot function
│   ├── EM_driver/              # Electron Microscope driver (⚠️ adapt to your own instrument)
│   ├── XSp_calibs/             # X-ray spectral calibrations (⚠️ adapt to your own instrument)
│   ├── scripts/                # Scripts to run acquisition, quantification, etc. (see full list below)
│   └── Results/                # Example acquired data (used for unit tests)
│
├── examples/                  # Example scripts for fitting, quantification and compositional analysis of example data
├── tests/                     # Unit tests for fitting, quantification, compositional analysis and image processing
│                               # (Acquisition tests require proper EM drivers)
├── paper_data/                # Raw paper data uploaded on Git LFS (Dowload instructions in Paper Data section below)
│
├── LICENSE.txt
├── README.md
└── pyproject.toml

---

📁 Scripts

This repository includes a collection of scripts that streamline the use of AutoEMXSp.
Each script is tailored for a specific task in spectral acquisition, calibration, quantification, or analysis.

🔬 Acquisition, Quantification & Analysis

• Run_Acquisition_Quant_Analysis.py — Acquire X-ray spectra and optionally perform quantification and composition analysis.
• Run_Quantification_Analysis.py — Quantify acquired spectra (single or multiple samples) and perform machine-learning analysis.
• Run_Analysis.py — Launch customized machine-learning analysis on previously quantified data.
• Fit_Quant_Single_Spectrum.py — Fit and optionally quantify a single spectrum. Prints fitting parameters and plots fitted spectrum for detailed inspection of model performance.

📊 Particle Size Distribution Measurements

• Collect_Particle_Statistics.py - Analyse sample, collecting particle size statistics and distribution.
• Process_Particle_Stats_Files.py - Process acquired aprticle size data and recompute.

🛠️ Miscellaneous

• Run_Experimental_Standard_Collection.py — Acquire and fit experimental standards.
• Run_SDD_Calibration.py — Perform calibration of the SDD detector.

⚗️ Characterize Extent of Intermixing in Known Powder Mixtures

(see Chem. Mater. 2025, 37, 6807−6822 for example)

• Run_Acquisition_PrecursorMix.py — Acquire spectra for powder precursor mixtures.
• Run_Quantification_PrecursorMix.py — Quantify spectra for one or multiple powder mixtures and run machine-learning analysis.
• Customized analysis can be performed using the Run_Analysis.py script

👉 All scripts can be executed directly from the command line or imported into a Python environment, making them accessible from anywhere on your system.

---

🤝 Contributing

Contributions are welcome!

Open to collaborations to extend this package to different tools or to different types of samples, for example thin films. Please contact me at agiunto@lbl.gov

---

📄 License

This project is licensed under a NON-COMMERCIAL USE ONLY, LICENSE — see the LICENSE file for details.

---

📖 Citation

If you use AutoEMXSp in your research, please cite the following publication:

A. Giunto, Y. Fei, P. Nevatia, B. Rendy, N. Szymanski and G. Ceder; Harnessing Automated SEM-EDS and Machine Learning to Unlock High-Throughput Compositional Characterization of Powder Materials, 2025.
DOI: https://doi.org/10.21203/rs.3.rs-7837297/v1

BibTeX

@article{Giunto2025AutoEMXSp,
  author  = {Giunto, Andrea and Fei, Yuxing and Nevatia, Pragnay and Rendy, Bernardus and Szymanski, Nathan and Ceder, Gerbrand},
  title   = {Harnessing Automated SEM-EDS and Machine Learning to Unlock High-Throughput Compositional Characterization of Powder Materials},
  year    = {2025},
  doi     = {10.21203/rs.3.rs-7837297/v1},
  url     = {https://doi.org/10.21203/rs.3.rs-7837297/v1}
}

---

📂 Paper Data

The raw data used in the associated publication is stored in the paper_data/ directory.
These files are tracked with Git LFS (Large File Storage).

🔽 Download with Git LFS

The repository is automatically cloned without Git LFS; you will only see placeholder files instead of the actual datasets inside paper_data/.
To download the full data, on the terminal go to the repo directory and:

# 1. Install Git LFS (only needed once per machine)
git lfs install

# 2. Fetch the data files
git lfs fetch --all
git lfs checkout

Alternatively, download manually from the github repo Download button.

After downloading, run the Run_Analysis.py or Run_Quantification.py scripts within the folder.

---

📬 Contact

For questions or issues, please open an issue on GitHub.

---