🔬 optics

All-optical Edge Computing for Speckle Sensing Interrogation

This paper presents an all-optical edge-computing platform that utilizes a trained digital micromirror device to perform real-time, task-specific signal processing on speckle patterns, thereby eliminating electronic bottlenecks and achieving high-speed, crosstalk-free multi-point fiber sensing.

Original authors: Tomás Lopes, Joana M. Teixeira, Tiago D. Ferreira, Catarina S. Monteiro, Pedro A. S. Jorge, Nuno A. Silva

Published 2026-05-26

📖 4 min read☕ Coffee break read

CC BY 4.0

Original authors: Tomás Lopes, Joana M. Teixeira, Tiago D. Ferreira, Catarina S. Monteiro, Pedro A. S. Jorge, Nuno A. Silva

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

The Big Problem: The "Slow Camera" Bottleneck

Imagine you are trying to listen to a crowded room where three people are speaking at once, but they are all whispering through a thick, wavy glass wall. The sound gets scrambled into a complex, shifting pattern of noise (this is called a speckle pattern).

Traditionally, to figure out who is saying what, you would need a super-fast camera to take a picture of the entire wall, send that huge photo to a computer, and then use software to analyze the pixels.

The Catch: Cameras are slow. They can only take pictures so many times per second. By the time the computer processes the photo, the "whispers" have already changed. This creates a delay (latency) and limits how fast you can listen. It's like trying to catch a hummingbird with a slow-motion camera that only takes one photo every minute.

The Solution: An "Optical Brain" at the Edge

The authors built a new system that skips the camera and the computer entirely. Instead of taking a picture and then thinking about it, their system thinks with light itself.

Think of it like a smart window (called a Digital Micromirror Device, or DMD) placed right in front of the scrambled sound.

The Window: This window is made of thousands of tiny, movable mirrors.
The Filter: Instead of letting all the light through to a camera, the system uses these mirrors to act as a custom filter. It blocks some parts of the light and lets others through, effectively "squashing" the complex 3D noise down into a simple 1D signal (like turning a complex painting into a single number).
The Listeners: Two ears (photodetectors) listen to the light that gets through. They compare the two signals to figure out exactly what is happening.

How It Learns: The "Trial and Error" Coach

The system doesn't come pre-programmed with the right settings. It has to learn how to separate the three voices on its own.

The researchers used a method called an Evolutionary Algorithm (think of it as a digital version of "survival of the fittest"):

Generation 1: The system randomly flips the tiny mirrors on the window. It listens to the result. It's probably a mess.
The Coach: A computer acts as a coach. It says, "That was bad. Try flipping these specific mirrors this way."
Evolution: The system tries thousands of different mirror patterns. It keeps the ones that make the "target voice" louder and the "other voices" quieter.
Result: Eventually, the system finds the perfect "mask" (a specific pattern of mirrors) that isolates one specific vibration from the fiber optic cable.

The Real-World Test: The Fiber Optic Guitar

To prove this works, they used an optical fiber (a strand of glass that carries light) and attached three tiny speakers (piezoelectric actuators) to it at different spots.

They played different sounds on all three speakers at the same time.
The light coming out of the fiber got scrambled by all three sounds.
The Magic: By training the "smart window" (the DMD), they could tune the system to listen only to the first speaker, then switch the settings to listen only to the second, and so on.

The Results:

Speed: Because they didn't use a camera, the system could react instantly, limited only by how fast the electronic "ears" could hear.
Clarity: They managed to boost the target sound by more than 4 decibels (making it clearly audible) while suppressing the other sounds by more than 10 decibels (making them almost silent).
Real-time: They could even play the separated sounds through a speaker in real-time, effectively "unscrambling" the audio instantly.

Why This Matters

This paper shows that we don't always need to take a picture and process it on a cloud server to understand complex data. By doing the "math" directly with light and mirrors right where the data is created (at the "edge"), we can process information much faster and with less delay.

In short: They replaced a slow, heavy camera-and-computer process with a fast, lightweight "optical filter" that learns to separate mixed signals instantly, just by listening to the results and adjusting its own settings.

Technical Summary: All-Optical Edge Computing for Speckle Sensing Interrogation

Problem Statement
Speckle-based sensing leverages the high-dimensional spatial intensity patterns generated by complex interference to encode environmental information. However, traditional interrogation methods rely on camera-based acquisition followed by electronic digitization and digital post-processing. This pipeline introduces significant latency and bandwidth bottlenecks, restricting temporal resolution and preventing real-time operation. The data load scales with the number of camera pixels rather than the complexity of the sensing task, creating computational burdens that hinder the tracking of fast, dynamic changes. While alternatives like event-based vision exist, there remains a critical need for interrogation architectures that operate at high bandwidths without relying on conventional full-frame imaging pipelines.

Methodology
The authors propose an all-optical edge-computing platform that performs task-specific computation directly in the optical domain, bypassing the need for full-field image capture. The core of the system involves projecting the output speckle pattern onto a Digital Micromirror Device (DMD), which acts as a programmable optical layer.

Optical Architecture: The speckle field is magnified and projected onto the DMD. To handle the non-negativity constraint of DMD weights, the beam is split, and complementary halves of the weighted field are routed to two distinct photodetectors. The system performs a differential measurement ( $\Delta I = I_+ - I_-$ ), where square-law detection combined with optical interference produces a nonlinear projection of the encoded information.
Optimization Strategy: Since the mapping between physical stimuli and speckle patterns is complex and sensitive to imperfections, the system employs a model-free, in-situ training procedure. A two-step evolutionary optimization strategy is used:
1. Genetic Algorithm (GA): Performs a global exploration of the mask space to find a coarse mask that maximizes the signal power at target frequencies while suppressing others.
2. Cross-Entropy Method (CEM): Fine-tunes the mask parameters based on the GA output to further enhance the signal-to-noise ratio (SNR) and suppress crosstalk.
Training Loop: The optimization relies solely on feedback from the differential detector voltage. A loss function based on the inverse of the SNR ratio is minimized to train the DMD masks to isolate specific sensing events without requiring an explicit physical model of speckle propagation.

Key Contributions

All-Optical Edge Computing Framework: The paper presents a general framework for compressing and processing high-dimensional wave information at the physical layer, shifting mode projection to the optical domain to produce readout signals aligned directly with the sensing task.
Model-Free In-Situ Training: The introduction of a genetic algorithm and cross-entropy method to program reconfigurable optical elements using only detector feedback, circumventing the need for explicit modeling of complex optical propagation.
Multi-Point Signal Decoupling: The demonstration of a system capable of independently resolving concurrent perturbations applied at distinct positions along a multimode optical fiber.

Results
The system was validated using a multi-point optical fiber sensing task where three piezoelectric actuators simultaneously perturbed the fiber at different locations.

Signal Separation: The optimized spatial masks successfully decoupled concurrent signals. The system achieved a target signal enhancement exceeding +4 dB (indicating the reconstructed signal energy was at least twice the residual energy) while suppressing crosstalk leakage to below -10 dB (less than one-tenth of the residual energy).
Real-Time Operation: The system operated with bandwidths limited only by the photodetectors, successfully separating signals in the audible range (up to ~8 kHz). The authors note that the bandwidth ceiling in this specific experiment was primarily due to the mechanical coupling of vibrations to the fiber rather than the optical or computational framework.
Quantitative Validation: A spectrogram-based Cross-SNR matrix confirmed strong diagonal dominance, proving that the system effectively isolates target perturbations from a mixture of concurrent signals.

Significance and Claims
The paper claims that this approach establishes a general framework for optical edge computing in speckle-based sensing, demonstrating how high-dimensional wave information can be processed at the physical layer to enable real-time and ultrafast sensing. By bypassing the camera bottleneck, the system produces low-dimensional, task-aligned electrical signals immediately available as high-bandwidth analog voltages, ready for direct interfacing with downstream hardware.

The authors position this work as a paradigm shift away from cloud-centric processing, which is increasingly limited by data rates. They assert that this solution opens new opportunities for high-speed, adaptive sensing in fiber optics, imaging, and wave-based perception systems. While the current demonstration focuses on acoustic fiber sensing, the authors suggest the principles naturally extend to other tasks where information is encoded in high-dimensional interference patterns, such as particle discrimination or defect classification, provided the optical masks are trained to respond selectively to specific classes. The work emphasizes that the demonstrated capabilities are limited by the mechanical setup in the current experiment, not the fundamental limits of the training framework or the optical hardware.