DA-LightNet: Real-Time Rain and Haze Removal on Edge Devices
This paper proposes DA-LightNet, a lightweight, unified deep learning network that effectively removes rain and haze in real-time on resource-constrained edge devices by employing a degradation-aware modulation module and efficient convolutional blocks to balance high restoration quality with low computational cost.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Every day, cameras capture the world as it is, but the world is rarely clear. Rain streaks across a windshield, blurring the road ahead, while thick haze hangs over a city, turning vibrant buildings into gray silhouettes. These weather conditions do more than just ruin a photograph; they strip away the details that machines need to see. For the growing network of smart cameras, drones, and autonomous vehicles that rely on vision to navigate, a blurry image can mean a missed obstacle or a wrong turn. For decades, scientists have worked to teach computers how to clean up these messy images, using complex mathematical models to guess what the scene looked like before the weather interfered. However, the most powerful tools for this job have traditionally been heavy, requiring massive computers with huge amounts of memory and power. This creates a problem: the very devices that need to see clearly in the rain or fog—like a drone flying over a forest or a camera mounted on a car—are often small, battery-powered, and unable to carry the weight of these giant computer programs.
A team of researchers from Sichuan Vocational and Technical College in China has developed a new solution designed specifically for these small, resource-limited machines. They created a system called DA-LightNet, a lightweight image restoration network that can remove both rain and haze in real time. Unlike previous approaches that often required separate, heavy programs for rain and separate ones for fog, this new system uses a single, unified architecture to handle both problems at once. The researchers built the network to be "degradation-aware," meaning it can look at a blurry image and figure out whether the blur is caused by rain or haze, then adjust its cleaning strategy accordingly without needing to switch models. They achieved this by designing a streamlined structure that strips away unnecessary calculations, focusing only on the essential features needed to restore the image. The result is a tool that is small enough to fit on a standard edge device—a term for small computers that process data locally rather than sending it to a distant cloud server—yet powerful enough to produce clear images instantly.
The researchers tested their creation on two specific sets of real-world images: one containing thousands of pairs of rainy and rain-free photos, and another with pairs of hazy and clear photos. They trained the system to learn the difference between the two types of weather damage and how to reverse them. When they ran the system on an NVIDIA Jetson platform, a common type of small computer used for artificial intelligence in the field, it processed images at a speed of 34.8 frames per second. This means it can clear up a video stream in real time, keeping pace with a live camera feed without any noticeable lag. In terms of the math behind the scenes, the entire system uses only 4.6 million parameters, which is a measure of its complexity, and requires 21.5 billion floating-point operations to process a single image. These numbers are significantly lower than other high-performing methods, which often require ten times more computational power.
To understand how this works, imagine the system as a highly efficient editor. When a rainy image arrives, the system first scans it to identify the specific patterns of the rain streaks. It then uses a special module to recalibrate its internal focus, telling itself to pay attention to the high-frequency details that rain obscures while ignoring the global contrast issues caused by fog. If the image is hazy instead, the same module shifts its attention to recovering the overall brightness and color balance. This adaptive process happens within a single, compact chain of operations. The researchers replaced the heavy, standard building blocks usually found in these networks with "efficient restoration blocks." These blocks use a technique called depthwise convolution, which processes each color channel of the image separately before mixing them back together, rather than processing everything all at once. This approach drastically reduces the amount of work the computer has to do. Finally, a lightweight reconstruction head takes the cleaned-up features and assembles them back into a full picture, adding only the necessary corrections to the original image rather than trying to rebuild the entire scene from scratch.
The team compared their new system against several other leading methods, including some that use massive transformer structures and others that rely on complex attention mechanisms. While those heavier models sometimes produced slightly sharper images on paper, they failed to run at real-time speeds on the edge devices. Some of the competitors could only manage about 5 to 15 frames per second, which is too slow for a moving vehicle or a flying drone to rely on for immediate decision-making. DA-LightNet, by contrast, maintained a competitive level of image quality while running more than twice as fast as the next best option. The researchers also tested the system on a Raspberry Pi, an even smaller and less powerful computer, to see if it could handle the task under stricter constraints. The system held its ground, demonstrating that it could function on devices with very limited memory and processing power.
The study suggests that this approach offers a better balance between visual quality and practical speed than current alternatives. The researchers found that by unifying the tasks of rain and haze removal into a single model, they avoided the need to store and run multiple separate programs, which saves both memory and time. They also showed that the system could learn to distinguish between different types of weather damage without needing to be told exactly what kind of weather it was looking at, simply by analyzing the patterns in the image itself. This flexibility is crucial for real-world applications where the weather can change rapidly and unpredictably. The results indicate that high-quality image restoration does not have to be the exclusive domain of powerful, cloud-based supercomputers. Instead, it can be brought directly to the camera lens, allowing smart devices to see clearly even in the worst conditions.
Looking ahead, the researchers plan to expand this work to include other weather challenges, such as snow, low light, and motion blur, aiming to create an even more general system that can handle any type of visual degradation. They also intend to explore further ways to optimize the system for specific hardware, potentially using techniques like quantization to make the model even smaller and faster. Beyond just making pictures look better, they plan to test whether the restored images actually help downstream tasks, such as helping a drone detect a person or a car navigate a busy street. For now, the work stands as a demonstration that with careful design, it is possible to build powerful vision tools that are small enough to fit in the palm of a hand, yet smart enough to clear the world's view in real time.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.