← Latest papers
💻 computer science

GeoCore-9B: Towards Geo-Aware Generative Foundation Models in Earth Observation

The paper introduces GeoCore-9B, a 9-billion-parameter generative foundation model trained from scratch on global Earth observation data using a Flow Matching-based Diffusion Transformer and a novel Geospatial Semantic Alignment loss to achieve state-of-the-art performance in visual fidelity and geographic structural accuracy for diverse EO applications.

Original authors: Jeonghyeok Do, Munchurl Kim

Published 2026-08-04
📖 9 min read🧠 Deep dive

Original authors: Jeonghyeok Do, Munchurl Kim

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine you are trying to teach a robot to draw the entire planet Earth from space. You might think, "Easy! Just show it a million photos of cats, cars, and sunsets, and it will learn how to draw anything." But here's the catch: photos of cats are taken from eye-level, with perspective and shadows that make things look 3D. Satellite photos, however, are taken from straight above, like a map. They don't have the same "feel." If you try to teach a robot using only cat photos, it will get confused. It might try to draw a city with a horizon line or make a forest look like it's tilting, because it's trying to apply "ground-level" rules to a "bird's-eye" view. This is the big puzzle scientists in Earth Observation (EO) are trying to solve: how do we build an AI that understands the unique, flat, and physically precise nature of satellite imagery without getting tricked by the habits of regular photography?

Enter GeoCore-9B, a new digital artist that refuses to copy the old ways. Instead of trying to learn from cat photos and then "fine-tune" itself, this model was trained from scratch—starting with a blank slate—using only 10 million real satellite images. Think of it as a student who skips the general art class and goes straight to a specialized school for map-making. This 9-billion-parameter giant doesn't just guess what a city looks like; it knows exactly where it is. It can be told, "Draw a dense city at this specific latitude and longitude, with this specific ground resolution," and it will obey.

The researchers found that by teaching the model to pay attention to real-world coordinates and physical scales, it creates images that are not only pretty but geographically accurate. They also discovered a clever trick to help the model learn faster: they used a "teacher" network (a frozen, expert AI that already knows how to spot terrain) to whisper hints to the student during training. This didn't make the final model slower or heavier; it just made the learning process much more focused. The result? GeoCore-9B can generate stunningly realistic satellite views, remove clouds from blurry photos, and even translate radar images (which look like static noise) into clear optical pictures. It suggests that when we stop trying to force Earth observation to fit into the mold of regular photography, we can build tools that truly understand our planet.

The Problem: The "Cat Photo" Trap

For a long time, the best AI models for generating images were trained on the internet's favorite subject: natural photos of people, animals, and landscapes. These models, like the famous "Stable Diffusion," are amazing at creating art. But when scientists tried to use them to generate satellite images, things went sideways.

Imagine trying to teach a dog to swim by showing it pictures of birds. The dog might try to flap its ears or fly instead of paddling. Similarly, these AI models were "biased" toward perspective. They expected objects to have a horizon, to be viewed from an angle, and to have a specific "casual" scale. But satellite images are orthographic—they are straight-down views with no horizon, where a house looks the same size whether it's in the foreground or background.

When researchers tried to force these "natural image" models to draw satellite maps, the results were often weird. The AI would draw roads that curved into the sky or buildings that looked like they were leaning over. It was trying to apply the rules of a street-level photo to a map from space. The paper argues that simply "fine-tuning" (tweaking) these existing models isn't enough because the underlying "brain" of the model is still thinking in terms of cats and cars, not continents and cities.

The Solution: A Model Born from Space

To fix this, the authors built GeoCore-9B. This is a massive generative foundation model with 9 billion parameters. The key difference? It wasn't trained on the internet's photo collection. It was trained exclusively on 10 million satellite images from a dataset called Git-10M.

Think of GeoCore-9B as a cartographer who has never seen a street-level photo. It only knows the world from above. It was built on a new architecture called a Diffusion Transformer (DiT) using Flow Matching. In simple terms, "diffusion" is like starting with a cloud of static noise and slowly refining it into a clear picture, step by step. "Flow Matching" is a smoother, more efficient way to guide that noise into a clear image, especially for huge models.

But a model that only knows how to draw isn't enough; it needs to know where to draw. GeoCore-9B is "geo-aware." It takes three special inputs along with a text description:

  1. Text: What you want to see (e.g., "a busy harbor").
  2. Ground Sample Distance (GSD): How detailed the image should be (e.g., 1 meter per pixel vs. 32 meters per pixel).
  3. Coordinates: The exact latitude and longitude.

This allows the model to say, "Okay, you want a harbor? At 1-meter resolution in New York, I'll draw tiny boats and cranes. But at 32-meter resolution in the Sahara, I'll draw a broad, sandy coastline." It adapts its "brushstrokes" based on the physical reality of the location.

The Secret Sauce: The "Teacher" Whisper

Training a 9-billion-parameter model from scratch is incredibly hard. It's like trying to teach a toddler to speak a complex language without any books; they might get stuck or start making up nonsense. The researchers noticed that without help, the model's images would sometimes look "disoriented" or have fragmented textures.

To solve this, they introduced a Geospatial Semantic Alignment (GSA) loss. Here's the analogy: Imagine the student (GeoCore-9B) is drawing a map. Sitting next to them is a frozen teacher (a specialized AI called DINOv3-Sat) who is an expert at recognizing terrain but isn't allowed to draw anything. The teacher looks at the student's sketch and whispers, "Hey, that river looks a bit jagged; real rivers are smoother," or "That forest patch is too scattered."

The student listens and adjusts their drawing to match the teacher's structural hints. Crucially, this "teacher" is only used during the training phase. Once the student is ready, the teacher is removed. This means the final model is just as fast and lightweight as it would be without the teacher, but it learned much better structural rules. The paper shows that this trick significantly improved the quality of the generated images, making roads straighter and buildings more realistic, without adding any extra cost to the final product.

What Can It Do?

The authors tested GeoCore-9B in several ways to see if it was actually useful, not just a pretty picture generator.

1. Text-to-Image Generation:
When asked to draw scenes based on text, GeoCore-9B outperformed previous models. While other AIs struggled with weird artifacts (like houses floating in the sky), GeoCore-9B produced images that looked like authentic satellite photos. It could handle complex prompts like "a dense metropolis with lakes and a metallic dome" and get the layout right.

2. Scale Awareness:
One of the most impressive feats was its ability to change its "zoom level" on command. If you asked for a 1-meter resolution, it drew fine details like individual cars and trees. If you asked for a 32-meter resolution, it drew broad patterns like large fields and city blocks. Previous models often got confused, drawing tiny cars at a low zoom or giant trees at a high zoom. GeoCore-9B understood the physics of scale.

3. The "No-Text" Challenge:
The researchers even tested the model without giving it any text description, just latitude and longitude. Surprisingly, GeoCore-9B could still generate accurate terrain for that specific location. If you gave it the coordinates for the Sahara, it drew sand dunes. If you gave it the coordinates for New York City, it drew skyscrapers. This proves the model had truly learned the "geographic priors" of the Earth, not just memorized text-image pairs.

4. Practical Rescue Missions:
The model wasn't just for making new pictures; it was also tested on fixing real-world problems.

  • Cloud Removal: Satellite cameras often get blocked by clouds. GeoCore-9B was able to look at a cloudy image and "hallucinate" (predict) what the ground looked like underneath, removing the clouds and revealing roads and fields with high accuracy.
  • SAR-to-Optical Translation: Radar images (SAR) look like static noise and are hard for humans to read. GeoCore-9B could take a noisy radar image and translate it into a clear, optical photo. It did this better than many specialized tools designed just for this task.

The Verdict

The paper suggests that GeoCore-9B establishes a new standard for generating Earth observation data. It proves that training a massive model from scratch on satellite data, rather than trying to adapt natural image models, leads to better results. The model is not just a "toy" that makes pretty pictures; it shows strong potential for real-world applications like disaster monitoring, urban planning, and environmental tracking.

However, the authors are careful to note that this is a starting point. The model currently generates RGB (color) images and relies on a pre-trained "encoder" (a tool that compresses images) that was originally designed for natural photos. This means there might be some limits to how much tiny detail it can perfectly preserve. They also point out that while the model is great at generating images, we need to be careful about "geographical deepfakes"—fake images that look so real they could be used to spread misinformation about real places.

In short, GeoCore-9B is a giant leap forward. It's the first time a model of this size has been built specifically to understand the Earth from space, learning to draw our planet not as a collection of objects, but as a coherent, geographically accurate map. It suggests that the future of Earth observation lies in models that respect the unique geometry of our planet, rather than trying to force it into the shape of a selfie.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →