← Latest papers
🧬 biology

MIMIC-MJX: Neuromechanical Emulation of Animal Behavior

MIMIC-MJX is a fast and generalizable framework that learns biomechanically grounded neural control policies from kinematic data to accurately simulate animal behavior and model the underlying motor control processes in physics simulations.

Original authors: Charles Y. Zhang (Harvard University), Yuanjia Yang (Salk Institute for Biological Studies), Aidan Sirbu (Mila), Elliott T. T. Abe (University of Washington), Emil Wärnberg (Harvard University), Eric
Published 2026-08-05
📖 7 min read🧠 Deep dive

Original authors: Charles Y. Zhang (Harvard University), Yuanjia Yang (Salk Institute for Biological Studies), Aidan Sirbu (Mila), Elliott T. T. Abe (University of Washington), Emil Wärnberg (Harvard University), Eric J. Leonardis (Salk Institute for Biological Studies), Diego E. Aldarondo (Harvard University), Adam Lee (Harvard University), Aaditya Prasad (Massachusetts Institute of Technology), Jason Foat (Salk Institute for Biological Studies), Kaiwen Bian (Salk Institute for Biological Studies), Joshua Park (Salk Institute for Biological Studies), Rusham Bhatt (Salk Institute for Biological Studies), Vyom N. Patel (Neuromatch), Hutton Saunders (Salk Institute for Biological Studies), Austin O. Barbano (Salk Institute for Biological Studies), Akira Nagamori (Salk Institute for Biological Studies), Ayesha R. Thanawalla (Salk Institute for Biological Studies), Kee Wui Huang (Salk Institute for Biological Studies), Fabian Plum (Imperial College London), Hendrik K. Beck (Imperial College London), Steven W. Flavell (Massachusetts Institute of Technology), David Labonte (Imperial College London), Blake A. Richards (Mila), Bingni W. Brunton (University of Washington), Eiman Azim (Salk Institute for Biological Studies), Bence P. Ölveczky (Harvard University), Talmo D. Pereira (Salk Institute for Biological Studies)

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ⚕️ This is an AI-generated explanation of a preprint that has not been peer-reviewed. It is not medical advice. Do not make health decisions based on this content. Read full disclaimer

Imagine you are watching a squirrel scramble up a tree. You can see its paws gripping the bark, its tail balancing, and its muscles flexing. But what you can't see is the invisible, lightning-fast conversation happening inside its brain. The nervous system isn't just a remote control sending simple "move up" or "move down" signals; it's a complex orchestra conducting a massive, heavy body through a world full of gravity, friction, and surprise. Scientists have long wanted to understand this conversation, but there's a catch: you can't easily peek inside a living animal's brain while it's running, and you can't just ask a squirrel to describe how it feels to balance.

To solve this, scientists use a trick called "neuromechanical modeling." Think of it like building a digital twin of the animal—a virtual body with muscles, bones, and physics that work just like the real thing. Then, they try to teach a computer brain (an artificial neural network) to control this digital body so it moves exactly like the real animal. The goal is to reverse-engineer the brain's secrets by seeing what kind of "thoughts" (control signals) are needed to make the digital body dance. However, until now, building these digital twins has been like trying to run a supercomputer on a toaster: it required massive, expensive clusters of computers that only big tech companies could afford, making it hard for regular biology labs to play with these ideas.

Enter MIMIC-MJX, a new, open-source toolkit that changes the game. The researchers behind this project, a team from Harvard, the Salk Institute, and others, have created a system that lets scientists train these digital brains on a single, standard graphics card (the kind found in gaming computers) rather than a room full of servers. They call their framework "MIMIC-MJX," and it acts like a master mimic. It takes video footage of real animals moving—rats scurrying, flies walking, worms squirming—and uses it to teach a virtual version of that animal how to move in a physics simulation.

Here is how it works, step by step. First, the system looks at a video of a real animal and figures out exactly how its joints are bending and where its limbs are in space. It's like taking a 3D skeleton and fitting it perfectly to the video, even if the video only shows the outside of the fur or skin. This is done using a tool called stac-mjx, which acts as a high-speed translator, turning 2D or 3D video dots into precise joint angles for a virtual body.

Once the virtual body knows what the real animal did, the second part of the system, called track-mjx, goes to work. This is the "teacher." It uses a method called deep reinforcement learning, which is a bit like training a dog with treats, but the dog is a computer program and the treats are mathematical rewards. The program tries to move the virtual animal to match the video. If the virtual rat lifts its paw at the wrong time, it gets a "bad score." If it matches the video perfectly, it gets a "good score." Over millions of tries, the computer brain learns the exact muscle commands needed to reproduce the movement.

What makes MIMIC-MJX special is that it's fast and flexible. The authors tested it on a wide variety of creatures: a rat, a fruit fly, a mouse arm, a stick insect, and a worm. They found that the system could learn to mimic these animals' movements with incredible accuracy. For example, when they trained it on a rat, the virtual rat could reproduce walking, rearing up, and grooming motions with an error of only about 7 millimeters—roughly the width of a pencil eraser. Even more impressively, the system could keep the virtual rat moving for long periods, not just for a split second. In tests, about 83% of the virtual rats could keep moving for two full minutes without falling over, even though they were only trained on short 5-second clips. This suggests the system learned the principles of movement, not just memorized a few seconds of video.

The researchers also showed that this system works with different types of "bodies." Some animals in their study, like the rat and the fly, were controlled by simple "torque" (twisting force) motors, while others, like the mouse arm and the worm, used more complex "muscle" models that mimic how real muscles stretch and contract. MIMIC-MJX handled both types successfully, proving it can adapt to different biological realities.

One of the most exciting parts of the paper is how they used these trained "mimics" to do experiments that would be impossible in real life. They took the low-level controller (the part that knows how to move the muscles) and froze it, then attached a new, simple brain on top to teach the animal a new trick. They asked the virtual rat to run at a specific speed or to escape from a bowl-shaped pit. The virtual rat, guided by the MIMIC-MJX controller, learned these new tasks quickly and moved in a very natural way. In contrast, when they tried to train a robot from scratch without this "mimic" foundation, it either failed completely or moved in a jerky, unnatural way. This suggests that the MIMIC-MJX system has captured something fundamental about how animals move, creating a "prior" or a baseline of natural behavior that makes learning new things much easier.

The paper also peered inside the "brain" of their virtual controllers to see what they were thinking. By analyzing the data flowing through the network, they found that the system organized movement into simple, low-dimensional patterns. For the fruit fly, the "thoughts" about walking formed a neat, circular loop in the data, representing the rhythm of the steps. For the mouse arm, the data showed that the brain was compressing complex movements into a few key variables, much like how a human might think "reach for the cup" rather than calculating every single muscle twitch.

However, the authors are careful to note what this system is not. They explicitly state that while the system can reproduce the movement perfectly, the specific electrical signals it generates to do so are not necessarily the exact same signals a real animal's brain uses. Because there are many ways to move a limb (a problem known as "Bernstein's degrees-of-freedom"), the computer might find a different solution than the animal did. The system is a valid simulation of how the body could move, but it doesn't prove how the animal actually thinks. It's a powerful tool for generating hypotheses, not a final answer key.

Furthermore, the system relies on the quality of the digital body models. If the virtual rat's muscles or bones aren't built correctly, the mimicry will fail. The authors admit that building these detailed body models is still a hard, time-consuming job that researchers have to do themselves for new species. They also simplified some physics, like ignoring the air resistance or the complex way fur might interact with the ground, to keep the simulations running fast.

Despite these limitations, MIMIC-MJX represents a significant shift in how neuroscience can be done. By making these powerful simulations accessible to any lab with a standard computer, it opens the door for thousands of researchers to run "virtual experiments." They can test how a nervous system might adapt to a new environment, what happens if a specific muscle is removed, or how learning occurs, all without needing to catch a single animal. It turns the virtual animal into a practical, manipulable subject, bridging the gap between the messy reality of biology and the clean precision of computer science. The paper concludes that this is a crucial step toward a future where "virtual neuroscience" is a standard partner to real-world experiments, helping us finally decode the complex dance between the brain and the body.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →