top of page

IBM and NASA Open Their Lunar Foundation Model, but Maps Still Need Human Proof

Sep 12
13 min read

IBM and NASA released the NASA-IBM Lunar Foundation Model as open-source software on September 10, targeting three difficult lunar mapping problems with one reusable system. The model analyzes craters, potential ice deposits, and volcanic formations across observations collected at sharply different resolutions. Its release challenges the usual scientific workflow of training a separate model for every instrument and research question.

That challenge is more important than the headline performance figures. IBM says the model reduced error on one ice-prospecting benchmark by 22 percent against a widely used vision baseline. At coarse-resolution crater detection, it reportedly delivered nearly 19 percent better performance while using half the training data. Those results are promising, but they come from benchmarks designed and reported by the project team.

The real contest is therefore not IBM against another AI company. It is a reusable, multimodal scientific model against task-specific systems built around individual datasets. The first approach promises faster research and broader access. The second remains easier to validate within a narrow scientific problem.

The NASA-IBM Lunar Foundation Model Unifies Fragmented Observations

The release turns a collection of disconnected lunar measurements into a common starting point for scientific AI projects.

IBM and NASA published the model, its weights, supporting datasets, and adaptation tools for outside researchers. The software is available through Hugging Face under the Apache 2.0 license, according to its public model card.

A foundation model is trained on broad data so researchers can adapt it to multiple downstream tasks. In this case, “broad” refers to different forms of lunar remote-sensing data, not internet text or conversational knowledge.

The distinction matters because this is not a chatbot for asking questions about the Moon. It is a vision system built to extract and generate representations of lunar surfaces, terrain properties, and observation conditions.

IBM and NASA also assembled a machine-learning-ready dataset containing more than 30 spatially aligned layers. Those layers draw from nine instruments associated with four missions, according to the project’s lunar model release.

The underlying observations include data from NASA’s Lunar Reconnaissance Orbiter and Gravity Recovery and Interior Laboratory mission. They also incorporate measurements from the Japanese Aerospace Exploration Agency’s SELENE, also known as Kaguya.

These instruments do not view the Moon in the same way. Some record visible surface details, while others measure temperature, gravity, elevation, radar properties, mineral composition, or hydrogen abundance.

Their spatial resolutions also differ substantially. The Lunar Reconnaissance Orbiter’s Narrow Angle Camera can capture terrain at about one meter per pixel. Its Wide Angle Camera provides much broader context at roughly 100 meters per pixel.

Gravity measurements can operate at far coarser scales. Combining those sources requires more than placing several image files in the same folder.

The project team aligned observations geographically and divided them into co-registered tile bundles. Each bundle represents the same lunar area through several instruments or derived measurements.

The published SomBench pretraining dataset contains about two million such bundles. Its model card lists 1,000,113 Narrow Angle Camera bundles and 963,609 Wide Angle Camera bundles.

The system learned from 11 modalities at two main spatial scales. Nine modalities are dense, image-like data sources. The remaining inputs encode optical metadata and static geographic context.

That optical information includes solar incidence, emission, phase, and azimuth angles. It also covers ground sampling distance and relevant surface coordinates.

Lighting information is unusually important on the Moon. With almost no atmosphere to scatter light, small changes in solar angle can produce starkly different shadows and highlights.

A model that ignores those conditions might interpret lighting changes as terrain changes. The NASA-IBM Lunar Foundation Model instead receives acquisition geometry as an explicit input.

This design helps separate what an instrument saw from the conditions under which it saw it. That is a necessary step before researchers can compare observations made at different times or viewing angles.

The model therefore changes more than the speed of one mapping task. It provides a shared representation for observations that previously demanded considerable preprocessing and task-specific engineering.

That common representation creates the article’s central tension. A reusable model offers broader reach, but every downstream scientific claim still needs task-level validation.

Why One Reusable Model Puts Task-Specific Systems Under Pressure

IBM and NASA are betting that lunar researchers should adapt one shared backbone instead of rebuilding the entire analytical pipeline for each question.

Traditional scientific machine learning often begins with a carefully selected dataset and one narrow objective. Researchers might train one model to find craters, another to outline volcanic formations, and another to estimate ice prospectivity.

That approach offers conceptual clarity. Each model has a defined input, target label, and evaluation method.

It also duplicates work. Teams repeatedly clean datasets, design input pipelines, choose architectures, and train large groups of parameters before investigating their actual scientific question.

A pretrained lunar backbone shifts more of that effort upstream. Researchers can start with features learned from several observation types, then adapt the model with a smaller task-specific dataset.

IBM and NASA tested this approach through full fine-tuning, frozen encoders, and low-rank adaptation. Low-rank adaptation, usually called LoRA, trains small auxiliary matrices while leaving most base-model parameters unchanged.

The project’s researchers used LoRA configurations that kept approximately 90 percent of the base model’s weights frozen. This can reduce the computing and storage required for adaptation.

However, the published results do not support one universal adaptation rule. The model card says LoRA matched or beat full fine-tuning on crater detection, while full fine-tuning retained an advantage on two small benchmarks.

A completely frozen encoder performed best on one small volcanic-feature dataset. Yet it fell below every baseline on crater detection.

Those differences are useful because they undermine a simplistic deployment story. Researchers still need to test which adaptation strategy fits their data, labels, and error tolerance.

The broader pressure falls on workflows organized around single sensors. Lunar questions frequently cross instrument boundaries because the visible appearance of a location reveals only part of its physical story.

Potential ice deposits provide a clear example. Researchers may consider surface temperature, slope, illumination, topography, radar measurements, and estimates of subsurface stability.

A conventional image model can stack several layers as input channels. The lunar model gives each modality a separate learned adapter, then combines the resulting tokens within its transformer architecture.

A transformer is a neural network that evaluates relationships among input elements. Here, those elements represent patches from different lunar measurements rather than words in a sentence.

This token-level approach lets the model preserve distinctions among modalities before learning their relationships. IBM attributes part of the ice benchmark improvement to that design.

The architecture also trains across a 100-fold resolution difference. Narrow and wide-angle tiles enter the same mixed training process at their native resolutions.

FlexiViT patch embeddings let researchers change the image patch size during adaptation without retraining the backbone from the beginning. That flexibility matters when one task depends on small crater rims and another depends on regional patterns.

The system was trained from scratch as a Vision Transformer Base encoder-decoder. The encoder uses 12 layers, 12 attention heads, and a hidden dimension of 768.

According to the model documentation, pretraining used 16 Nvidia H100 GPUs for 150,000 steps. The reported workload totaled roughly 1,100 GPU hours, with a global batch size of 1,536.

Those requirements are substantial for an individual research group. Open weights let outside teams avoid repeating that pretraining expense, although fine-tuning and evaluation still require suitable hardware.

This is where the open release creates practical pressure. A specialized team now has to justify building a new backbone before testing an existing lunar model with relevant pretrained features.

The pressure will be strongest for researchers with limited labeled data. On the wide-angle crater benchmark, pretrained variants using half the available training data matched or exceeded a leading baseline trained on the full set.

Developers can access runnable configurations through the project’s fine-tuning repository. The repository includes modules for crater detection, volcanic-feature segmentation, and ice prospectivity.

It does not include the pretraining code, according to its README. That omission narrows what “open source” means for anyone seeking to reproduce the model from raw data.

The weights, adaptation code, configurations, license, and benchmark datasets provide considerable access. Full pretraining reproducibility remains a separate and more demanding standard.

Teams evaluating the release will need to preserve those distinctions in their own technical records. A searchable engineering knowledge base can help connect model versions, dataset assumptions, experiments, and review decisions.

The model is therefore not an automatic replacement for specialized systems. It is a credible default that specialized systems must now outperform, simplify, or validate more convincingly.

The Mechanism Connects Scale, Modality, and Lunar Lighting

The model’s main technical contribution is not a single accuracy score, but a way to reason across incompatible observations without erasing their differences.

IBM and NASA adapted the training approach used by TerraMind, a multimodal Earth-observation model developed by IBM and the European Space Agency. The lunar version uses masked-token modeling.

During masked-token training, parts of the input are hidden and the system learns to reconstruct selected targets. This encourages the model to learn relationships within and across observation types.

A visible image might help explain topographic structure. Thermal information might relate to shadowing and surface composition. Radar or hydrogen measurements might add clues unavailable in ordinary photography.

The system can learn those relationships because its training tiles cover the same geographic areas. Spatial alignment gives the model a basis for comparing measurements that originated in different instruments.

The first lunar-specific addition is acquisition geometry. Each tile includes observation and illumination conditions as sequence tokens.

That choice directly addresses a major source of visual confusion. The same ridge can look like a bright edge in one image and disappear into shadow in another.

At the lunar poles, low solar angles create long shadows that can conceal hazards. Permanently shadowed regions are especially difficult because ordinary reflected-light imaging reveals little detail.

The second addition is joint mixed-resolution pretraining. One set of weights processes both meter-scale and regional observations, rather than treating each scale as a separate model family.

This matters for crater analysis. A small crater’s rim may require high-resolution imagery, while the surrounding terrain provides geological context at a much broader scale.

It also matters for prospective landing areas. Researchers must connect local hazards with regional illumination, slope, temperature, and access considerations.

The model’s 11 modalities do not all offer global coverage. Some static layers are available only within an instrument’s footprint, and some polar products cover relatively few tiles.

Modality-wise tokenization lets a researcher omit unavailable inputs or add selected modalities during fine-tuning. The model does not require every observation type for every task.

That flexibility is essential for real scientific archives, where missing data is normal. It also raises an evaluation question: performance can vary depending on which modalities are present.

The published benchmarks cover four downstream problems. They include wide-angle crater detection, meter-scale crater detection, irregular mare patch segmentation, and polar ice prospectivity.

Irregular mare patches are unusual, relatively smooth volcanic formations found within the Moon’s dark basaltic plains. Their ages and origins remain debated, so mapping their boundaries can support broader geological analysis.

For wide-angle crater detection using half the training data, the best lunar model configuration achieved a mean average precision of 0.2541. The best reported SwinV2-B baseline reached 0.2313.

Mean average precision summarizes detection quality across confidence and overlap thresholds. It rewards systems that find relevant objects while limiting false detections.

With the complete wide-angle training set, the best lunar configuration reached 0.2581. The corresponding SwinV2-B baseline reached 0.2420.

At meter-scale crater detection, the difference nearly disappeared. The model achieved 0.1543, compared with 0.1552 for the leading baseline.

That result is as informative as the larger gains. It shows that pretraining did not produce a decisive advantage across every resolution and task.

For irregular mare patch segmentation, the best reported lunar result reached an intersection-over-union score of 0.5709. The strongest listed baseline reached 0.5687.

Intersection over union measures how closely a predicted region overlaps the labeled region. The narrow margin does not establish a dramatic capability gap.

The polar ice prospectivity benchmark produced the clearest result. The lunar model recorded a root mean squared error of 0.0293, while SwinV2-B recorded 0.0377.

Lower root mean squared error indicates closer predictions on that regression task. IBM described the difference as an error reduction of up to 22 percent.

These exact results appear in the project’s technical report. The researchers evaluated most configurations across five random seeds, helping show how much results varied between runs.

Still, benchmark performance and scientific usefulness are not identical. A model can improve a metric without producing discoveries that survive independent measurement.

The likely near-term role is prioritization. The system can highlight locations, patterns, or anomalies that deserve examination through higher-resolution imaging, simulation, or future instruments.

That function has real value. Scientists cannot manually inspect every combination within petabytes of observations, especially when data sources use different grids and scales.

Yet the model’s output should remain a research lead. It is not direct evidence that ice exists beneath a specific surface, nor proof that a mapped formation has a particular age.

Open Weights Do Not Eliminate Scientific Uncertainty

The model can narrow a search area, but it cannot turn remote-sensing correlations into confirmed lunar resources or safe landing decisions.

IBM’s announcement presents three primary applications: finding smaller craters, studying volcanic history, and estimating where lunar ice may occur. Each use case carries a different validation burden.

Crater detection is closest to an observable imaging task. Researchers can compare predicted crater locations with labeled images and independent catalogs.

Even there, labels contain uncertainty. Small craters overlap, erode, or disappear under difficult lighting, while annotation standards can differ among datasets.

The volcanic task is harder because irregular mare patch boundaries can be ambiguous. IBM acknowledges that the evaluation used imperfect labels.

A three percent improvement over one reported task-specific comparison should therefore be treated cautiously. Better overlap with uncertain labels does not resolve the scientific debate about those formations.

Ice prospectivity presents the largest gap between model output and physical confirmation. The model estimates where conditions and measurements resemble areas considered favorable for ice.

It does not directly sample lunar material. A low predicted error on a held-out dataset cannot confirm the quantity, depth, accessibility, or purity of ice at a mission site.

IBM’s release uses careful language, describing potential ice deposits and areas with high prospectivity. Readers should preserve that qualification.

The benchmark comparisons also come from the team that designed the model and assembled the datasets. Independent replication has not yet established whether the reported gains transfer to other regions, labels, or task definitions.

Data leakage is another issue researchers must continually test. Geographically nearby lunar tiles can share terrain patterns even when they are stored as different samples.

The project says it used geographic splits based on lunar mapping zones and polar caps. That is stronger than randomly splitting neighboring tiles, but outside teams should examine the partitioning for their intended tasks.

Coverage bias deserves equal attention. Dense observations tend to cluster around scientifically interesting regions or areas targeted by specific missions.

A model trained on those records might perform differently in sparsely observed terrain. Missing modalities can further change the quality of its predictions.

The Moon’s surface also presents extreme distribution shifts. New instruments may have different noise, calibration, resolution, or viewing geometry from the missions represented in SomBench.

Fine-tuning can help, but adaptation does not guarantee compatibility. Researchers will need instrument-specific tests before relying on the model in operational planning.

The release’s open character improves the prospects for such scrutiny. Outside teams can download weights, inspect configurations, reproduce downstream tests, and create regional benchmarks.

Apache 2.0 also permits broad modification and redistribution. That should make it easier for universities, space agencies, and commercial lunar companies to build specialized versions.

However, the absent pretraining code limits full reconstruction. Researchers can evaluate the released checkpoint, but they cannot yet reproduce every step that produced it using the public repository alone.

Hardware access creates another practical boundary. Avoiding 1,100 GPU hours of pretraining lowers the barrier, but processing multimodal lunar datasets remains computationally demanding.

Documentation and data preparation may become larger obstacles than model availability. Instruments use different projections, resolutions, calibration histories, and physical units.

A technically open model only becomes broadly useful when researchers can reliably reproduce preprocessing and connect outputs to established scientific tools.

Operational use raises an even higher standard. Landing-site selection cannot depend on one machine-learning score because navigation hazards have direct safety consequences.

Mission planners combine imagery, terrain models, lighting studies, communications constraints, thermal conditions, and engineering margins. The lunar model can contribute evidence without replacing that process.

The same restraint applies to resource planning. Water ice could support drinking supplies, oxygen production, and propellant manufacturing, but accessibility determines whether a deposit has operational value.

A location that looks promising remotely may be too deep, too dispersed, or too difficult to reach. Physical measurements will remain decisive.

This tradeoff defines the NASA-IBM Lunar Foundation Model more accurately than the phrase “AI maps the Moon.” It expands the space of testable hypotheses while leaving proof in the hands of instruments and scientists.

Three Signals Will Show Whether Open Lunar AI Matters

The next test is adoption and independent verification, not another headline benchmark from the original team.

The first signal is third-party benchmark replication. Independent researchers need to reproduce the crater, volcanic, and ice results using the released weights and documented data splits.

Replication would strengthen confidence if teams obtain similar results across multiple random seeds. Significant shortfalls would weaken the claim that the pretrained representation offers a dependable advantage.

The most informative studies will test regions or labels not controlled by the original team. They should also report failure cases rather than publishing only aggregate scores.

Those failure cases can reveal whether the model confuses shadowing with terrain, struggles with missing modalities, or underperforms in sparsely observed regions.

The second signal is adaptation to new data or mission workflows. A reusable foundation model earns its name when outside groups can apply it beyond its original benchmark package.

Researchers might test imagery from another lunar mission, add a new measurement type, or fine-tune the backbone for a different geological feature. Successful transfers would support IBM and NASA’s shared-model strategy.

Repeated retraining difficulties would point in the opposite direction. If each new instrument requires extensive preprocessing and architecture changes, task-specific pipelines could retain their practical advantage.

The public software already provides a starting point through TerraTorch configurations and downloadable checkpoints. The next question is whether researchers can extend that foundation without close assistance from its creators.

The third signal is whether the model informs observations or mission decisions that produce verifiable outcomes. That might begin with prioritized imaging targets rather than operational landing guidance.

A useful system could flag undocumented craters for manual review, identify volcanic boundaries for further study, or rank polar regions for follow-up measurements. Scientists could then compare those leads with independent data.

The timeline will depend on research cycles and access to relevant observations. The broader strategic context comes from NASA’s Artemis program, which is intended to support sustained lunar exploration and preparations for Mars.

IBM and NASA previously released scientific foundation models for Earth observation, weather, climate, scientific text, and solar physics. The lunar project extends that pattern into planetary remote sensing.

This history makes the launch more than an isolated demonstration. IBM and NASA are building a family of shared scientific AI systems around public data and reusable architectures.

The approach pressures institutions to reconsider where model development belongs in the research process. A common backbone can reduce duplicate training, but centralized pretraining also concentrates assumptions about data, architecture, and evaluation.

Open access helps expose those assumptions. It does not remove them.

For developers, the immediate opportunity is experimentation with a specialized multimodal model whose inputs have physical meaning. This differs from adapting a general image model with only visible photographs.

For scientists, the opportunity is to connect observations across instruments without rebuilding every representation from scratch. The obligation is to test whether those connections remain scientifically valid.

For mission planners, the model offers another way to prioritize scarce attention and computing. It does not replace high-resolution observations, simulations, field measurements, or engineering review.

That boundary should shape how the release is judged. The NASA-IBM Lunar Foundation Model succeeds first if it becomes a useful research substrate, not if it generates the most dramatic lunar claim.

Over the coming months, watch who reproduces its benchmarks, who adapts it to unfamiliar data, and whether its predictions guide independent observations. Those outcomes will show whether open lunar AI becomes shared infrastructure or remains an impressive research release.

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page