How 'Foundational' Are Current Molecular Foundation Models?
Francesca Grisoni
Abstract
Large-scale models have permeated the molecular sciences, yet what makes a model 'foundational' in this domain remains poorly defined. This paper proposes three testable criteria for assessing the foundational nature of molecular models: (i) generality across molecular entities, properties, and tasks; (ii) transferability to new applications with no or minimal task-specific retraining; and (iii) generalization beyond the training distribution. Applying these criteria to the state of the art reveals promising progress, particularly visible in biomolecular structure prediction and machine-learned interatomic potentials, although none of the approaches examined fully satisfies all three. Success is concentrated in domains where target properties are consistently defined and training data are abundant, with low label noise relative to physically meaningful variation. More broadly, progress in the molecular sciences appears to depend less on model scale alone than on the quality and structure of available data, as well as the incorporation of prior knowledge into models, prediction tasks, or downstream applications. This work shifts the notion of a molecular foundation model from a descriptive label to a testable hypothesis, offering a framework for assessing current models and guiding future developments.
Create a lesson
Related papers
Fold'EM: Direct atomic structure inference from Cryo-EM particles
Advaith Maddipatla, Märt-Erik Mäeots, Marco Pegoraro et al.
Multi-Scale Temporal Flows for Peptide Trajectory Generation
Xichen Sun, Wentao Wei, Xiaoxi Zhang et al.
Molecular architecture of TE-seeded chromosome-naive initiation networks of protein-protein interactions delineates the Human Protein Map of the assembly of multiprotein complexes
Gennadi Glinsky
StabilityArc: Decoding Protein Sequence Embeddings into Generalizable Stability Landscapes
Aaron L. Feller, Andrew D. Ellington, Claus O. Wilke
Ca2+-tunable mechanics and recoil in reconstituted Tcb2 networks
Xiangting Lei, K. R. Prathyusha, Carlos Floyd et al.
Leveraging secondary-structure information for accurate nucleic acid structure prediction with OFoldNA
Valhalla Team