Active Learning for Sample-Efficient Protein Design Using Bayesian Uncertainty Estimation and Experimental Feedback

Authors

  • Noemi Clerc Department of Computer Science, University of North Texas, Denton, TX, USA. Author
  • Keely McCadden Department of Computer Science, George Mason University, Fairfax, VA, USA. Author
  • Tore Borgstrom Department of Computer Science, University of New Hampshire, Durham, NH, USA. Author

Keywords:

active learning; protein design; Bayesian uncertainty; experimental feedback; sample efficiency; research infrastructure; governance; sustainability

Abstract

Protein design is increasingly mediated by machine learning, yet experimental validation remains expensive, slow, and noisy. This paper examines active learning as a systems strategy for sample-efficient protein design, with particular attention to Bayesian uncertainty estimation and the integration of experimental feedback. Rather than treating uncertainty as a narrow modeling accessory, the discussion positions it as a control signal that governs which proteins are synthesized, assayed, and fed back into the next design cycle. The paper develops a system-level account of closed-loop protein design that spans assay orchestration, data provenance, model maintenance, acquisition policy, robotic execution, and governance. It analyzes key trade-offs between sequential and batched experimentation, computational and wet-lab costs, model calibration and exploration, and local optimization and long-term scientific value. The argument emphasizes that sample efficiency is not only a machine learning property but also an infrastructural, institutional, and policy outcome. Robustness under distribution shift, assay variability, and multi-objective design constraints is considered alongside fairness, biosafety, sustainability, and deployment in resource-constrained settings. Cross-domain comparisons with materials discovery, autonomous laboratories, and clinical machine learning clarify both the promise and the limits of Bayesian active learning. The paper concludes that effective protein design systems require uncertainty-aware models, interoperable data infrastructures, reproducible experimental workflows, and governance mechanisms that align efficiency with safety and equitable benefit. Such systems can reduce experimental waste and accelerate discovery, but only if uncertainty estimation, feedback quality, and institutional accountability are treated as first-class design concerns.

References

1. Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., & Hassabis, D. (2016). Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587), 484-489. https://doi.org/10.1038/nature16961

2. Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., Bridgland, A., Meyer, C., Kohl, S. A. A., Ballard, A. J., Cowie, A., Romera-Paredes, B., Nikolov, S., Jain, R., Adler, J., ... Hassabis, D. (2021). Highly accurate protein structure prediction with AlphaFold. Nature, 596(7873), 583-589. https://doi.org/10.1038/s41586-021-03819-2

3. Watson, J. L., Juergens, D., Bennett, N. R., Trippe, B. L., Yim, J., Eisenach, H. E., Ahern, W., Borst, A. J., Ragotte, R. J., Milles, L. F., Wicky, B. I. M., Hanikel, N., Pellock, S. J., Courbet, A., Sheffler, W., Wang, J., Venkatesh, P., Sappington, I., Torres, S. V., ... Baker, D. (2023). De novo design of protein structure and function with RFdiffusion. Nature, 620(7976), 1089-1100. https://doi.org/10.1038/s41586-023-06415-8

4. Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., Simonyan, K., Vinyals, O., Wierstra, D., Silver, D., & Hassabis, D. (2020). Improved protein structure prediction using potentials from deep learning. Nature, 577(7792), 706-710. https://doi.org/10.1038/s41586-019-1923-7

5. Hie, B., Zhong, E. D., Berger, B., & Bryson, B. (2021). Learning the language of viral evolution and escape. Science, 371(6526), 284-288. https://doi.org/10.1126/science.abd7331

6. Yang, K. K., Wu, Z., & Arnold, F. H. (2019). Machine-learning-guided directed evolution for protein engineering. Nature Methods, 16(8), 687-694. https://doi.org/10.1038/s41592-019-0496-6

7. Wu, H., Song, Y., Zhang, Z., Zhang, Z., Zhou, H., Ma, W. Y., & Liu, J. (2026). Rationalized All-Atom Protein Design with Unified Multi-Modal Bayesian Flow. Advances in Neural Information Processing Systems, 38, 3019-3050.

8. Romero, P. A., Krause, A., & Arnold, F. H. (2013). Navigating the protein fitness landscape with Gaussian processes. Proceedings of the National Academy of Sciences, 110(3), E193-E201. https://doi.org/10.1073/pnas.1215251110

9. Snoek, J., Larochelle, H., & Adams, R. P. (2012). Practical Bayesian optimization of machine learning algorithms. Advances in Neural Information Processing Systems, 25, 2951-2959.

10. Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016). Taking the human out of the loop: A review of Bayesian optimization. Proceedings of the IEEE, 104(1), 148-175. https://doi.org/10.1109/JPROC.2015.2494218

11. Gal, Y., & Ghahramani, Z. (2016). Dropout as a Bayesian approximation: Representing model uncertainty in deep learning. Proceedings of the 33rd International Conference on Machine Learning, 48, 1050-1059.

12. Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2017). Simple and scalable predictive uncertainty estimation using deep ensembles. Advances in Neural Information Processing Systems, 30, 6402-6413.

13. Settles, B. (2009). Active learning literature survey. Computer Sciences Technical Report 1648. University of Wisconsin-Madison.

14. Angluin, D. (1988). Queries and concept learning. Machine Learning, 2(4), 319-342. https://doi.org/10.1023/A:1022821128753

15. Cohn, D. A., Ghahramani, Z., & Jordan, M. I. (1996). Active learning with statistical models. Journal of Artificial Intelligence Research, 4, 129-145. https://doi.org/10.1613/jair.295

16. Kingma, D. P., & Ba, J. (2015). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations.

17. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998-6008.

18. King, R. D., Whelan, K. E., Jones, F. M., Reiser, P. G. K., Bryant, C. H., Muggleton, S. H., Kell, D. B., & Oliver, S. G. (2004). Functional genomic hypothesis generation and experimentation by a robot scientist. Nature, 427(6971), 247-252. https://doi.org/10.1038/nature02236

19. Carbonell, P., Radivojevic, T., & García Martín, H. (2019). Opportunities at the intersection of synthetic biology, machine learning, and automation. ACS Synthetic Biology, 8(7), 1474-1477. https://doi.org/10.1021/acssynbio.8b00540

20. Topol, E. J. (2019). High-performance medicine: The convergence of human and artificial intelligence. Nature Medicine, 25(1), 44-56. https://doi.org/10.1038/s41591-018-0300-7

21. Floridi, L., & Cowls, J. (2019). A unified framework of five principles for AI in society. Harvard Data Science Review, 1(1). https://doi.org/10.1162/99608f92.8cd550d1

22. Rajkomar, A., Dean, J., & Kohane, I. (2019). Machine learning in medicine. New England Journal of Medicine, 380(14), 1347-1358. https://doi.org/10.1056/NEJMra1814259

23. Beam, A. L., & Kohane, I. S. (2018). Big data and machine learning in health care. JAMA, 319(13), 1317-1318. https://doi.org/10.1001/jama.2017.18391

Downloads

Published

2026-09-25