- Camila J. Fernandez ORCID:orcid.org/0009-0006-0136-797313,
- Jeffrey M. McManus ORCID:orcid.org/0000-0003-2613-942516,
- Yanjun Li ORCID:orcid.org/0000-0002-2534-704917,
- Michael J. Bennington ORCID:orcid.org/0000-0001-7940-629713,
- Roger D. Quinn ORCID:orcid.org/0000-0002-8504-716017,
- Hillel J. Chiel ORCID:orcid.org/0000-0002-1750-850016,18,19 &
- …
- Victoria A. Webster-Wood ORCID:orcid.org/0000-0001-6638-268713,14,15
Part of the book series:Lecture Notes in Computer Science ((LNAI,volume 14930))
Included in the following conference series:
327Accesses
Abstract
To capture and understand animal behavior, engineers and biologists seek to develop biologically accurate neuromechanical models of muscle dynamics and neural control. However, demand-driven enhancement of complex neuromechanics, such as the multifunctionalAplysia californica feeding apparatus, can be challenging due to the multidimensional biomechanical and neural models involved. We propose an analysis pipeline that enables reinforcement learning (RL) to classify which aspects of an engineered neuromechanical model can accurately capture animal behavior. As an example, prioritizing where demand-driven enhancement of a biomechanical and neural model is needed, the neural model of a published neuromechanical model ofAplysia swallowing during feeding was replaced with an RL controller and their performances were compared and correlated within vivo swallowing behavior. By comparing the performance of the neural model and the learned model toin vivo animal behavior, we can pinpoint areas for improvement. The analysis pipeline identified that the neuromechanical model confidently captured force performance with no significant difference from animal swallowing force behavior. It most usefully also indicated that the biomechanical model will need to be improved in future iterations to better capture motor neuron activity. Future work should explore the accuracy of the RL-enabled analysis pipeline with a more advanced biomechanical model.
This work was supported by NSF DBI2015317 as part of the NSF/CIHR/DFG/FRQ/UKRI-MRC Next Generation Networks for Neuroscience Program, by the NSF Research Fellowship Program under Grant No. DGE1745016, and by internal funding through Carnegie Mellon University. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.
This is a preview of subscription content,log in via an institution to check access.
Access this chapter
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
- Chapter
- JPY 3498
- Price includes VAT (Japan)
- eBook
- JPY 8464
- Price includes VAT (Japan)
- Softcover Book
- JPY 10581
- Price includes VAT (Japan)
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Karakasiliotis, K., et al.: From cineradiography to biorobots: an approach for designing robots to emulate and study animal locomotion. J. R. Soc. Interface13(119), 20151089 (2016).https://doi.org/10.1098/rsif.2015.1089
Ijspeert, A.J.: Biorobotics: using robots to emulate and investigate agile locomotion. Science346(6206), 196–203 (2014).https://doi.org/10.1126/science.1254486
Ostrowski, J., Burdick, J.W.: The geometric mechanics of undulatory robotic locomotion. Int. J. Robot. Res.17(7), 683–701 (1998).https://doi.org/10.1177/027836499801700701
Aguilar, J., et al.: A review on locomotion robophysics: the study of movement at the intersection of robotics, soft matter and dynamical systems. Rep. Prog. Phys.79(11), 110001 (2016).https://doi.org/10.1088/0034-4885/79/11/110001
Sun, X., et al.: A neuromechanical model for Drosophila larval crawling based on physical measurements. BMC Biol.20(1), 130 (2022).https://doi.org/10.1186/s12915-022-01336-w
Markin, S.N., Klishko, A.N., Shevtsova, N.A., Lemay, M.A., Prilutsky, B.I., Rybak, I.A.: Afferent control of locomotor CPG: insights from a simple neuromechanical model. Ann. N. Y. Acad. Sci.1198(1), 21–34 (2010).https://doi.org/10.1111/j.1749-6632.2010.05435.x
Sreenivasa, M., Valero-Cuevas, F.J., Tresch, M., Nakamura, Y., Schouten, A.C., Sartori, M.: Editorial: neuromechanics and control of physical behavior: from experimental and computational formulations to bio-inspired technologies. Front. Comput. Neurosci.13, (2019).https://doi.org/10.3389/fncom.2019.00013
Higuchi, K., Kazawa, T., Sakai, B., Namiki, S., Haupt, S.S., Kanzaki, R.: High performance, large-scale multi-compartment Hodgkin-Huxley simulation of Drosophila’s whole-brain neural circuit model. bioRxiv (Cold Spring Harbor Laboratory) (2022).https://doi.org/10.1101/2022.11.01.512969
Gill, J.P., Chiel, H.J.: Rapid adaptation to changing mechanical load by ordered recruitment of identified motor neurons. eneuro, pp. ENEURO.0016-20.2020 (2020).https://doi.org/10.1523/eneuro.0016-20.2020
Lyttle, D., Gill, J., Shaw, K.M., Thomas, P., Chiel, H.J.: Robustness, flexibility, and sensitivity in a multifunctional motor control model, vol. 111, no. 1, pp. 25–47 (2016).https://doi.org/10.1007/s00422-016-0704-8
Shaw, K.M., et al.: The significance of dynamical architecture for adaptive responses to mechanical loads during rhythmic behavior. J. Comput. Neurosci.38(1), 25–51 (2014).https://doi.org/10.1007/s10827-014-0519-3
Novakovic, V.A., Sutton, G.P., Neustadter, D.M., Beer, R.D., Chiel, H.J.: Mechanical reconfiguration mediates swallowing and rejection inAplysia californica. J. Comp. Physiol. A Neuroethol. Sens. Neural Behav. Physiol.192(8), 857–870 (2006).https://doi.org/10.1007/s00359-006-0124-7
Webster-Wood, V.A., Gill, J.P., Thomas, P.J., Chiel, H.J.: Control for multifunctionality: bioinspired control based on feeding inAplysia californica. Biol. Cybern.114(6), 557–588 (2020).https://doi.org/10.1007/s00422-020-00851-9
Li, Y., Sukhnandan, R., Gill, J.P., Chiel, H.J., Webster-Wood, V., Quinn, R.D.: A bioinspired synthetic nervous system controller for pick-and-place manipulation. IEEE Int. Conf. Robot. Autom. (ICRA)2023, 8047–8053 (2023).https://doi.org/10.1109/icra48891.2023.10161198
Dai, K., et al.: SLUGBOT, anAplysia-inspired robotic grasper for studying control. In: Lecture Notes in Computer Science, pp. 182–194 (2022).https://doi.org/10.1007/978-3-031-20470-8_19
Sun, W., Xu, M., Gill, J., Thomas, P., Chiel, H.J., Webster-Wood, V.A.: GymSlug: Deep Reinforcement Learning Toward Bio-inspired Control Based onAplysia californica Feeding, pp. 236–248 (2022).https://doi.org/10.1007/978-3-031-20470-8_24
Hurwitz, I., Kupfermann, I., Susswein, A.J.: Different roles of neurons B63 and B34 that are active during the protraction phase of buccal motor programs inAplysia californica. J. Neurophysiol.78(3), 1305–1319 (1997).https://doi.org/10.1152/jn.1997.78.3.1305
“Cross-correlation - MATLAB xcorr.www.mathworks.com.https://www.mathworks.com/help/matlab/ref/xcorr.html
Kreiss, J.P., Paparoditis, E.: Bootstrap methods for dependent data: a review. J. Korean Stat. Soc.40(4), 357–378 (2011).https://doi.org/10.1016/j.jkss.2011.08.009
McManus, J.M., Lu, H., Cullins, M.J., Chiel, H.J.: Differential activation of an identified motor neuron and neuromodulation provideAplysia’s retractor muscle an additional function. J. Neurophysiol.112(4), 778–791 (2014).https://doi.org/10.1152/jn.00148.2014
Yamazaki, K., Vo-Ho, V.-K., Bulsara, D., Le, N.: Spiking neural networks and their applications: a review. Brain Sci.12(7), 863 (2022).https://doi.org/10.3390/brainsci12070863
Li, Y., Webster-Wood, V.A., Gill, J.P., Sutton, G.P., Chiel, H.J., Quinn, R.D.: A synthetic nervous system controls a biomechanical model ofAplysia feeding. In: Lecture Notes in Computer Science, pp. 354–365 (2022).https://doi.org/10.1007/978-3-031-20470-8_35
Acknowledgements
The authors thank Dr. Jeff Gill for sharing the animal data from his 2020 publication [9] for use in these comparisons. We thank the anonymous reviewers for their insightful edits and suggestions.
Author information
Authors and Affiliations
Department of Mechanical, Carnegie Mellon University, Pittsburgh, PA, 15232, USA
Camila J. Fernandez, Michael J. Bennington & Victoria A. Webster-Wood
Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, 15232, USA
Victoria A. Webster-Wood
McGowan Institute for Regenerative Medicine, Carnegie Mellon University, Pittsburgh, PA, 15232, USA
Victoria A. Webster-Wood
Department of Biology, Case Western Reserve University, 10900 Euclid Ave, Cleveland, OH, 44106, USA
Jeffrey M. McManus & Hillel J. Chiel
Mechanical Engineering, Case Western Reserve University, 10900 Euclid Ave, Cleveland, OH, 44106, USA
Yanjun Li & Roger D. Quinn
Neurosciences, Case Western Reserve University, 10900 Euclid Ave, Cleveland, OH, 44106, USA
Hillel J. Chiel
Biomedical Engineering, Case Western Reserve University, 10900 Euclid Ave, Cleveland, OH, 44106, USA
Hillel J. Chiel
- Camila J. Fernandez
Search author on:PubMed Google Scholar
- Jeffrey M. McManus
Search author on:PubMed Google Scholar
- Yanjun Li
Search author on:PubMed Google Scholar
- Michael J. Bennington
Search author on:PubMed Google Scholar
- Roger D. Quinn
Search author on:PubMed Google Scholar
- Hillel J. Chiel
Search author on:PubMed Google Scholar
- Victoria A. Webster-Wood
Search author on:PubMed Google Scholar
Corresponding author
Correspondence toCamila J. Fernandez.
Editor information
Editors and Affiliations
West Virginia University, Morgantown, WV, USA
Nicholas S. Szczecinski
Carnegie Mellon University, Pittsburgh, USA
Victoria Webster-Wood
Northwestern University, Evanston, IL, USA
Matthew Tresch
Case Western Reserve University, Cleveland, OH, USA
William R. P. Nourse
Radboud University, Nijmegen, Gelderland, The Netherlands
Anna Mura
Case Western Reserve University, Cleveland, OH, USA
Roger D. Quinn
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Fernandez, C.J.et al. (2025). Analysis Pipeline for High-Dimensional Neuromechanical Model Improvement. In: Szczecinski, N.S., Webster-Wood, V., Tresch, M., Nourse, W.R.P., Mura, A., Quinn, R.D. (eds) Biomimetic and Biohybrid Systems. Living Machines 2024. Lecture Notes in Computer Science(), vol 14930. Springer, Cham. https://doi.org/10.1007/978-3-031-72597-5_23
Download citation
Published:
Publisher Name:Springer, Cham
Print ISBN:978-3-031-72596-8
Online ISBN:978-3-031-72597-5
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative