Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/wiley/proximodistal-exploration-in-motor-learning-as-an-emergent-property-of-RVRHOHZpyN
References (60)
-
Esther Thelen, D. Corbetta, K. Kamm, John Spencer, Klaus Schneider, Ronald Zernicke (1993)
The transition to reaching: mapping intention and intrinsic dynamics.Child development, 64 4
-
M. Carpenter (1968)
The Co-ordination and Regulation of MovementsJournal of Neuropathology and Experimental Neurology, 27
-
M. Bornstein, M. Lamb (2015)
Developmental science : an advanced textbook -
L. Berthouze, M. Lungarella (2004)
Motor Skill Acquisition Under Environmental Perturbations: On the Necessity of Alternate Freezing and Freeing of Degrees of FreedomAdaptive Behavior, 12
-
H. Kuypers (2011)
Anatomy of the Descending PathwaysComprehensive Physiology
-
J. Elman (1993)
Learning and development in neural networks: the importance of starting smallCognition, 48
-
C. Rovee-Collier (1999)
The Development of Infant MemoryCurrent Directions in Psychological Science, 8
-
J. Jansen, T. Fladby (1990)
The perinatal reorganization of the innervation of skeletal muscle in mammalsProgress in Neurobiology, 34
-
S. Apostolopoulos, M. Leibold, M. Buss (2015)
2015 IEEE International Conference on Intelligent Robots and Systems (IROS) -
Hiroaki Sakoe (1978)
Dynamic programming algorithm optimization for spoken word recognitionIEEE Transactions on Acoustics, Speech, and Signal Processing, 26
-
Artur Matos, Reiji Suzuki, Takaya Arita (2007)
Heterochrony and evolvability in neural network developmentArtificial Life and Robotics, 11
-
L. Deng (2006)
The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine LearningTechnometrics, 48
-
W. Calvin (1987)
The brain as a Darwin MachineNature, 330
-
N. Berthier, M. Rosenstein, A. Barto (2005)
Approximate optimal control as a model for motor learning.Psychological review, 112 2
-
S. Chernova, A. Thomaz (2014)
Robot Learning from Human Teachers -
Mark Lee, Q. Meng, Fei Chao (2007)
Developmental learning for autonomous robotsRobotics Auton. Syst., 55
-
R. Cohen, D. Rosenbaum (2004)
Where grasps are made reveals how grasps are planned: generation and recall of motor plansExperimental Brain Research, 157
-
Terminal cost || x t N − x g || 2 . The distance between the 2-D Cartesian coordinates of the end-effector ( x t N ) at the end of the movement at t N , and the goal x g -
(2008)
Optimization strategies in human reinforcement learning. Advances in computational motor control VII. Washington, DC: Society for Neuroscience -
J. Bongard (2011)
Morphological change in machines accelerates the evolution of robust behaviorProceedings of the National Academy of Sciences, 108
-
G. Westermann, D. Mareschal, Mark Johnson, Sylvain Sirois, M. Spratling, Michael Thomas (2020)
Neuroconstructivism.Developmental science, 10 1
-
Adrien Baranes, Pierre-Yves Oudeyer (2011)
The interaction of maturational constraints and intrinsic motivations in active motor development2011 IEEE International Conference on Development and Learning (ICDL), 2
-
(2004)
Terminal cost max -
R. French, M. Mermillod, A. Chauvin, P. Quinn, D. Mareschal (2019)
The Importance of Starting Blurry: Simulating Improved Basic-Level Category Learning in Infants Due to Weak Visual AcuityProceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society
-
E. Todorov (2004)
Optimality principles in sensorimotor controlNature Neuroscience, 7
-
A. Cangelosi (1999)
Heterochrony and Adaptation in Developing Neural Networks -
N. Hansen, A. Ostermeier (2001)
Completely Derandomized Self-Adaptation in Evolution StrategiesEvolutionary Computation, 9
-
B. Vereijken, R. Emmerik, H. Whiting, K. Newell (1992)
Free(z)ing Degrees of Freedom in Skill AcquisitionJournal of Motor Behavior, 24
-
Dr. Malakar (2021)
MechanismsEncyclopedia of Evolutionary Psychological Science
-
F. Stulp, Olivier Sigaud (2013)
Robot Skill Learning: From Reinforcement Learning to Evolution Strategies, 4
-
Chrisantha Fernando, Vera Vasas, E. Szathmáry, P. Husbands (2011)
Evolvable Neuronal Paths: A Novel Basis for Information and Search in the BrainPLoS ONE, 6
-
R. Grupen (2005)
A Developmental Organization for Robot Behavior -
Brice Miard, Pierre Rouanet, Jonathan Grizou, M. Lopes, J. Gottlieb, Adrien Baranes, Pierre-Yves Oudeyer (2014)
A new experimental setup to study the structure of curiosity-driven exploration in humans4th International Conference on Development and Learning and on Epigenetic Robotics
-
S. Vijayakumar, Aaron D'Souza, S. Schaal (2005)
Incremental Online Learning in High DimensionsNeural Computation, 17
-
Joseph Delaney (2018)
Sensitivity analysisThe African Continental Free Trade Area: Economic and Distributional Effects
-
F. Stulp, Laura Herlant, Antoine Hoarau, G. Raiola (2014)
Simultaneous on-line Discovery and Improvement of Robotic Skill options2014 IEEE/RSJ International Conference on Intelligent Robots and Systems
-
N. Berthier, R. Clifton, D. Mccall, D. Robin (1999)
Proximodistal structure of early reaching in human infantsExperimental Brain Research, 127
-
E. Uchibe, M. Asada, K. Hosoda (1998)
Environmental complexity control for vision-based learning mobile robotProceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146), 3
-
Pierre-Yves Oudeyer, Linda Smith (2016)
How Evolution May Work Through Curiosity-Driven Developmental ProcessTopics in cognitive science, 8 2
-
D. Southard, T. Higgins (1987)
Changing Movement Patterns: Effects of Demonstration and PracticeResearch Quarterly for Exercise and Sport, 58
-
F. Stulp, Pierre-Yves Oudeyer (2012)
Adaptive exploration through covariance matrix adaptation enables developmental motor learningPaladyn, 3
-
Y. Ollivier, Ludovic Arnold, A. Auger, N. Hansen (2011)
Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance PrinciplesJ. Mach. Learn. Res., 18
-
Clément Moulin-Frier, S. Nguyen, Pierre-Yves Oudeyer (2014)
Self-organization of early vocal development in infants and machines: the role of intrinsic motivationFrontiers in Psychology, 4
-
F. Stulp, Pierre-Yves Oudeyer (2012)
Emergent proximo-distal maturation through adaptive exploration2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL)
-
G. Edelman (1989)
Neural Darwinism: The Theory Of Neuronal Group Selection -
J. Changeux, P. Courrege, A. Danchin (1973)
A theory of the epigenesis of neuronal networks by selective stabilization of synapses.Proceedings of the National Academy of Sciences of the United States of America, 70 10
-
F. Stulp (2012)
Adaptive exploration for continual reinforcement learning2012 IEEE/RSJ International Conference on Intelligent Robots and Systems
-
B. Bertenthal, C. Hofsten (1998)
Eye, Head and Trunk Control: The Foundation for Manual Development 1 The responsibility was shared equally between the authors. 1Neuroscience & Biobehavioral Reviews, 22
-
K. Adolph, Sarah Berger (2005)
Physical and Motor Development. -
Chrisantha Fernando, R. Goldstein, E. Szathmáry (2010)
The Neuronal Replicator HypothesisNeural Computation, 22
-
Evangelos Theodorou, J. Buchli, S. Schaal (2010)
A Generalized Path Integral Control Approach to Reinforcement LearningJ. Mach. Learn. Res., 11
-
Y. Nagai, M. Asada, K. Hosoda (2006)
Learning for joint attention helped by functional developmentAdvanced Robotics, 20
-
J. Kober, Jan Peters (2008)
Policy search for motor primitives in roboticsMachine Learning, 84
-
M. Schlesinger, D. Parisi, J. Langer (2000)
Learning to Reach by Constraining the Movement Search SpaceDevelopmental Science, 3
-
Adrien Baranes, Pierre-Yves Oudeyer (2013)
Active learning of inverse models with intrinsically motivated goal exploration in robotsRobotics Auton. Syst., 61
-
Chrisantha Fernando, E. Szathmáry, P. Husbands (2012)
Selectionist and Evolutionary Approaches to Brain Function: A Critical AppraisalFrontiers in Computational Neuroscience, 6
-
Nicola Hodges, S. Hayes, Robert Horn, A. Williams (2005)
Changes in coordination, control and outcome as a result of extended practice on a novel motor skillErgonomics, 48
-
Pierre-Yves Oudeyer, Adrien Baranes, F. Kaplan (2013)
Intrinsically Motivated Learning of Real-World Sensorimotor Skills with Developmental Constraints -
F. Stulp, Olivier Sigaud (2012)
Policy Improvement Methods: Between Black-Box Optimization and Episodic Reinforcement Learning -
V. Heidrich-Meisner (2008)
Uncertainty Handling in Evolutionary Direct Policy Search
- Publisher
- Wiley
- Copyright
- Copyright © 2018 John Wiley & Sons Ltd
- ISSN
- 1363-755X
- eISSN
- 1467-7687
- DOI
- 10.1111/desc.12638
- Publisher site
- See Article on Publisher Site
Abstract
To harness the complexity of their high‐dimensional bodies during sensorimotor development, infants are guided by patterns of freezing and freeing of degrees of freedom. For instance, when learning to reach, infants free the degrees of freedom in their arm proximodistally, that is, from joints that are closer to the body to those that are more distant. Here, we formulate and study computationally the hypothesis that such patterns can emerge spontaneously as the result of a family of stochastic optimization processes, without an innate encoding of a maturational schedule. In particular, we present simulated experiments with an arm where a computational learner progressively acquires reaching skills through adaptive exploration, and we show that a proximodistal organization appears spontaneously, which we denote PDFF (Proximo Distal Freezing and Freeing of degrees of freedom). We also compare this emergent organization between different arm morphologies—from human‐like to quite unnatural ones—to study the effect of different kinematic structures on the emergence of PDFF.
Journal
Developmental Science – Wiley
Published: Jan 1, 2018