Taisei Sugiyama

<jats:p>Meta-learning enables us to learn how to learn the same or similar tasks more efficiently. Decision-making literature theorizes that a prefrontal network, including the orbitofrontal and anterior cingulate cortices, underlies meta-learning of decision making by reinforcement learning. Recently, computationally similar meta-learning has been theorized and empirically demonstrated in motor adaptation. However, it remains unclear whether meta-learning of motor adaptation also relies on a prefrontal network. Considering hierarchical information flow from the prefrontal to motor cortices, this study explores whether meta-learning is processed in the dorsolateral prefrontal cortex (DLPFC) or in the dorsal premotor cortex (PMd), which is situated upstream of the primary motor cortex, but downstream of the DLPFC. Transcranial magnetic stimulation (TMS) was delivered to either PMd or DLPFC during a motor meta-learning task, in which human participants were trained to regulate the rate and retention of motor adaptation to maximize rewards. While motor adaptation itself was intact, TMS to PMd, but not DLPFC, attenuated meta-learning, impairing the ability to regulate motor adaptation to maximize rewards. Further analyses revealed that TMS to PMd attenuated meta-learning of memory retention. These results suggest that meta-learning of motor adaptation relies more on the premotor area than on a prefrontal network. Thus, while PMd is traditionally viewed as crucial for planning motor actions, this study suggests that PMd is also crucial for meta-learning of motor adaptation, processing goal-directed planning of how long motor memory should be retained to fit the long-term goal of motor adaptation.</jats:p>

<jats:title>Abstract</jats:title><jats:p>Humans and animals develop learning-to-learn strategies throughout their lives to accelerate learning. One theory suggests that this is achieved by a metacognitive process of controlling and monitoring learning. Although such learning-to-learn is also observed in motor learning, the metacognitive aspect of learning regulation has not been considered in classical theories of motor learning. Here, we formulated a minimal mechanism of this process as reinforcement learning of motor learning properties, which regulates a policy for memory update in response to sensory prediction error while monitoring its performance. This theory was confirmed in human motor learning experiments, in which the subjective sense of learning-outcome association determined the direction of up- and down-regulation of both learning speed and memory retention. Thus, it provides a simple, unifying account for variations in learning speeds, where the reinforcement learning mechanism monitors and controls the motor learning process.</jats:p>