Access the full text.
Sign up today, get DeepDyve free for 14 days.
Shitian Shen, Min Chi (2016)
Reinforcement Learning: the Sooner the Better, or the Later the Better?Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization
I. Hochberg, G. Feraru, Mark Kozdoba, Shie Mannor, Moshe Tennenholtz, E. Yom-Tov (2016)
Encouraging Physical Activity in Patients With Diabetes: Intervention Using a Reinforcement Learning SystemJournal of Medical Internet Research, 19
T. D’amato, Rémy Bation, A. Cochet, I. Jalenques, F. Galland, E. Giraud-Baro, Michele Pacaud-Troncin, F. Augier-Astolfi, P. Llorca, M. Saoud, J. Brunelin (2011)
A randomized, controlled trial of computer-assisted cognitive remediation for schizophreniaSchizophrenia Research, 125
Cognitive Training Program: CogniPlus-SCHUHFRIED
O. Tucha, Lara Tucha, Gesa Kaumann, S. König, K. Lange, Dorota Stasik, Zoe Streather, Tobias Engelschalk, K. Lange (2011)
Training of attention functions in children with attention deficit hyperactivity disorderAttention Deficit and Hyperactivity Disorders, 3
Matthew Taylor, P. Stone (2009)
Transfer Learning for Reinforcement Learning Domains: A SurveyJ. Mach. Learn. Res., 10
[ (2005)
PASAT: Paced Auditory Serial Addition TaskTechnical Report. Department of General Psychology
Chih-Ming Chen, Yi-Lun Li (2010)
Personalised context-aware ubiquitous learning system for supporting effective English vocabulary learningInteractive Learning Environments, 18
C. Bowie, Michael Grossman, M. Gupta, K. Holshausen, Michael Best (2017)
Action-Based Cognitive Remediation for Individuals With Serious Mental Illnesses: Effects of Real-World Simulations and Goal Setting on Functional and Vocational OutcomesPsychiatric Rehabilitation Journal, 40
C. Hasson, Julia Manczurowsky, S. Yen (2015)
A reinforcement learning approach to gait training improves retentionFrontiers in Human Neuroscience, 9
F. Amonn, J. Frölich, D. Breuer, T. Banaschewski, M. Doepfner (2013)
Evaluation of a computer-based neuropsychological training in children with attention-deficit hyperactivity disorder (ADHD).NeuroRehabilitation, 32 3
Elham Mousavinasab, Nahid Zarifsanaiey, S. Kalhori, M. Rakhshan, L. Keikha, M. Saeedi (2018)
Intelligent tutoring systems: a systematic review of characteristics, applications, and evaluation methodsInteractive Learning Environments, 29
F. Moen, Maria Hrozanova, T. Stiles (2018)
The effects of perceptual-cognitive training with Neurotracker on executive brain functions among elite athletesCogent Psychology, 5
K. Chrysafiadi, M. Virvou (2012)
Evaluating the integration of fuzzy logic into the student model of a web-based learning environmentExpert Syst. Appl., 39
[ (1990)
Intelligent tutoring systems: An overviewArtificial Intelligence Review, 4
[ (2021)
EricaRetrieved November 17, 2021 from http://www.erica.giuntios.it., 17
T. Tombaugh (2006)
A comprehensive review of the Paced Auditory Serial Addition Test (PASAT).Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists, 21 1
Philip Harvey (2019)
Domains of cognition and their assessmentDialogues in Clinical Neuroscience, 21
Matthew Rudary, Satinder Singh, M. Pollack (2004)
Adaptive cognitive orthotics: combining reinforcement learning and constraint-based temporal reasoningProceedings of the twenty-first international conference on Machine learning
R. Petersen, J. Morris (2005)
Mild cognitive impairment as a clinical entity and treatment target.Archives of neurology, 62 7
M. Semkovska, E. Ahern, D. Lonargáin, S. Lambe, D. McLaughlin (2015)
Efficacy of Neurocognitive Remediation Therapy During an Acute Depressive Episode and Following Remission: Results From Two Randomised Pilot StudiesEuropean Psychiatry, 30
[ (2010)
Intelligent systemsInternational Encyclopedia of Education (3rd ed.)
RehaCom-Computer-Based Cognitive Therapy
S. Cardullo (2017)
New frontiers in neuropsychology. The Padua Rehabilitation Tool: a new software for rehabilitation using touch-screen technology
B. López-Luengo, J. Muela-Martínez (2016)
Preliminary study of a rehabilitation program based on attentional processes to treat auditory hallucinationsCognitive Neuropsychiatry, 21
Meng Fan-cheng, Dai Ya-ping (2012)
Reinforcement learning adaptive control for upper limb rehabilitation robot based on fuzzy neural networkProceedings of the 31st Chinese Control Conference
M. Gaspari, F. Zini, S. Stecchi (2020)
Enhancing cognitive rehabilitation in multiple sclerosis with a disease-specific toolDisability and Rehabilitation: Assistive Technology, 18
W. Sturm (2015)
Cognitive training in Parkinson disease: Cognition-specific vs nonspecific computer trainingNeurology, 84
R. Bauer, A. Gharabaghi (2015)
Reinforcement learning for adaptive threshold control of restorative brain-computer interfaces: a Bayesian simulationFrontiers in Neuroscience, 9
[ (2021)
NeuroTracker | #1 Cognitive Training System in the WorldRetrieved November 17, 2021 from https://neurotracker.net., 17
K. Christensen, S. Kreiner, M. Mesbah (2013)
Rasch Models in Health
A. Coronato, Muddasar Naeem, G. Pietro, Giovanni Paragliola (2020)
Reinforcement learning for intelligent healthcare applications: A surveyArtificial intelligence in medicine, 109
[ (2020)
Reinforcement learning in healthcare: A surveyarxiv:1908.08796[cs.LG].
[ (2017)
New Frontiers in NeuropsychologyThe Padua Rehabilitation Tool: A New Software for Rehabilitation Using Touch-Screen Technology. Ph.D. Dissertation. University of Padua.
Guojing Zhou, Hamoon Azizsoltani, Markel Ausin, T. Barnes, Min Chi (2019)
Hierarchical Reinforcement Learning for Pedagogical Policy Induction
M. Mohammadi, Z. Keshavarzi, Msc, S. Talepasand
Birth Order and Sibling Gender Ratio of a Clinical Sample the Effectiveness of Computerized Cognitive Rehabilitation Training Program in Improving Cognitive Abilities of Schizophrenia Clients Original Article
SampaioAlberto (2013)
Quantifying the user experienceACM Sigsoft Software Engineering Notes
[ (2021)
Brainer | Riabilitazione CognitivaRetrieved November 17, 2021 from http://www.brainer.it., 17
M. Cavallo, Federica Trivelli, M. Adenzato, E. Bidoia, Rm Giaretto, F. Oliva, L. Ostacoli, A. Sala, R. Picci (2013)
DO NEUROPSYCHOLOGICAL AND SOCIAL COGNITION ABILITIES IN SCHIZOPHRENIA CHANGE AFTER INTENSIVE COGNITIVE TRAINING? A PILOT STUDY, 10
S. Ávila-Sansores, F. Orihuela-Espina, Luis Enrique-Sucar (2013)
Patient Tailored Virtual Rehabilitation
R. Zimmermann, U. Gschwandtner, N. Benz, F. Hatz, C. Schindler, E. Taub, P. Fuhr (2014)
Cognitive training in Parkinson diseaseNeurology, 82
Annushree Bablani, D. Edla, Diwakar Tripathi, Ramalingaswamy Cheruku (2019)
Survey on Brain-Computer InterfaceACM Computing Surveys (CSUR), 52
L. Sterling (1993)
Intelligent SystemsLecture Notes in Networks and Systems
T. Mulder, J. Hochstenbach (2001)
Adaptability and Flexibility of the Human Motor System: Implications for Neurological RehabilitationNeural Plasticity, 8
Cognitive Therapy Tools, Cognitive Rehabilitation
[ (2014)
The effectiveness of computerized cognitive rehabilitation training program in improving cognitive abilities of schizophrenia clientsIran Journal of Psychiatry, 9
L. Pedullà, G. Brichetto, A. Tacchino, C. Vassallo, P. Zaratin, M. Battaglia, L. Bonzano, M. Bove (2016)
Adaptive vs. non-adaptive cognitive training by means of a personalized App: a randomized trial in people with multiple sclerosisJournal of NeuroEngineering and Rehabilitation, 13
J. Motter, J. Motter, Monique Pimontel, Monique Pimontel, D. Rindskopf, D. Devanand, P. Doraiswamy, J. Sneed, J. Sneed (2016)
Computerized cognitive training and functional recovery in major depressive disorder: A meta-analysis.Journal of affective disorders, 189
D. Reinkensmeyer, E. Guigon, M. Maier (2012)
A computational model of use-dependent motor recovery following a stroke: Optimizing corticospinal activations via reinforcement learning can explain residual capacity and other strength recovery dynamicsNeural networks : the official journal of the International Neural Network Society, 29-30
S. Cardullo, Pes Valeria, Tognon Ilaria, Pesenti Ambra, L. Gamberini, D. Mapelli (2015)
Padua Rehabilitation Tool: A Pilot Study on Patients with Dementia
E. Yhnell, H. Furby, R. Breen, L. Brookes-Howell, C. Drew, R. Playle, G. Watson, C. Metzler-Baddeley, A. Rosser, M. Busse (2018)
Exploring computerised cognitive training as a therapeutic intervention for people with Huntington’s disease (CogTrainHD): protocol for a randomised feasibility studyPilot and Feasibility Studies, 4
Mariana Assed, Martha Carvalho, C. Rocca, A. Serafim (2016)
Memory training and benefits for quality of life in the elderly: A case reportDementia & Neuropsychologia, 10
G. Naros, A. Gharabaghi (2015)
Reinforcement learning of self-regulated β-oscillations for motor restoration in chronic strokeFrontiers in Human Neuroscience, 9
G. Fenza, F. Orciuoli, D. Sampson (2017)
Building Adaptive Tutoring Model Using Artificial Neural Networks and Reinforcement Learning2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT)
T. Alloway, Vanessa Bibile, G. Lau (2013)
Computerized working memory training: Can it lead to gains in cognitive skills in students?Comput. Hum. Behav., 29
B. Grawemeyer, M. Mavrikis, Wayne Holmes, S. Santos, Michael Wiedmann, N. Rummel (2016)
Affecting off-task behaviour: how affect-aware feedback can improve student learningProceedings of the Sixth International Conference on Learning Analytics & Knowledge
[ (1998)
Reinforcement Learning: An IntroductionMIT Press
Chao Yu, Jiming Liu, S. Nemati (2019)
Reinforcement Learning in Healthcare: A SurveyACM Computing Surveys (CSUR), 55
Tyne Crow, Andrew Luxton-Reilly, B. Wünsche (2018)
Intelligent tutoring systems for programming education: a systematic reviewProceedings of the 20th Australasian Computing Education Conference
M. Hagovska, I. Nagyova (2017)
The transfer of skills from cognitive and physical training to activities of daily living: a randomised controlled studyEuropean Journal of Ageing, 14
E. Bruin, Eva Reve, K. Murer (2013)
A randomized controlled pilot study assessing the feasibility of combined motor–cognitive training and its effect on gait characteristics in the elderlyClinical Rehabilitation, 27
C. Peretz, A. Korczyn, Evelyn Shatil, V. Aharonson, Smadar Birnboim, Nir Giladi (2011)
Computer-Based, Personalized Cognitive Training versus Classical Computer Games: A Randomized Double-Blind Prospective Trial of Cognitive StimulationNeuroepidemiology, 36
M. Yazdani (1986)
Intelligent tutoring systems: An overviewExpert Systems, 3
T. Vlagsma, A. Duits, H. Dijkstra, T. Laar, J. Spikman (2020)
Effectiveness of ReSET; a strategic executive treatment for executive dysfunctioning in patients with Parkinson’s diseaseNeuropsychological Rehabilitation, 30
Jeff Sauro, James Lewis (2012)
Quantifying the User Experience: Practical Statistics for User Research
D. Gronwall (1977)
Paced Auditory Serial-Addition Task: A Measure of Recovery from ConcussionPerceptual and Motor Skills, 44
[ (2019)
Survey on brain-computer interface: An emerging computational intelligence paradigmACM Computing Surveys, 52
Mo Zhou, Yonatan Mintz, Yoshimi Fukuoka, Ken Goldberg, E. Flowers, Philip Kaminsky, Alejandro Castillejo, A. Aswani (2018)
Personalizing Mobile Fitness Apps using Reinforcement LearningCEUR workshop proceedings, 2068
B. Treutwein (1995)
Adaptive psychophysical proceduresVision Research, 35
Computer-assisted cognitive training can help patients affected by several illnesses alleviate their cognitive deficits or healthy people improve their mental performance. In most computer-based systems, training sessions consist of graded exercises, which should ideally be able to gradually improve the trainee’s cognitive functions. Indeed, adapting the difficulty of the exercises to how individuals perform in their execution is crucial to improve the effectiveness of cognitive training activities. In this article, we propose the use of reinforcement learning (RL) to learn how to automatically adapt the difficulty of computerized exercises for cognitive training. In our approach, trainees’ performance in performed exercises is used as a reward to learn a policy that changes over time the values of the parameters that determine exercise difficulty. We illustrate a method to be initially used to learn difficulty-variation policies tailored for specific categories of trainees, and then to refine these policies for single individuals. We present the results of two user studies that provide evidence for the effectiveness of our method: a first study, in which a student category policy obtained via RL was found to have better effects on the cognitive function than a standard baseline training that adopts a mechanism to vary the difficulty proposed by neuropsychologists, and a second study, demonstrating that adding an RL-based individual customization further improves the training process.
ACM Transactions on Interactive Intelligent Systems (TiiS) – Association for Computing Machinery
Published: Mar 4, 2022
Keywords: Computerized cognitive training
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.