國立虎尾科技大學 |

A biologically motivated synthesis of accumulator and reinforcement-learning models for describing adaptive decision-making.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	A biologically motivated synthesis of accumulator and reinforcement-learning models for describing adaptive decision-making./
Author:	Dunovan, Kyle.
Description:	1 online resource (106 pages)
Notes:	Source: Dissertation Abstracts International, Volume: 78-08(E), Section: B.
Subject:	Cognitive psychology. -
Online resource:	click for full text (PQDT)
ISBN:	9781369657470

A biologically motivated synthesis of accumulator and reinforcement-learning models for describing adaptive decision-making.
Dunovan, Kyle.

A biologically motivated synthesis of accumulator and reinforcement-learning models for describing adaptive decision-making. - 1 online resource (106 pages)

Source: Dissertation Abstracts International, Volume: 78-08(E), Section: B.

Thesis (Ph.D.)--University of Pittsburgh, 2016.

Includes bibliographical references

Cognitive process models, such as reinforcement learning (RL) and accumulator models of decision-making, have proven to be highly insightful tools for studying adaptive behaviors as well as their underlying neural substrates. Currently, however, two major barriers exist preventing these models from being applied in more complex settings: 1) the assumptions of most accumulator models break down for decisions involving more than two alternatives; 2) RL and accumulator models currently exist as separate frameworks, with no clear mapping between trial-to-trial learning and the dynamics of the decision process. Recently I showed how a modified accumulator model, premised off of the architecture of cortico-basal ganglia pathways, both predicts human decisions under uncertainty and evoked activity in cortical and subcortical control circuits. Here I present a synthesis of RL and accumulator models that is motivated by recent evidence that the basal ganglia acts as a site for integrating trial-wise feedback from midbrain dopaminergic neurons with accumulating evidence from sensory and associative cortices. I show how this hybrid model can explain both adaptive go/no-go decisions and multi-alternative decisions in a computationally efficient manner. More importantly, by parameterizing the model to conform to various underlying assumptions about the architecture and physiology of basal ganglia pathways, model predictions can be rigorously tested against observed patterns in behavior as well as neural recordings. The result is a biologically-constrained and behaviorally tractable description of trial-to-trial learning effects on decision-making among multiple alternatives.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2018

Mode of access: World Wide Web

ISBN: 9781369657470Subjects--Topical Terms:

556029
Cognitive psychology.
Index Terms--Genre/Form:

554714
Electronic books.

A biologically motivated synthesis of accumulator and reinforcement-learning models for describing adaptive decision-making.
LDR:02837ntm a2200301K 4500 001 913686
005 20180622095235.5
006 m o u
007 cr mn||||a|a||
008 190606s2016 xx obm 000 0 eng d
020 $a 9781369657470
035 $a (MiAaPQ)AAI10586374
035 $a AAI10586374
040 $a MiAaPQ $b eng $c MiAaPQ
100 1 $a Dunovan, Kyle. $3 1186622
245 1 2 $a A biologically motivated synthesis of accumulator and reinforcement-learning models for describing adaptive decision-making.
264 0 $c 2016
300 $a 1 online resource (106 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertation Abstracts International, Volume: 78-08(E), Section: B.
500 $a Adviser: Julie Fiez.
502 $a Thesis (Ph.D.)--University of Pittsburgh, 2016.
504 $a Includes bibliographical references
520 $a Cognitive process models, such as reinforcement learning (RL) and accumulator models of decision-making, have proven to be highly insightful tools for studying adaptive behaviors as well as their underlying neural substrates. Currently, however, two major barriers exist preventing these models from being applied in more complex settings: 1) the assumptions of most accumulator models break down for decisions involving more than two alternatives; 2) RL and accumulator models currently exist as separate frameworks, with no clear mapping between trial-to-trial learning and the dynamics of the decision process. Recently I showed how a modified accumulator model, premised off of the architecture of cortico-basal ganglia pathways, both predicts human decisions under uncertainty and evoked activity in cortical and subcortical control circuits. Here I present a synthesis of RL and accumulator models that is motivated by recent evidence that the basal ganglia acts as a site for integrating trial-wise feedback from midbrain dopaminergic neurons with accumulating evidence from sensory and associative cortices. I show how this hybrid model can explain both adaptive go/no-go decisions and multi-alternative decisions in a computationally efficient manner. More importantly, by parameterizing the model to conform to various underlying assumptions about the architecture and physiology of basal ganglia pathways, model predictions can be rigorously tested against observed patterns in behavior as well as neural recordings. The result is a biologically-constrained and behaviorally tractable description of trial-to-trial learning effects on decision-making among multiple alternatives.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2018
538 $a Mode of access: World Wide Web
650 4 $a Cognitive psychology. $3 556029
655 7 $a Electronic books. $2 local $3 554714
690 $a 0633
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of Pittsburgh. $3 1178873
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=10586374 $z click for full text (PQDT)