| Title: |
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control |
| Authors: |
Daw, ND; Niv, Y; Dayan, P |
| Source: |
NAT NEUROSCI , 8 (12) 1704 - 1711. (2005) |
| Publisher Information: |
NATURE PUBLISHING GROUP |
| Publication Year: |
2005 |
| Subject Terms: |
LINKING BASAL GANGLIA; REINFORCER DEVALUATION; COMPUTATIONAL MODEL; CEREBRAL-CORTEX; HABIT FORMATION; LESIONS; REWARD; DOPAMINE; MEMORY; SENSITIVITY; psy; geo |
| Description: |
A broad range of neural and behavioral data suggests that the brain contains multiple systems for behavioral choice, including one associated with prefrontal cortex and another with dorsolateral striatum. However, such a surfeit of control raises an additional choice problem: how to arbitrate between the systems when they disagree. Here, we consider dual-action choice systems from a normative perspective, using the computational theory of reinforcement learning. We identify a key trade-off pitting computational simplicity against the flexible and statistically efficient use of experience. The trade-off is realized in a competition between the dorsolateral striatal and prefrontal systems. We suggest a Bayesian principle of arbitration between them according to uncertainty, so each controller is deployed when it should be most accurate. This provides a unifying account of a wealth of experimental evidence about the factors favoring dominance by either system. |
| Document Type: |
article in journal/newspaper |
| Language: |
unknown |
| Relation: |
http://discovery.ucl.ac.uk/7319/ |
| Availability: |
http://discovery.ucl.ac.uk/7319/ |
| Rights: |
undefined |
| Accession Number: |
edsbas.57734278 |
| Database: |
BASE |