3
|
Richards BA, Lillicrap TP, Beaudoin P, Bengio Y, Bogacz R, Christensen A, Clopath C, Costa RP, de Berker A, Ganguli S, Gillon CJ, Hafner D, Kepecs A, Kriegeskorte N, Latham P, Lindsay GW, Miller KD, Naud R, Pack CC, Poirazi P, Roelfsema P, Sacramento J, Saxe A, Scellier B, Schapiro AC, Senn W, Wayne G, Yamins D, Zenke F, Zylberberg J, Therien D, Kording KP. A deep learning framework for neuroscience. Nat Neurosci 2019; 22:1761-1770. [PMID: 31659335 PMCID: PMC7115933 DOI: 10.1038/s41593-019-0520-2] [Citation(s) in RCA: 348] [Impact Index Per Article: 69.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2019] [Accepted: 09/23/2019] [Indexed: 11/08/2022]
Abstract
Systems neuroscience seeks explanations for how the brain implements a wide variety of perceptual, cognitive and motor tasks. Conversely, artificial intelligence attempts to design computational systems based on the tasks they will have to solve. In artificial neural networks, the three components specified by design are the objective functions, the learning rules and the architectures. With the growing success of deep learning, which utilizes brain-inspired architectures, these three designed components have increasingly become central to how we model, engineer and optimize complex artificial learning systems. Here we argue that a greater focus on these components would also benefit systems neuroscience. We give examples of how this optimization-based framework can drive theoretical and experimental progress in neuroscience. We contend that this principled perspective on systems neuroscience will help to generate more rapid progress.
Collapse
Affiliation(s)
- Blake A Richards
- Mila, Montréal, Quebec, Canada.
- School of Computer Science, McGill University, Montréal, Quebec, Canada.
- Department of Neurology & Neurosurgery, McGill University, Montréal, Quebec, Canada.
- Canadian Institute for Advanced Research, Toronto, Ontario, Canada.
| | - Timothy P Lillicrap
- DeepMind, Inc., London, UK
- Centre for Computation, Mathematics and Physics in the Life Sciences and Experimental Biology, University College London, London, UK
| | | | - Yoshua Bengio
- Mila, Montréal, Quebec, Canada
- Canadian Institute for Advanced Research, Toronto, Ontario, Canada
- Université de Montréal, Montréal, Quebec, Canada
| | - Rafal Bogacz
- MRC Brain Network Dynamics Unit, University of Oxford, Oxford, UK
| | - Amelia Christensen
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Claudia Clopath
- Department of Bioengineering, Imperial College London, London, UK
| | - Rui Ponte Costa
- Computational Neuroscience Unit, School of Computer Science, Electrical and Electronic Engineering, and Engineering Maths, University of Bristol, Bristol, UK
- Department of Physiology, Universität Bern, Bern, Switzerland
| | | | - Surya Ganguli
- Department of Applied Physics, Stanford University, Stanford, CA, USA
- Google Brain, Mountain View, CA, USA
| | - Colleen J Gillon
- Department of Biological Sciences, University of Toronto Scarborough, Toronto, Ontario, Canada
- Department of Cell & Systems Biology, University of Toronto, Toronto, Ontario, Canada
| | - Danijar Hafner
- Google Brain, Mountain View, CA, USA
- Department of Computer Science, University of Toronto, Toronto, Ontario, Canada
- Vector Institute, Toronto, Ontario, Canada
| | - Adam Kepecs
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| | - Nikolaus Kriegeskorte
- Department of Psychology and Neuroscience, Columbia University, New York, NY, USA
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York, USA
| | - Peter Latham
- Gatsby Computational Neuroscience Unit, University College London, London, UK
| | - Grace W Lindsay
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York, USA
- Center for Theoretical Neuroscience, Columbia University, New York, NY, USA
| | - Kenneth D Miller
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York, USA
- Center for Theoretical Neuroscience, Columbia University, New York, NY, USA
- Department of Neuroscience, College of Physicians and Surgeons, Columbia University, New York, NY, USA
| | - Richard Naud
- University of Ottawa Brain and Mind Institute, Ottawa, Ontario, Canada
- Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Christopher C Pack
- Department of Neurology & Neurosurgery, McGill University, Montréal, Quebec, Canada
| | - Panayiota Poirazi
- Institute of Molecular Biology and Biotechnology (IMBB), Foundation for Research and Technology-Hellas (FORTH), Heraklion, Crete, Greece
| | - Pieter Roelfsema
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Amsterdam, Netherlands
| | - João Sacramento
- Institute of Neuroinformatics, ETH Zürich and University of Zürich, Zürich, Switzerland
| | - Andrew Saxe
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Benjamin Scellier
- Mila, Montréal, Quebec, Canada
- Université de Montréal, Montréal, Quebec, Canada
| | - Anna C Schapiro
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Walter Senn
- Department of Physiology, Universität Bern, Bern, Switzerland
| | | | - Daniel Yamins
- Department of Psychology, Stanford University, Stanford, CA, USA
- Department of Computer Science, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Friedemann Zenke
- Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland
- Centre for Neural Circuits and Behaviour, University of Oxford, Oxford, UK
| | - Joel Zylberberg
- Canadian Institute for Advanced Research, Toronto, Ontario, Canada
- Department of Physics and Astronomy York University, Toronto, Ontario, Canada
- Center for Vision Research, York University, Toronto, Ontario, Canada
| | | | - Konrad P Kording
- Canadian Institute for Advanced Research, Toronto, Ontario, Canada
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
4
|
Von Seth M, Hillered L, Otterbeck A, Hanslin K, Larsson A, Sjölin J, Lipcsey M, Cove ME, Chew NS, Vu LH, Lim RZ, Puthucheary Z, Hanslin K, Wilske F, Skorup P, Tano E, Sjölin J, Lipcsey M, Derese I, Thiessen S, Derde S, Dufour T, Pauwels L, Bekhuis Y, Van den Berghe G, Vanhorebeek I, Khan M, Dwivedi D, Zhou J, Prat A, Seidah NG, Liaw PC, Fox-Robichaud AE, Von Seth M, Skorup P, Hillered L, Larsson A, Sjölin J, Lipcsey M, Otterbeck A, Hanslin K, Lipcsey M, Larsson A, Von Seth M, Correa T, Pereira J, Takala J, Jakob S, Skorup P, Maudsdotter L, Tano E, Lipcsey M, Castegren M, Larsson A, Sjölin J, Xue M, Xu JY, Liu L, Huang YZ, Guo FM, Yang Y, Qiu HB, Kuzovlev A, Moroz V, Goloubev A, Myazin A, Chumachenko A, Pisarev V, Takeyama N, Tsuda M, Kanou H, Aoki R, Kajita Y, Hashiba M, Terashima T, Tomino A, Davies R, O’Dea KP, Soni S, Ward JK, O’Callaghan DJ, Takata M, Gordon AC, Wilson J, Zhao Y, Singer M, Spencer J, Shankar-Hari M, Genga KR, Lo C, Cirstea MS, Walley KR, Russell JA, Linder A, Boyd JH, Sedlag A, Riedel C, Georgieff M, Barth E, Debain A, Jonckheer J, Moeyersons W, Van zwam K, Puis L, Staessens K, Honoré PM, Spapen HD, De Waele E, de Garibay APR, Bracht H, Ende-Schneider B, Schreiber C, Kreymann B, Bini A, Votino E, Giuliano G, Steinberg I, Vetrugno L, Trunfio D, Sidoti A, Essig A, Brogi E, Forfori F, Conroy M, Marsh B, O’Flynn J, Henne-Bruns D, Gebhard F, Orend K, Halatsch M, Weiss M, Chase M, Freinkman E, Uber A, Liu X, Cocchi MN, Donnino MW, Peetermans M, Liesenborghs L, Claes J, Vanassche T, Hoylaerts M, Jacquemin M, Vanhoorelbeke K, De Meyer S, Verhamme P, Vögeli A, Ottiger M, Meier M, Steuer C, Bernasconi L, Huber A, Christ-Crain M, Henzen C, Hoess C, Thomann R, Zimmerli W, Müller B, Schütz P, Hoppensteadt D, Walborn A, Rondina M, Tsuruta K, Fareed J, Tachyla S, Ikeda T, Ono S, Ueno T, Suda S, Nagura T, Damiani E, Domizi R, Scorcella C, Tondi S, Pierantozzi S, Ciucani S, Mininno N, Adrario E, Pelaia P, Donati A, Andersen MS, Lu S, Lopez G, Lassen AT, Ghiran I, Shapiro NI, Trahtemberg U, Sviri S, Beil M, Agur Z, Van Heerden P, Jahaj E, Vassiliou A, Mastora Z, Orfanos SE, Kotanidou A, Wirz Y, Sager R, Amin D, Amin A, Haubitz S, Hausfater P, Huber A, Kutz A, Mueller B, Schuetz P, Sager RS, Wirz YW, Amin DA, Amin AA, Hausfater PH, Huber AH, Haubitz S, Kutz A, Mueller B, Schuetz P, Gottin L, Dell’amore C, Stringari G, Cogo G, Ceolagraziadei M, Sommavilla M, Soldani F, Polati E, Meier M, Baumgartner T, Zurauskaité G, Gupta S, Mueller B, Devendra A, Schuetz P, Mandaci D, Eren G, Ozturk F, Emir N, Hergunsel O, Azaiez S, Khedher S, Maaoui A, Salem M, Chernevskaya E, Beloborodova N, Bedova A, Sarshor YU, Pautova A, Gusarov V, Öveges N, László I, Forgács M, Kiss T, Hankovszky P, Palágyi P, Bebes A, Gubán B, Földesi I, Araczki Á, Telkes M, Ondrik Z, Helyes Z, Kemény Á, Molnár Z, Spanuth E, Ebelt H, Ivandic B, Thomae R, Werdan K, El-Shafie M, Taema K, El-Hallag M, Kandeel A, Tayeh O, Taema K, Eldesouky M, Omara A, Winkler MS, Holzmann M, Nierhaus A, Mudersbach E, Schwedhelm E, Daum G, Kluge S, Zoellner C, Greiwe G, Sawari H, Schwedhelm E, Nierhaus A, Kluge S, Kubitz J, Jung R, Daum G, Reichenspurner H, Zoellner C, Winkler MS, Groznik M, Ihan A, Andersen LW, Chase M, Holmberg MJ, Wulff A, Cocchi MN, Donnino MW, Balci C, Haliloglu M, Bilgili B, Bilgin H, Kasapoglu U, Sayan I, Süzer M, Mulazımoglu L, Cinel I, Patel V, Shah S, Parulekar P, Minton C, Patel J, Ejimofo C, Choi H, Costa R, Caruso P, Nassar P, Fu J, Jin J, Xu Y, Kong J, Wu D, Yaguchi A, Klonis A, Ganguly S, Kollef M, Burnham C, Fuller B, Mavrommati A, Chatzilia D, Salla E, Papadaki E, Kamariotis S, Christodoulatos S, Stylianakis A, Alamanos G, Simoes M, Trigo E, Silva N, Martins P, Pimentel J, Baily D, Curran LA, Ahmadnia E, Patel BV, Adukauskiene D, Cyziute J, Adukauskaite A, Pentiokiniene D, Righetti F, Colombaroli E, Castellano G, Wilske F, Skorup P, Lipcsey M, Hanslin K, Larsson A, Sjölin J, Man M, Shum HP, Chan YH, Chan KC, Yan WW, Lee RA, Lau SK, Dilokpattanamongkol P, Thirapakpoomanunt P, Anakkamaetee R, Montakantikul P, Tangsujaritvijit V, Sinha S, Pati J, Sahu S, Adukauskiene D, Valanciene D, Dambrauskiene A, Adukauskiene D, Valanciene D, Dambrauskiene A, Hernandez K, Lopez T, Saca D, Bello M, Mahmood W, Hamed K, Al Badi N, AlThawadi S, Al Hosaini S, Salahuddin N, Cilloniz CC, Ceccato AC, Bassi GLL, Ferrer MF, Gabarrus AG, Ranzani OR, Jose ASS, Vidal CGG, de la Bella Casa JPP, Blasi FB, Torres AT, Adukauskiene D, Ciginskiene A, Dambrauskiene A, Simoliuniene R, Giuliano G, Triunfio D, Sozio E, Taddei E, Brogi E, Sbrana F, Ripoli A, Bertolino G, Tascini C, Forfori F, Fleischmann C, Goldfarb D, Schlattmann P, Schlapbach L, Kissoon N, Baykara N, Akalin H, Arslantas MK, Gavrilovic SG, Vukoja MV, Hache MH, Kashyap RK, Dong YD, Gajic OG, Ranzani O, Shankar-Hari M, Harrison D, Rabello L, Rowan K, Salluh J, Soares M, Markota AM, Fluher JF, Kogler DK, Borovšak ZB, Sinkovic AS, László I, Öveges N, Forgács M, Kiss T, Hankovszky P, Palágyi P, Bebes A, Gubán B, Földesi I, Araczki Á, Telkes M, Ondrik Z, Helyes Z, Kemény Á, Molnár Z, Fareed J, Siddiqui Z, Aggarwal P, Iqbal O, Hoppensteadt D, Lewis M, Wasmund R, Abro S, Raghuvir S, Tsuruta K, Barie PS, Fineberg D, Radford A, Tsuruta K, Casazza A, Vilardo A, Bellazzi E, Boschi R, Ciprandi D, Gigliuto C, Preda R, Vanzino R, Vetere M, Carnevale L, Kyriazopoulou E, Pistiki A, Routsi C, Tsangaris I, Giamarellos-Bourboulis E, Kyriazopoulou E, Tsangaris I, Routsi C, Pnevmatikos I, Vlachogiannis G, Antoniadou E, Mandragos K, Armaganidis A, Giamarellos-Bourboulis E, Allan P, Oehmen R, Luo J, Ellis C, Latham P, Newman J, Pritchett C, Pandya D, Cripps A, Harris S, Jadav M, Langford R, Ko B, Park H, Beumer CM, Koch R, Beuningen DV, Oudelashof AM, Vd Veerdonk FL, Kolwijck E, VanderHoeven JG, Bergmans DC, Hoedemaekers C, Brandt JB, Golej J, Burda G, Mostafa G, Schneider A, Vargha R, Hermon M, Levin P, Broyer C, Assous M, Wiener-Well Y, Dahan M, Benenson S, Ben-Chetrit E, Faux A, Sherazi R, Sethi A, Saha S, Kiselevskiy M, Gromova E, Loginov S, Tchikileva I, Dolzhikova Y, Krotenko N, Vlasenko R, Anisimova N, Spadaro S, Fogagnolo A, Remelli F, Alvisi V, Romanello A, Marangoni E, Volta C, Degrassi A, Mearelli F, Casarsa C, Fiotti N, Biolo G, Cariqueo M, Luengo C, Galvez R, Romero C, Cornejo R, Llanos O, Estuardo N, Alarcon P, Magazi B, Khan S, Pasipanodya J, Eriksson M, Strandberg G, Lipsey M, Larsson A, Rajput Z, Hiscock F, Karadag T, Uwagwu J, Jain S, Molokhia A, Barrasa H, Soraluce A, Uson E, Rodriguez A, Isla A, Martin A, Fernández B, Fonseca F, Sánchez-Izquierdo JA, Maynar FJ, Kaffarnik M, Alraish R, Frey O, Roehr A, Stockmann M, Wicha S, Shortridge D, Castanheira M, Sader HS, Streit JM, Flamm RK, Falsetta K, Lam T, Reidt S, Jancik J, Kinoshita T, Yoshimura J, Yamakawa K, Fujimi S, Armaganidis A, Torres A, Zakynthinos S, Mandragos C, Giamarellos-Bourboulis E, Ramirez P, De la Torre-Prados M, Rodriguez A, Dale G, Wach A, Beni L, Hooftman L, Zwingelstein C, François B, Colin G, Dequin PF, Laterre PF, Perez A, Welte R, Lorenz I, Eller P, Joannidis M, Bellmann R, Lim S, Chana S, Patel S, Higuera J, Cabestrero D, Rey L, Narváez G, Blandino A, Aroca M, Saéz S, De Pablo R, Thiessen S, Vanhorebeek I, Derde S, Derese I, Dufour T, Albert CN, Langouche L, Goossens C, Peersman N, Vermeersch P, Vander Perre S, Holst J, Wouters P, Van den Berghe G, Liu X, Uber AU, Holmberg M, Konanki V, McNaughton M, Zhang J, Donnino MW, Demirkiran O, Byelyalov A, Luengo C, Guerrero J, Cariqueo M, Scorcella C, Domizi R, Damiani E, Tondi S, Pierantozzi S, Rossini N, Falanga U, Monaldi V, Adrario E, Pelaia P, Donati A, Cole O, Scawn N, Balciunas M, Blascovics I, Vuylsteke A, Salaunkey K, Omar A, Salama A, Allam M, Alkhulaifi A, Verstraete S, Vanhorebeek I, Van Puffelen E, Derese I, Ingels C, Verbruggen S, Wouters P, Joosten K, Hanot J, Guerra G, Vlasselaers D, Lin J, Van den Berghe G, Haines R, Zolfaghari P, Hewson R, Offiah C, Prowle J, Park H, Ko B, Buter H, Veenstra JA, Koopmans M, Boerma EC, Veenstra JA, Buter H, Koopmans M, Boerma EC, Taha A, Shafie A, Hallaj S, Gharaibeh D, Hon H, Bizrane M, El Khattate AA, Madani N, Abouqal R, Belayachi J, Kongpolprom N, Sanguanwong N, Sanaie S, Mahmoodpoor A, Hamishehkar H, Biderman P, Van Heerden P, Avitzur Y, Solomon S, Iakobishvili Z, Carmi U, Gorfil D, Singer P, Paisley C, Patrick-Heselton J, Mogk M, Humphreys J, Welters I, Pierantozzi S, Scorcella C, Domizi R, Damiani E, Tondi S, Casarotta E, Bolognini S, Adrario E, Pelaia P, Donati A, Holmberg MJ, Moskowitz A, Patel P, Grossestreuer A, Uber A, Andersen LW, Donnino MW, Malinverni S, Goedeme D, Mols P, Langlois PL, Szwec C, D’Aragon F, Heyland DK, Manzanares W, Manzanares W, Szwec C, Langlois P, Aramendi I, Heyland D, Stankovic N, Nadler J, Uber A, Holmberg M, Sanchez L, Wolfe R, Chase M, Donnino M, Cocchi M, Atalan HK, Gucyetmez B, Kavlak ME, Aslan S, Kargi A, Yazici S, Donmez R, Polat KY, Piechota M, Piechota A, Misztal M, Bernas S, Pietraszek-Grzywaczewska I, Saleh M, Hamdy A, Hamdy A, Elhallag M, Atar F, Kundakci A, Gedik E, Sahinturk H, Zeyneloglu P, Pirat A, Popescu M, Tomescu D, Van Gassel R, Baggerman M, Schaap F, Bol M, Nicolaes G, Beurskens D, Damink SO, Van de Poll M, Horibe M, Sasaki M, Sanui M, Iwasaki E, Sawano H, Goto T, Ikeura T, Hamada T, Oda T, Mayumi T, Kanai T, Kjøsen G, Horneland R, Rydenfelt K, Aandahl E, Tønnessen T, Haugaa H, Lockett P, Evans L, Somerset L, Ker-Reid F, Laver S, Courtney E, Dalton S, Georgiou A, Robinson K, Lam T, Haas B, Reidt S, Bartlett K, Jancik J, Bigwood M, Hanley R, Morgan P, Marouli D, Chatzimichali A, Kolyvaki S, Panteli A, Diamantaki E, Pediaditis E, Sirogianni P, Ginos P, Kondili E, Georgopoulos D, Askitopoulou H, Zampieri FG, Liborio AB, Besen BA, Cavalcanti AB, Dominedò C, Dell’Anna AM, Monayer A, Grieco DL, Barelli R, Cutuli SL, Maddalena AI, Picconi E, Sonnino C, Sandroni C, Antonelli M, Gucyetmez B, Atalan HK, Tuzuner F, Cakar N, Jacob M, Sahu S, Singh YP, Mehta Y, Yang KY, Kuo S, Rai V, Cheng T, Ertmer C, Czempik P, Hutchings S, Watts S, Wilson C, Burton C, Kirkman E, Drennan D, O’Prey A, MacKay A, Forrest R, Oglinda A, Ciobanu G, Casian M, Oglinda C, Lun CT, Yuen HJ, Ng G, Leung A, So SO, Chan HS, Lai KY, Sanguanwit P, Charoensuk W, Phakdeekitcharoen B, Batres-Baires G, Kammerzell I, Lahmer T, Mayr U, Schmid R, Huber W, Spanuth E, Bomberg H, Klingele M, Thomae R, Groesdonk H, Bernas S, Piechota M, Mirkiewicz K, Pérez AG, Silva J, Ramos A, Acharta F, Perezlindo M, Lovesio L, Antonelli PG, Dogliotti A, Lovesio C, Baron J, Schiefer J, Baron DM, Faybik P, Shum HP, Yan WW, Chan TM, Marouli D, Chatzimichali A, Kolyvaki S, Panteli A, Diamantaki E, Pediaditis E, Sirogianni P, Ginos P, Kondili E, Georgopoulos D, Askitopoulou H, Vicka V, Gineityte D, Ringaitiene D, Sipylaite J, Pekarskiene J, Beurskens DM, Van Smaalen TC, Hoogland P, Winkens B, Christiaans MH, Reutelingsperger CP, Van Heurn E, Nicolaes GA, Schmitt FS, Salgado ES, Friebe JF, Fleming TF, Zemva JZ, Schmoch TS, Uhle FU, Kihm LK, Morath CM, Nusshag CN, Zeier MZ, Bruckner TB, Mehrabi AM, Nawroth PN, Weigand MW, Hofer SH, Brenner TB, Fotopoulou G, Poularas I, Kokkoris S, Brountzos E, Zakynthinos S, Routsi C, Saleh M, Elghonemi M, Nilsson KF, Sandin J, Gustafsson L, Frithiof R, Skorniakov I, Varaksin A, Vikulova D, Shaikh O, Whiteley C, Ostermann M, Di Lascio G, Anicetti L, Bonizzoli M, Fulceri G, Migliaccio ML, Sentina P, Cozzolino M, Peris A, Khadzhynov D, Halleck F, Staeck O, Lehner L, Budde K, Slowinski T, Slowinski T, Kindgen-Milles D, Khadzhynov D, Huysmans N, Laenen MV, Helmschrodt A, Boer W. 37th International Symposium on Intensive Care and Emergency Medicine (part 3 of 3). Crit Care 2017. [PMCID: PMC5374592 DOI: 10.1186/s13054-017-1629-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
|