1
|
Lazartigues L, Mathy F, Aguilar C, Lavigne F. The order of stimuli matters when learning second-order transitional probabilities. Learn Behav 2024:10.3758/s13420-024-00646-z. [PMID: 39327382 DOI: 10.3758/s13420-024-00646-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/09/2024] [Indexed: 09/28/2024]
Abstract
The order of stimuli within sequences and the transitional probabilities (TPs) it generates are central information in sequence processing. However, less is known about what type of information and how it is extracted by general learning mechanisms. The present study focused on statistical learning of second-order TPs. Second-order TPs are involved when only the combination of two stimuli predicts the third. In a first experiment, TPs depended crucially on the order of presentation of a pair A - B , which led to different predictions depending on the order of the stimuli (i.e., ABC vs. BAF). Eight visuomotor sequences governed by second-order TPs were used and response times (RTs) were recorded for each transition. The task included a learning phase followed by a switch phase during which the second-order TP were reversed (e.g., the sequences ABC and BAF became respectively ABF and BAC). A decrease of RTs between the second and the third stimulus during the learning phase and an increase of RTs during the switch phase suggested that variations of orders within second-order TPs could be learned. Further analyses, however, indicated that such learning was difficult for most participants. A second experiment showed that the difficulty of learning was not solely due to the difficulty to pick up the effect of order of presentation, but that learning second-order transitional probabilities in addition to order would be the main obstacle. These experiments suggest that statistical learning is capable of learning complex associations, even if this remains a challenge for human cognition.
Collapse
Affiliation(s)
- Laura Lazartigues
- University Lille, CNRS, UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, F-59000, Lille, France.
| | - Fabien Mathy
- Bases, Corpus, Langage (BCL, UMR 7320), Université Côte d'Azur and CNRS, Nice, France
| | | | - Frédéric Lavigne
- Bases, Corpus, Langage (BCL, UMR 7320), Université Côte d'Azur and CNRS, Nice, France
| |
Collapse
|
2
|
Lazartigues L, Mathy F, Lavigne F. Probability, Dependency, and Frequency Are Not All Equally Involved in Statistical Learning. Exp Psychol 2022; 69:241-252. [PMID: 36655884 DOI: 10.1027/1618-3169/a000561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
The ability to learn sequences depends on different factors governing sequence structure, such as transitional probability (TP, probability of a stimulus given a previous stimulus), adjacent or nonadjacent dependency, and frequency. Current evidence indicates that adjacent and nonadjacent pairs are not equally learnable; the same applies to second-order and first-order TPs and to the frequency of the sequences. However, the relative importance of these factors and interactive effects on learning remain poorly understood. The first experiment tested the effects of TPs and dependency separately on the learning of nonlinguistic visual sequences, and the second experiment used the factors of the first experiment and added a frequency factor to test their interactive effects with verbal sequences of stimuli (pseudo-words). The results of both experiments showed higher performance during online learning for first-order TPs in adjacent pairs. Moreover, Experiment 2 indicated poorer performance during offline recall for nonadjacent dependencies and low-frequency sequences. We discuss the results that different factors are not used equally in prediction and memorization.
Collapse
Affiliation(s)
- Laura Lazartigues
- Department of Psychology, Université Côte d'Azur, BCL, CNRS, Nice, France
| | - Fabien Mathy
- Department of Psychology, Université Côte d'Azur, BCL, CNRS, Nice, France
| | - Frédéric Lavigne
- Department of Psychology, Université Côte d'Azur, BCL, CNRS, Nice, France
| |
Collapse
|
3
|
Lazartigues L, Mathy F, Lavigne F. Statistical learning of unbalanced exclusive-or temporal sequences in humans. PLoS One 2021; 16:e0246826. [PMID: 33592012 PMCID: PMC7886115 DOI: 10.1371/journal.pone.0246826] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Accepted: 01/27/2021] [Indexed: 11/26/2022] Open
Abstract
A pervasive issue in statistical learning has been to determine the parameters of regularity extraction. Our hypothesis was that the extraction of transitional probabilities can prevail over frequency if the task involves prediction. Participants were exposed to four repeated sequences of three stimuli (XYZ) with each stimulus corresponding to the position of a red dot on a touch screen that participants were required to touch sequentially. The temporal and spatial structure of the positions corresponded to a serial version of the exclusive-or (XOR) that allowed testing of the respective effect of frequency and first- and second-order transitional probabilities. The XOR allowed the first-order transitional probability to vary while being not completely related to frequency and to vary while the second-order transitional probability was fixed (p(Z|X, Y) = 1). The findings show that first-order transitional probability prevails over frequency to predict the second stimulus from the first and that it also influences the prediction of the third item despite the presence of second-order transitional probability that could have offered a certain prediction of the third item. These results are particularly informative in light of statistical learning models.
Collapse
Affiliation(s)
- Laura Lazartigues
- Department of Psychology, Université Côte d’Azur, CNRS, BCL, Nice, France
- * E-mail:
| | - Fabien Mathy
- Department of Psychology, Université Côte d’Azur, CNRS, BCL, Nice, France
| | - Frédéric Lavigne
- Department of Psychology, Université Côte d’Azur, CNRS, BCL, Nice, France
| |
Collapse
|
4
|
Smith JD, Jackson BN, Adamczyk MN, Church BA. Conceptual anchoring dissociates implicit and explicit category learning. J Exp Psychol Learn Mem Cogn 2021; 48:813-828. [PMID: 33523691 DOI: 10.1037/xlm0000856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Categorization researchers have long debated the possibility of multiple category-learning systems. The need persists for paradigms that dissociate explicit-declarative category-learning processes (featuring verbalizable category rules) from implicit-procedural processes (featuring stimulus-response associations lying beneath declarative cognition). The authors contribute a new paradigm, using perfectly matched exclusive-or (XOR) category tasks differing only in the availability or absence of easily verbalizable conceptual content. This manipulation transformed learning. The conceptual task alone was learned suddenly, by insightful rule discovery, producing explicit-declarative XOR knowledge. The perceptual task was learned more gradually, consistent with associative-learning processes, producing impoverished declarative knowledge. We also tested participants under regimens of immediate and deferred reinforcement. The conceptual task alone was learned through processes that survive the loss of trial-by-trial reinforcement. All results support the idea that humans have perceptual-associative processes for implicit learning, but also an overlain conceptual system that under the right circumstances constitutes a parallel explicit-declarative category-learning system. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
5
|
Cyr A, Thériault F, Chartier S. Revisiting the XOR problem: a neurorobotic implementation. Neural Comput Appl 2020. [DOI: 10.1007/s00521-019-04522-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
6
|
Kikuchi DW, Dornhaus A, Gopeechund V, Sherratt TN. Signal categorization by foraging animals depends on ecological diversity. eLife 2019; 8:e43965. [PMID: 31021317 PMCID: PMC6510532 DOI: 10.7554/elife.43965] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Accepted: 04/24/2019] [Indexed: 11/13/2022] Open
Abstract
Warning signals displayed by defended prey are mimicked by both mutualistic (Müllerian) and parasitic (Batesian) species. Yet mimicry is often imperfect: why does selection not improve mimicry? Predators create selection on warning signals, so predator psychology is crucial to understanding mimicry. We conducted experiments where humans acted as predators in a virtual ecosystem to ask how prey diversity affects the way that predators categorize prey phenotypes as profitable or unprofitable. The phenotypic diversity of prey communities strongly affected predator categorization. Higher diversity increased the likelihood that predators would use a 'key' trait to form broad categories, even if it meant committing errors. Broad categorization favors the evolution of mimicry. Both species richness and evenness contributed significantly to this effect. This lets us view the behavioral and evolutionary processes leading to mimicry in light of classical community ecology. Broad categorization by receivers is also likely to affect other forms of signaling.
Collapse
Affiliation(s)
- David William Kikuchi
- Department of Ecology and Evolutionary BiologyUniversity of ArizonaTucsonUnited States
| | - Anna Dornhaus
- Department of Ecology and Evolutionary BiologyUniversity of ArizonaTucsonUnited States
| | | | | |
Collapse
|
7
|
Broschard MB, Kim J, Love BC, Wasserman EA, Freeman JH. Selective attention in rat visual category learning. ACTA ACUST UNITED AC 2019; 26:84-92. [PMID: 30770465 PMCID: PMC6380202 DOI: 10.1101/lm.048942.118] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2018] [Accepted: 01/15/2019] [Indexed: 11/25/2022]
Abstract
A prominent theory of category learning, COVIS, posits that new categories are learned with either a declarative or procedural system, depending on the task. The declarative system uses the prefrontal cortex (PFC) to learn rule-based (RB) category tasks in which there is one relevant sensory dimension that can be used to establish a rule for solving the task, whereas the procedural system uses corticostriatal circuits for information integration (II) tasks in which there are multiple relevant dimensions, precluding use of explicit rules. Previous studies have found faster learning of RB versus II tasks in humans and monkeys but not in pigeons. The absence of a learning rate difference in pigeons has been attributed to their lacking a PFC. A major gap in this comparative analysis, however, is the lack of data from a nonprimate mammalian species, such as rats, that have a PFC but a less differentiated PFC than primates. Here, we investigated RB and II category learning in rats. Similar to pigeons, RB and II tasks were learned at the same rate. After reaching a learning criterion, wider distributions of stimuli were presented to examine generalization. A second experiment found equivalent RB and II learning with wider category distributions. Computational modeling revealed that rats extract and selectively attend to category-relevant information but do not consistently use rules to solve the RB task. These findings suggest rats are on a continuum of PFC function between birds and primates, with selective attention but limited ability to utilize rules relative to primates.
Collapse
Affiliation(s)
- Matthew B Broschard
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa, 52242, USA
| | - Jangjin Kim
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa, 52242, USA
| | - Bradley C Love
- Department of Experimental Psychology and The Alan Turing Institute, University College London, London WC1H 0AP, United Kingdom
| | - Edward A Wasserman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa, 52242, USA
| | - John H Freeman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa, 52242, USA
| |
Collapse
|
8
|
Smith JD, Jamani S, Boomer J, Church BA. One-back reinforcement dissociates implicit-procedural and explicit-declarative category learning. Mem Cognit 2018; 46:261-273. [PMID: 29019169 PMCID: PMC5811319 DOI: 10.3758/s13421-017-0762-8] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
The debate over unitary/multiple category-learning utilities is reminiscent of debates about multiple memory systems and unitary/dual codes in knowledge representation. In categorization, researchers continue to seek paradigms to dissociate explicit learning processes (yielding verbalizable rules) from implicit learning processes (yielding stimulus-response associations that remain outside awareness). We introduce a new dissociation here. Participants learned matched category tasks with a multidimensional, information-integration solution or a one-dimensional, rule-based solution. They received reinforcement immediately (0-Back reinforcement) or after one intervening trial (1-Back reinforcement). Lagged reinforcement eliminated implicit, information-integration category learning but preserved explicit, rule-based learning. Moreover, information-integration learners facing lagged reinforcement spontaneously adopted explicit rule strategies that poorly suited their task. The results represent a strong process dissociation in categorization, broadening the range of empirical techniques for testing the multiple-process theoretical perspective. This and related methods that disable associative learning-fostering a transition to explicit-declarative cognition-could have broad utility in comparative, cognitive, and developmental science.
Collapse
Affiliation(s)
- J David Smith
- Department of Psychology, Georgia State University, Atlanta, GA, USA
| | - Sonia Jamani
- Department of Psychology, Georgia State University, Atlanta, GA, USA
| | - Joseph Boomer
- University at Buffalo, The State University of New York, New York, NY, USA
| | - Barbara A Church
- Language Research Center, Georgia State University, Atlanta, GA, USA.
| |
Collapse
|
9
|
Bossens C, Op de Beeck HP. Linear and Non-Linear Visual Feature Learning in Rat and Humans. Front Behav Neurosci 2016; 10:235. [PMID: 28066201 PMCID: PMC5180255 DOI: 10.3389/fnbeh.2016.00235] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2016] [Accepted: 11/30/2016] [Indexed: 11/17/2022] Open
Abstract
The visual system processes visual input in a hierarchical manner in order to extract relevant features that can be used in tasks such as invariant object recognition. Although typically investigated in primates, recent work has shown that rats can be trained in a variety of visual object and shape recognition tasks. These studies did not pinpoint the complexity of the features used by these animals. Many tasks might be solved by using a combination of relatively simple features which tend to be correlated. Alternatively, rats might extract complex features or feature combinations which are nonlinear with respect to those simple features. In the present study, we address this question by starting from a small stimulus set for which one stimulus-response mapping involves a simple linear feature to solve the task while another mapping needs a well-defined nonlinear combination of simpler features related to shape symmetry. We verified computationally that the nonlinear task cannot be trivially solved by a simple V1-model. We show how rats are able to solve the linear feature task but are unable to acquire the nonlinear feature. In contrast, humans are able to use the nonlinear feature and are even faster in uncovering this solution as compared to the linear feature. The implications for the computational capabilities of the rat visual system are discussed.
Collapse
|
10
|
Smith JD, Zakrzewski AC, Johnson JM, Valleau JC. Ecology, Fitness, Evolution: New Perspectives on Categorization. CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE 2016; 25:266-274. [PMID: 27725790 DOI: 10.1177/0963721416652393] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Categorization's great debate has weighed single-system exemplar theory against the possibility of alternative processing systems. We take an evolutionary perspective toward this debate to illuminate it in a new way. Animals are crucial behavioral ambassadors to this area. They reveal the roots of human categorization, the basic assumptions of vertebrates entering category tasks, and the surprising weakness of exemplar memory as a category-learning strategy. These results have joined neuroscience results to prompt important changes in categorization theory. Categorization's great debate is ending. Categorization is served by multiple systems of process and representation.
Collapse
|
11
|
Categorization: The View from Animal Cognition. Behav Sci (Basel) 2016; 6:bs6020012. [PMID: 27314392 PMCID: PMC4931384 DOI: 10.3390/bs6020012] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2016] [Revised: 05/21/2016] [Accepted: 05/31/2016] [Indexed: 11/17/2022] Open
Abstract
Exemplar, prototype, and rule theory have organized much of the enormous literature on categorization. From this theoretical foundation have arisen the two primary debates in the literature-the prototype-exemplar debate and the single system-multiple systems debate. We review these theories and debates. Then, we examine the contribution that animal-cognition studies have made to them. Animals have been crucial behavioral ambassadors to the literature on categorization. They reveal the roots of human categorization, the basic assumptions of vertebrates entering category tasks, the surprising weakness of exemplar memory as a category-learning strategy. They show that a unitary exemplar theory of categorization is insufficient to explain human and animal categorization. They show that a multiple-systems theoretical account-encompassing exemplars, prototypes, and rules-will be required for a complete explanation. They show the value of a fitness perspective in understanding categorization, and the value of giving categorization an evolutionary depth and phylogenetic breadth. They raise important questions about the internal similarity structure of natural kinds and categories. They demonstrate strong continuities with humans in categorization, but discontinuities, too. Categorization's great debates are resolving themselves, and to these resolutions animals have made crucial contributions.
Collapse
|
12
|
Lee RF. Dual logic and cerebral coordinates for reciprocal interaction in eye contact. PLoS One 2015; 10:e0121791. [PMID: 25885446 PMCID: PMC4401735 DOI: 10.1371/journal.pone.0121791] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2014] [Accepted: 02/04/2015] [Indexed: 11/18/2022] Open
Abstract
In order to scientifically study the human brain’s response to face-to-face social interaction, the scientific method itself needs to be reconsidered so that both quantitative observation and symbolic reasoning can be adapted to the situation where the observer is also observed. In light of the recent development of dyadic fMRI which can directly observe dyadic brain interacting in one MRI scanner, this paper aims to establish a new form of logic, dual logic, which provides a theoretical platform for deductive reasoning in a complementary dual system with emergence mechanism. Applying the dual logic in the dfMRI experimental design and data analysis, the exogenous and endogenous dual systems in the BOLD responses can be identified; the non-reciprocal responses in the dual system can be suppressed; a cerebral coordinate for reciprocal interaction can be generated. Elucidated by dual logic deductions, the cerebral coordinate for reciprocal interaction suggests: the exogenous and endogenous systems consist of the empathy network and the mentalization network respectively; the default-mode network emerges from the resting state to activation in the endogenous system during reciprocal interaction; the cingulate plays an essential role in the emergence from the exogenous system to the endogenous system. Overall, the dual logic deductions are supported by the dfMRI experimental results and are consistent with current literature. Both the theoretical framework and experimental method set the stage to formally apply the scientific method in studying complex social interaction.
Collapse
Affiliation(s)
- Ray F. Lee
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, United States of America
- * E-mail:
| |
Collapse
|
13
|
Abstract
The article explores-from a utility/adaptation perspective-the role of prototype and exemplar processes in categorization. The author surveys important category tasks within the categorization literature from the perspective of the optimality of applying prototype and exemplar processes. Formal simulations reveal that organisms will often (not always!) receive more useful signals about category belongingness if they average their exemplar experience into a prototype and use this as the comparative standard for categorization. This survey then provides the theoretical context for considering the evolution of cognitive systems for categorization. In the article's final sections, the author reviews recent research on the performance of nonhuman primates and humans in the tasks analyzed in the article. Diverse species share operating principles, default commitments, and processing weaknesses in categorization. From these commonalities, it may be possible to infer some properties of the categorization ecology these species generally experienced during cognitive evolution.
Collapse
Affiliation(s)
- J David Smith
- Department of Psychology, Center for Cognitive Science, University at Buffalo, The State University of New York, 346 Park Hall, Buffalo, NY, 14260, USA,
| |
Collapse
|
14
|
Smith JD, Berg ME, Cook RG, Murphy MS, Crossley MJ, Boomer J, Spiering B, Beran MJ, Church BA, Ashby FG, Grace RC. Implicit and explicit categorization: a tale of four species. Neurosci Biobehav Rev 2012; 36:2355-69. [PMID: 22981878 DOI: 10.1016/j.neubiorev.2012.09.003] [Citation(s) in RCA: 78] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2012] [Revised: 08/09/2012] [Accepted: 09/04/2012] [Indexed: 11/18/2022]
Abstract
Categorization is essential for survival, and it is a widely studied cognitive adaptation in humans and animals. An influential neuroscience perspective differentiates in humans an explicit, rule-based categorization system from an implicit system that slowly associates response outputs to different regions of perceptual space. This perspective is being extended to study categorization in other vertebrate species, using category tasks that have a one-dimensional, rule-based solution or a two-dimensional, information-integration solution. Humans, macaques, and capuchin monkeys strongly dimensionalize perceptual stimuli and learn rule-based tasks more quickly. In sharp contrast, pigeons learn these two tasks equally quickly. Pigeons represent a cognitive system in which the commitment to dimensional analysis and category rules was not strongly made. Their results may reveal the character of the ancestral vertebrate categorization system from which that of primates emerged. The primate results establish continuity with human cognition, suggesting that nonhuman primates share aspects of humans' capacity for explicit cognition. The emergence of dimensional analysis and rule learning could have been an important step in primates' cognitive evolution.
Collapse
Affiliation(s)
- J David Smith
- Department of Psychology, University at Buffalo, The State University of New York, Buffalo, NY 14260, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
15
|
The learning of basic-level categories by pigeons: the prototype effect, attention, and effects of categorization. Learn Behav 2011; 39:271-87. [PMID: 21484235 DOI: 10.3758/s13420-011-0028-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Pigeons were trained to classify composite faces of two categories created by mimicking the structure of basic-level categories, with each face consisting of an item-specific component and a common component diagnostic for its category. Classification accuracy increased as the proportion of common components increased, regardless of familiar and novel item-specific components, with the best discrimination occurring at untrained original faces used as the common components. A no-categorization control condition suggested that categorization gives rise to equivalence for item-specific components and distinctiveness for degrees of prototypicality. When some item-specific components were shared by exemplars of the contrasting categories, those that were not overlapping between the categories became the effective cues for the pigeons' responses. Implications of these results are discussed in the context of current categorization and associative learning theories.
Collapse
|
16
|
Abstract
In the present study, we investigated response decisions made under conditions of incomplete information in rats. In Experiment 1, rats were trained on either a positive patterning (PP; A-, B-, AB+) or a negative patterning (NP; A+, B+, AB-) instrumental lever-press discrimination. Subjects that had learned an NP discrimination responded less to Cue A when Cue B was covered at test. The cover did not, however, affect test responses to Cue A in the PP condition. In Experiment 2, rats received concurrent training on both PP and NP discriminations. After concurrent training, responses to Cue A were different with B covered versus uncovered for both NP and PP discriminations. We discuss possible accounts for why exposure to a nonlinearly soluble discrimination (NP) may have affected sensitivity to cue ambiguity produced by the cover. These results have interesting implications for representational processes engaged in problem solving.
Collapse
|