1
|
Grotz WH, Rump LC, Niessen A, Schmidt-Gayk H, Reichelt A, Kirste G, Olschewski M, Schollmeyer PJ. Treatment of osteopenia and osteoporosis after kidney transplantation. Transplantation 1998; 66:1004-8. [PMID: 9808483 DOI: 10.1097/00007890-199810270-00007] [Citation(s) in RCA: 103] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
BACKGROUND Osteopenia and osteoporosis are frequent complications after kidney transplantation. Data for the treatment of low bone mass after kidney transplantation are not available. METHODS To test the efficacy of antiresorptive treatment, 46 patients with osteopenia or osteoporosis after kidney transplantation (bone mineral density < or =1.5 SD below normal) were randomly assigned to three groups cyclically treated as follows: group 1 with daily oral clodronate (800 mg) and group 2 with daily intranasal calcitonin (200 IU) for 2 weeks every 3 months. These two groups were compared with a control group (group 3). Every patient was supplemented with 500 mg of calcium per day. Bone mineral density (BMD) was measured by dual energy x-ray absorptiometry (DEXA) at the lumbar spine and femoral neck before and after the 12-month treatment period. RESULTS BMD at the lumbar spine was increased by 4.6% in the clodronate group (n=15, P=0.005), by 3.2% in the calcitonin group (n=16, P=0.034), and by 1.8% in the control group (n=15, P=0.265). However, the differences in BMD changes among the groups were not statistically significant. During therapy, serum calcium decreased slightly in all groups by 4.6%; however, parathyroid hormone values increased significantly in the treatment groups by 116%. Therapy was well tolerated without impact on graft function. CONCLUSIONS Cyclical therapy with clodronate or calcitonin appears to induce a gain in BMD at the lumbar spine in patients with low bone mass after kidney transplantation. This treatment had no adverse impact on graft function but may aggravate preexisting secondary hyperparathyroidism.
Collapse
|
Clinical Trial |
27 |
103 |
2
|
Bergkamp TLG, Niessen ASM, den Hartigh RJR, Frencken WGP, Meijer RR. Methodological Issues in Soccer Talent Identification Research. Sports Med 2020; 49:1317-1335. [PMID: 31161402 PMCID: PMC6684562 DOI: 10.1007/s40279-019-01113-w] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Talent identification research in soccer comprises the prediction of elite soccer performance. While many studies in this field have aimed to empirically relate performance characteristics to subsequent soccer success, a critical evaluation of the methodology of these studies has mostly been absent in the literature. In this position paper, we discuss advantages and limitations of the design, validity, and utility of current soccer talent identification research. Specifically, we draw on principles from selection psychology that can contribute to best practices in the context of making selection decisions across domains. Based on an extensive search of the soccer literature, we identify four methodological issues from this framework that are relevant for talent identification research, i.e. (1) the operationalization of criterion variables (the performance to be predicted) as performance levels; (2) the focus on isolated performance indicators as predictors of soccer performance; (3) the effects of range restriction on the predictive validity of predictors used in talent identification; and (4) the effect of the base rate on the utility of talent identification procedures. Based on these four issues, we highlight opportunities and challenges for future soccer talent identification studies that may contribute to developing evidence-based selection procedures. We suggest for future research to consider the use of individual soccer criterion measures, to adopt representative, high-fidelity predictors of soccer performance, and to take restriction of range and the base rate into account.
Collapse
|
Journal Article |
5 |
47 |
3
|
Den Hartigh RJR, Niessen ASM, Frencken WGP, Meijer RR. Selection procedures in sports: Improving predictions of athletes' future performance. Eur J Sport Sci 2018; 18:1191-1198. [PMID: 29856681 DOI: 10.1080/17461391.2018.1480662] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Abstract
The selection of athletes has been a central topic in sports sciences for decades. Yet, little consideration has been given to the theoretical underpinnings and predictive validity of the procedures. In this paper, we evaluate current selection procedures in sports given what we know from the selection psychology literature. We contrast the popular clinical method (predictions based on overall impressions of experts) with the actuarial approach (predictions based on pre-defined decision rules), and we discuss why the latter approach often leads to superior performance predictions. Furthermore, we discuss the "signs" and the "samples" approaches. Taking the prevailing signs approach, athletes' technical-, tactical-, physical-, and psychological skills are often assessed separately in controlled settings. However, for predicting later sport performance, taking samples of athletes' behaviours in their sports environment may result in more valid assessments. We discuss the possible advantages and implications of making selection procedures in sports more actuarial and sample-based.
Collapse
|
Review |
7 |
32 |
4
|
Meijer RR, Niessen ASM, Tendeiro JN. A Practical Guide to Check the Consistency of Item Response Patterns in Clinical Research Through Person-Fit Statistics. Assessment 2015; 23:52-62. [DOI: 10.1177/1073191115577800] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Although there are many studies devoted to person-fit statistics to detect inconsistent item score patterns, most studies are difficult to understand for nonspecialists. The aim of this tutorial is to explain the principles of these statistics for researchers and clinicians who are interested in applying these statistics. In particular, we first explain how invalid test scores can be detected using person-fit statistics; second, we provide the reader practical examples of existing studies that used person-fit statistics to detect and to interpret inconsistent item score patterns; and third, we discuss a new R-package that can be used to identify and interpret inconsistent score patterns.
Collapse
|
|
10 |
30 |
5
|
Niessen ASM, Meijer RR, Tendeiro JN. Measuring non-cognitive predictors in high-stakes contexts: The effect of self-presentation on self-report instruments used in admission to higher education. PERSONALITY AND INDIVIDUAL DIFFERENCES 2017. [DOI: 10.1016/j.paid.2016.11.014] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
|
8 |
29 |
6
|
Tendeiro JN, Meijer RR, Niessen ASM. PerFit: An R Package for Person-Fit Analysis in IRT. J Stat Softw 2016. [DOI: 10.18637/jss.v074.i05] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
|
|
9 |
26 |
7
|
Niessen ASM, Meijer RR. On the Use of Broadened Admission Criteria in Higher Education. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2018; 12:436-448. [PMID: 28544866 DOI: 10.1177/1745691616683050] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
There is an increasing interest in the use of broadened criteria for admission to higher education, often assessed through noncognitive instruments. We argue that there are several reasons why, despite some significant progress, the use of noncognitive predictors to select students is problematic in high-stakes educational selection and why the incremental validity will often be modest, even when studied in low-stakes contexts. Furthermore, we comment on the use of broadened admission criteria in relation to reducing adverse impact of testing on some groups, and we extend the literature by discussing an approach based on behavioral sampling, which showed promising results in Europe. Finally, we provide some suggestions for future research.
Collapse
|
Journal Article |
7 |
22 |
8
|
Niessen ASM, Meijer RR. Selection of medical students on the basis of non-academic skills: is it worth the trouble? Clin Med (Lond) 2016; 16:339-42. [PMID: 27481377 PMCID: PMC6280215 DOI: 10.7861/clinmedicine.16-4-339] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
In this article, we discuss the practical usefulness of selecting future medical students on the basis of increasingly popular non-academic tests (eg multiple mini-interviews, situational judgment tests) in addition to academic tests. Non-academic tests assess skills such as ethical decision making, communication and collaboration skills, or traits such as conscientiousness. Although other studies showed that performance on non-academic tests could have a positive relationship with future professional performance, we argue that this relationship should be interpreted in the context of the base rate (the proportion of suitable candidates in the applicant pool) and the selection ratio (the proportion of selected applicants from the applicant pool). We provide some numerical examples in the context of medical student selection. Finally, we suggest that optimising training in non-academic skills may be a more successful alternative than selecting students on the basis of these skills.
Collapse
|
review-article |
9 |
20 |
9
|
Bergkamp TLG, Frencken WGP, Niessen ASM, Meijer RR, den Hartigh RJR. How soccer scouts identify talented players. Eur J Sport Sci 2021; 22:994-1004. [PMID: 33858300 DOI: 10.1080/17461391.2021.1916081] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Scouts of soccer clubs are often the first to identify talented players. However, there is a lack of research on how these scouts assess and predict overall soccer performance. Therefore, we conducted a large-scaled study to examine the process of talent identification among 125 soccer scouts. Through an online self-report questionnaire, scouts were asked about (1) the players' age at which they can predict players' soccer performance, (2) the attributes they consider relevant, and (3) the extent to which they predict performance in a structured manner. The most important results are as follows. First, scouts who observed 12-year-old and younger players perceived they could predict at older ages (13.6 years old, on average) whether a player has the potential to become a professional soccer player. This suggests that scouts are aware of the idea that early indicators of later performance are often lacking, yet do advise on selection of players at younger ages. Second, when identifying talented players, scouts considered more easily observable attributes, such as technical attributes. However, scouts described these often in a broad sense rather than in terms of specific predictors of future performance. Finally, scouts reported that they assess attributes of players in a structured manner. Yet, they ultimately based their prediction (i.e. final score) on an intuitive integration of different performance attributes, which is a suboptimal strategy according to existing literature. Taken together, these outcomes provide specific clues to improve the reliability and validity of the scouting process. HighlightsBased on a large sample of soccer scouts, we examine three issues that are important in the process of identifying talented soccer players: The age at which good performance predictions can be made, which attributes are relevant predictors, and how performance predictions are formed.Scouts who observe players in young age cohorts believe that the age at which they can predict performance is older than the players they typically scout, suggesting that they are aware that early indicators of performance are often lacking.Technical performance attributes are considered as most important performance predictors by scouts, but these are often described in a broad - rather than specific - sense.Scouts indicate that they predict performance in a structured manner, but form their overall performance prediction on an intuitive integration of different performance attributes, which can be a suboptimal approach.
Collapse
|
|
4 |
19 |
10
|
Niessen ASM, Meijer RR, Tendeiro JN. Admission testing for higher education: A multi-cohort study on the validity of high-fidelity curriculum-sampling tests. PLoS One 2018; 13:e0198746. [PMID: 29889898 PMCID: PMC5995396 DOI: 10.1371/journal.pone.0198746] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2017] [Accepted: 05/24/2018] [Indexed: 11/18/2022] Open
Abstract
We investigated the validity of curriculum-sampling tests for admission to higher education in two studies. Curriculum-sampling tests mimic representative parts of an academic program to predict future academic achievement. In the first study, we investigated the predictive validity of a curriculum-sampling test for first year academic achievement across three cohorts of undergraduate psychology applicants and for academic achievement after three years in one cohort. We also studied the relationship between the test scores and enrollment decisions. In the second study, we examined the cognitive and noncognitive construct saturation of curriculum-sampling tests in a sample of psychology students. The curriculum-sampling tests showed high predictive validity for first year and third year academic achievement, mostly comparable to the predictive validity of high school GPA. In addition, curriculum-sampling test scores showed incremental validity over high school GPA. Applicants who scored low on the curriculum-sampling tests decided not to enroll in the program more often, indicating that curriculum-sampling admission tests may also promote self-selection. Contrary to expectations, the curriculum-sampling tests scores did not show any relationships with cognitive ability, but there were some indications for noncognitive saturation, mostly for perceived test competence. So, curriculum-sampling tests can serve as efficient admission tests that yield high predictive validity. Furthermore, when self-selection or student-program fit are major objectives of admission procedures, curriculum-sampling test may be preferred over or may be used in addition to high school GPA.
Collapse
|
|
7 |
18 |
11
|
Nienstedt JC, Buhmann C, Bihler M, Niessen A, Plaetke R, Gerloff C, Pflug C. Drooling is no early sign of dysphagia in Parkinson's disease. Neurogastroenterol Motil 2018; 30:e13259. [PMID: 29178420 DOI: 10.1111/nmo.13259] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/24/2017] [Accepted: 11/06/2017] [Indexed: 01/01/2023]
Abstract
BACKGROUND Dysphagia is frequent and clinically highly relevant in Parkinson's disease (PD). For a rational dysphagia screening predictors are required. Previous investigations suggested that drooling correlates with dysphagia and may serve as its early sign. The aim of this study was to clarify the interrelationship of drooling and dysphagia. METHODS In a controlled, cross-sectional, observational study, a total of 119 Parkinson outpatients and 32 controls were examined clinically and by flexible-endoscopic evaluation of swallowing (FEES). Drooling, dysphagia including retained pharyngeal secretions, and cognitive function were assessed by established evaluation scales. KEY RESULTS Fifty percent of all PD patients but only 9% of controls had drooling (P < .001). Drooling and dysphagia were related in PD (P = .027) but the data do not support to view drooling as a hallmark symptom for critical dysphagia. Thirty-nine percent of the patients with critical aspiration had no drooling. In contrast, 41% of the patients with severe drooling had no clinically relevant dysphagia in FEES. The oral, but not the pharyngeal secretion management was impaired in PD patients and there was no clear association between drooling and pharyngeal secretion accumulation. Cognitive impaired patients had significantly more drooling (P = .005). CONCLUSIONS & INFERENCES Although frequent in PD, drooling and dysphagia are only weakly related and drooling cannot be viewed as an early sign of dysphagia. Our data further suggest that the underlying cause of drooling is located in the voluntary oral phase, which is negatively influenced by cognitive deficits.
Collapse
|
Observational Study |
7 |
17 |
12
|
Bergkamp TLG, den Hartigh RJR, Frencken WGP, Niessen ASM, Meijer RR. The validity of small-sided games in predicting 11-vs-11 soccer game performance. PLoS One 2020; 15:e0239448. [PMID: 32956368 PMCID: PMC7505454 DOI: 10.1371/journal.pone.0239448] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Accepted: 09/07/2020] [Indexed: 11/30/2022] Open
Abstract
Predicting performance in soccer games has been a major focus within talent identification and development. Past research has mainly used performance levels, such as elite vs. non-elite players, as the performance to predict (i.e. the criterion). Moreover, these studies have mainly focused on isolated performance attributes as predictors of soccer performance levels. However, there has been an increasing interest in finer grained criterion measures of soccer performance, as well as representative assessments at the level of performance predictors. In this study, we first determined the degree to which 7-vs-7 small-sided games can be considered as representative of 11-vs-11 games. Second, we assessed the validity of individual players’ small-sided game performance in predicting their 11-vs-11 game performance on a continuous scale. Moreover, we explored the predictive validity for 11-vs-11 game performance of several physiological and motor tests in isolation. Sixty-three elite youth players of a professional soccer academy participated in 11 to 17 small-sided games and six 11-vs-11 soccer games. In-game performance indicators were assessed through notational analysis and combined into an overall offensive and defensive performance measure, based on their relationship with game success. Physiological and motor abilities were assessed using a sprint, endurance, and agility test. Results showed that the small-sided games were faster paced, but representative of 11-vs-11 games, with the exception of aerial duels. Furthermore, individual small-sided game performance yielded moderate predictive validities with 11-vs-11 game performance. In contrast, the physiological and motor tests yielded small to trivial relations with game performance. Altogether, this study provides novel insights into the application of representative soccer assessments and the use of continuous criterion measures of soccer performance.
Collapse
|
Research Support, Non-U.S. Gov't |
5 |
10 |
13
|
Niessen ASM, Meijer RR, Tendeiro JN. Applying organizational justice theory to admission into higher education: Admission from a student perspective. INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT 2017. [DOI: 10.1111/ijsa.12161] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
|
8 |
9 |
14
|
Bergkamp TLG, Niessen ASM, den Hartigh RJR, Frencken WGP, Meijer RR. Comment on: “Talent Identification in Sport: A Systematic Review”. Sports Med 2018; 48:1517-1519. [DOI: 10.1007/s40279-018-0868-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
|
7 |
9 |
15
|
Grotz W, Rump JA, Niessen A, Schmidt-Gayk H, Schollmeyer P. Treatment of bone pain after kidney transplantation. Transplant Proc 1998; 30:2114-6. [PMID: 9723410 DOI: 10.1016/s0041-1345(98)00557-0] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
Clinical Trial |
27 |
8 |
16
|
Neumann M, Niessen ASM, Meijer RR. Implementing evidence-based assessment and selection in organizations: A review and an agenda for future research. ORGANIZATIONAL PSYCHOLOGY REVIEW 2020. [DOI: 10.1177/2041386620983419] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In personnel- and educational selection, a substantial gap exists between research and practice, since evidence-based assessment instruments and decision-making procedures are underutilized. We provide an overview of studies that investigated interventions to encourage the use of evidence-based assessment methods, or factors related to their use. The most promising studies were grounded in self-determination theory. Training and autonomy in the design of evidence-based assessment methods were positively related to their use, while negative stakeholder perceptions decreased practitioners’ intentions to use evidence-based assessment methods. Use of evidence-based decision-making procedures was positively related to access to such procedures, information to use it, and autonomy over the procedure, but negatively related to receiving outcome feedback. A review of the professional selection literature showed that the implementation of evidence-based assessment was hardly discussed. We conclude with an agenda for future research on encouraging evidence-based assessment practice.
Collapse
|
|
5 |
6 |
17
|
Meijer RR, Neumann M, Hemker BT, Niessen ASM. A Tutorial on Mechanical Decision-Making for Personnel and Educational Selection. Front Psychol 2020; 10:3002. [PMID: 32038385 PMCID: PMC6990119 DOI: 10.3389/fpsyg.2019.03002] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2019] [Accepted: 12/18/2019] [Indexed: 11/13/2022] Open
Abstract
In decision-making, it is important not only to use the correct information but also to combine information in an optimal way. There are robust research findings that a mechanical combination of information for personnel and educational selection matches or outperforms a holistic combination of information. However, practitioners and policy makers seldom use mechanical combination for decision-making. One of the important conditions for scientific results to be used in practice and to be part of policy-making is that results are easily accessible. To increase the accessibility of mechanical judgment prediction procedures, we (1) explain in detail how mechanical combination procedures work, (2) provide examples to illustrate these procedures, and (3) discuss some limitations of mechanical decision-making.
Collapse
|
Journal Article |
5 |
6 |
18
|
Meijer RR, Niessen ASM. A trial studying approach to predict college achievement. Front Psychol 2015; 6:887. [PMID: 26175704 PMCID: PMC4485315 DOI: 10.3389/fpsyg.2015.00887] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2015] [Accepted: 06/15/2015] [Indexed: 11/13/2022] Open
Abstract
We argue that using trial studying is a reliable and valid way to select students for higher education. This method is based on a work sample approach often used in personnel selection contexts. We discuss that this method has predictive validity for study success, has high acceptance by stakeholders, and measures self-regulation in a high-stakes testing context that cannot be measured through self-report questionnaires. We suggest further research to implement this method to select students.
Collapse
|
Journal Article |
10 |
5 |
19
|
Neumann M, Hengeveld M, Niessen ASM, Tendeiro JN, Meijer RR. Education increases decision-rule use: An investigation of education and incentives to improve decision making. J Exp Psychol Appl 2021; 28:166-178. [PMID: 34138620 DOI: 10.1037/xap0000372] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Robust scientific evidence shows that human performance predictions are more valid when information is combined mechanically (with a decision rule) rather than holistically (in the decision-maker's mind). Yet, information is often combined holistically in practice. One reason is that decision makers lack the knowledge of evidence-based decision making. In a performance prediction task, we tested whether watching an educational video on evidence-based decision making increased decision-makers' use of a decision rule and their prediction accuracy immediately after the manipulation and a month later. Furthermore, we manipulated whether participants earned incentives for accurate predictions. Existing research showed that incentives decrease decision-rule use and prediction accuracy. We hypothesized that this is the case for decision makers who did not receive educational information about evidence-based decision making, but that incentives increase decision-rule use and prediction accuracy for participants who received educational information. Our results showed that educational information increased decision-rule use. This resulted in increased prediction accuracy, but only immediately after receiving the educational information. In contrast to the existing literature, incentives slightly increased decision-rule use. We did not find evidence that this effect was larger for educated participants. Providing decision makers with educational information may be effective to increase decision-rule use in practice. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
Journal Article |
4 |
3 |
20
|
Peringa IP, Niessen ASM, Meijer RR, den Hartigh RJR. A uniform approach for advancing athlete assessment: A tutorial on the Lens Model. PSYCHOLOGY OF SPORT AND EXERCISE 2024; 76:102732. [PMID: 39278579 DOI: 10.1016/j.psychsport.2024.102732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Revised: 08/30/2024] [Accepted: 09/05/2024] [Indexed: 09/18/2024]
Abstract
In athlete assessment, coaches or scouts typically judge athletes by observing and combining information about their attributes. However, how accurate is the expert's eye in combining this information, and can its accuracy be improved? To address these questions, this paper introduces the Lens Model, a framework for studying human judgment that has been widely successful in other performance domains. Since the framework offers both theoretical and practical benefits and is new to sports scientists and practitioners, our paper is presented in the form of a tutorial. First, we discuss the need for the Lens Model in sports; second, we demonstrate its proven value outside of sports. Third, we provide a conceptual explanation of the Lens Model, detailing, among other aspects, how experts' judgmental policies can be modeled and how judgmental accuracy can be determined and evaluated. This is followed by an empirical example: a study on the judgments of soccer scouts, along with suggestions to improve their accuracy. To inspire further Lens Model research across sports, we conclude with prospective research directions.
Collapse
|
|
1 |
|
21
|
Niessen ASM, Kausel EE, Neumann M. Using narratives and numbers in performance prediction: Attitudes, confidence, and validity. INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT 2021. [DOI: 10.1111/ijsa.12364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
|
4 |
|
22
|
Niessen ASM, Meijer RR. Zwick, R. (2017). Who Gets In? Strategies for Fair and Effective College Admissions. Cambridge, MA: Harvard University Press. JOURNAL OF EDUCATIONAL MEASUREMENT 2017. [DOI: 10.1111/jedm.12160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
|
8 |
|
23
|
Niessen ASM, Meijer RR. College Admissions, Diversity, and Performance-Based Assessment: Reply to Stemler (2017). PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2017; 12:452-453. [PMID: 28544859 DOI: 10.1177/1745691617693055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
Comment |
8 |
|
24
|
Neumann M, Niessen ASM, Meijer RR. Predicting decision-makers’ algorithm use. COMPUTERS IN HUMAN BEHAVIOR 2023. [DOI: 10.1016/j.chb.2023.107759] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
|
2 |
|
25
|
Neumann M, Niessen ASM, Hurks PPM, Meijer RR. Holistic and mechanical combination in psychological assessment: Why algorithms are underutilized and what is needed to increase their use. INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT 2023. [DOI: 10.1111/ijsa.12416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
|
|
2 |
|