Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

This study explores how researchers' analytical choices affect the reliability of scientific findings. Most discussions of reliability problems in science focus on systematic biases. We broaden the lens to emphasize the idiosyncrasy of conscious and unconscious decisions that researchers make during data analysis. We coordinated 161 researchers in 73 research teams and observed their research decisions as they used the same data to independently test the same prominent social science hypothesis: that greater immigration reduces support for social policies among the public. In this typical case of social science research, research teams reported both widely diverging numerical findings and substantive conclusions despite identical start conditions. Researchers' expertise, prior beliefs, and expectations barely predict the wide variation in research outcomes. More than 95% of the total variance in numerical results remains unexplained even after qualitative coding of all identifiable decisions in each team's workflow. This reveals a universe of uncertainty that remains hidden when considering a single study in isolation. The idiosyncratic nature of how researchers' results and conclusions varied is a previously underappreciated explanation for why many scientific hypotheses remain contested. These results call for greater epistemic humility and clarity in reporting scientific findings.

Static space requirements of male meat turkeys

The area covered by standing male meat turkeys between 11 and 21 weeks of age was measured by planimetry on photographs taken from directly above the birds. There was a strong relationship (r = 0.86) between their liveweight and the area covered, and a formula was derived for the calculation of the area covered by turkeys weighing between 7.6 and 21.8 kg. A comparison with the formula developed on theoretical grounds in 1995 by the Farm Animal Welfare Council (FAWC) showed that for heavy turkeys the FAWC formula is not valid, because it yields values which are about 50 per cent too low.

[CO2-stunning of slaughter pigs: effects on EEG, catecholamines and clinical reflexes]

Investigations were carried out on the response of slaughter pigs to CO2 stunning with two different gas concentrations (80 vol%, 90 vol%, 73 s) under practical conditions in a one gondola-dip-lift system. EEG measurements were performed and blood constituents such as catecholamines (adrenaline, nor-adrenaline) and lactate as well as clinical reactions (nasal septum and corneal reflex, heart beats) investigated. Special EEG-electrodes were adapted for the measurement on pigs and a mobile data logger was prepared for the use in the lairage of the slaughter house and in the stunning unit. The CO2 concentrations were measured continuously close to the head of the pigs when transported up and down in the stunning gondola. The results show that the technique is suited to monitor the effects of different CO2 gas concentrations on the EEG of the pigs under practical conditions. There is strong evidence that CO2 concentrations of 80 vol% applied over 70 s as required by law are not sufficient to stun pigs properly. A large part of the animals still showed typical reflexes when leaving the stunning pit. When an atmosphere of 90 vol% CO2 is applied, most animals are already dead before bleeding commences. This may create problems in respect to meat hygiene. The blood analysis revealed very high concentrations of catecholamines after stunning. The values for adrenaline and nor-adrenaline in the sticking blood rose by a factor of about 1000 as compared to the concentrations in blood samples taken in the lairage before stunning. It seems necessary to revise the current legislation on gas stunning and to look in greater detail in the effects of CO2 stunning on the welfare of slaughter pigs.