Publication Bias in the Computer Science Education Research Literature

Abstract: Publication bias is the tendency for investigations with primarily nonstatistically significant findings to be withheld from the research record. Because publication bias has serious negative consequences for research and practice, we gathered information about the prevalence and predictors of publication bias in the computer science education literature. From an initial random sample of 352 recent computer science education articles, we reviewed the 38 empirical articles that used inferential statistical analyses. We found that (a) the proportion of articles reporting primarily statistically significant findings in computer science education was very similar to the proportion in medical research, (b) that an article's having a female first author was a strong predictor of an article's having primarily statistically significant results, and (c) that there was a tendency for authors to emphasize statistically significant findings and deemphasize nonstatistically sign...

• Type: Journal
• Year: 2008
• Where: JUCS
• Authors: Justus J. Randolph, Roman Bednarik
• Keywords: Computer Science Education, JUCS 2008, Publication Bias, Significant Findings