Guidelines for Science: Evidence and Checklists

Loading...
Thumbnail Image
Penn collection
Marketing Papers
Degree type
Discipline
Subject
advocacy
econometrics
evidence - based checklists
experiments
multiple hypotheses
objectivity
reg ression analysis
replication
statistical significance
Business
Econometrics
Marketing
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Green, Kesten C
Contributor
Abstract

Problem: The scientific method is unrivalled as a basis for generating useful knowledge, yet research papers published in management, economics, and other social sciences fields often ignore scientific principles. What, then, can be done to increase the publication of useful scientific papers? Methods: Evidence on researchers’ compliance with scientific principles was examined. Guidelines aimed at reducing violations were then derived from established definitions of the scientific method. Findings: Violations of the principles of science are encouraged by: (a) funding for advocacy research; (b) regulations that limit what research is permitted, how it must be designed, and what must be reported; (c) political suppression of scientists’ speech; (d) universities’ use of invalid criteria to evaluate research—such as grant money and counting of publications without regard to usefulness; (e) journals’ use of invalid criteria for deciding which papers to publish—such as the use of statistical significance tests. Solutions: We created a checklist of 24 evidence-based operational guidelines to help researchers comply with scientific principles (valid inputs). Based on the definition of science, we then developed a checklist of seven criteria to evaluate whether a research paper provides useful scientific findings (valuable outputs). That checklist can be used by researchers, funders, courts, legislators, regulators, employers, reviewers, and journals. Originality: This paper provides the first comprehensive evidence-based checklists of operational guidelines for conducting scientific research and for evaluating the scientific quality and usefulness of research efforts. Usefulness: Journals could increase the publication of useful papers by including a section committed to publishing all relevant and useful papers that comply with science. By using the Criteria for Useful Science checklist, those who support science could more effectively evaluate the contributions of scientists.

Advisor
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Publication date
2017-01-24
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation
Collection