I KNOW THAT YOU HARKED LAST SUMMER (30 August 2023)

Description

Summer is over, all wine is consumed, and all vegetables harvested. Time for this IS research to get back to work. We kick off the new season by talking about questionable research practices – HARKing, p-hacking, fishing for asterisks, data dredging, and so on. Nick digs out an old paper Jan wrote, and we use it to discuss the situations in which HARKing might be commonsense or outright unethical and we try to identify how best to protect against questionable research practices.

Episode Reading List

  • Ho, S. Y., Recker, J., Tan, C.-W., Vance, A., & Zhang, H. (2023). MISQ Special Issue on Registered Reports. https://misq.umn.edu/call_for_papers/registered-reports.
  • Miranda, S. M., Berente, N., Seidel, S., Safadi, H., & Burton-Jones, A. (2022). Computationally Intensive Theory Construction: A Primer for Authors and Reviewers. MIS Quarterly, 46(2), i-xvi.
  • Andrade, C. (2021). HARKing, Cherry-Picking, P-Hacking, Fishing Expeditions, and Data Dredging and Mining as Questionable Research Practices. Journal of Clinical Psychiatry, 82(1), 20f13804.
  • Mertens, W., & Recker, J. (2020). New Guidelines for Null Hypothesis Significance Testing in Hypothetico-Deductive IS Research. Journal of the Association for Information Systems,21(4), 1072-1102.
  • Figl, K., & Recker, J. (2016). Process Innovation as Creative Problem-Solving: An Experimental Study of Textual Descriptions and Diagrams. Information & Management, 53(6), 767-786.
  • Grover, V., & Lyytinen, K. (2015). New State of Play in Information Systems Research: The Push to the Edges. MIS Quarterly, 39(2), 271-296.
  • Greenwood, B. N., & Wattal, S. (2017). Show Me the Way to Go Home: An Empirical Investigation of Ride-Sharing and Alcohol Related Motor Vehicle Fatalities. MIS Quarterly, 41(1), 163-187.
  • Edwards, J. R., & Berry, J. W. (2010). The Presence of Something or the Absence of Nothing: Increasing Theoretical Precision in Management Research. Organizational Research Methods, 13(4), 668-689.
  • Wasserstein, R. L., Schirm, A. L., & Lazar, N. A. (2019). Moving to a World Beyond “p < 0.05″. The American Statistician, 73(sup1), 1-19.
  • Lee, J., & Berente, N. (2012). Digital Innovation and the Division of Innovative Labor: Digital Controls in the Automotive Industry. Organization Science, 23(5), 1428-1447.
  • Lindberg, A., Schecter, A., Berente, N., Hennel, P., & Lyytinen, K. (2023). The Entrainment of Task Allocation and Release Cycles in Open Source Software Development. MIS Quarterly, doi:10.25300/MISQ/2023/16789.
  • Burton-Jones, A., Boh, W., Oborn, E., & Padmanabhan, B. (2021). Advancing Research Transparency at MIS Quarterly: A Pluralistic Approach. MIS Quarterly, 45(2), iii-xviii.
  • Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015). Understanding Algorithm Aversion: Forecasters Erroneously Avoid Algorithms After Seeing them Err. Journal of Experimental Psychology: General, 144(1), 114-126.
  • Logg, J., Minson, J., & Moore, D. A. (2019). Algorithm Appreciation: People Prefer Algorithmic To Human Judgment. Organizational Behavior and Human Decision Processes, 151, 90-103.

The Home Page of Professor Jan Recker