-
Sep 30, 2024 | 
digitalcommons.library.tmc.edu | Ziyi Li |Yijian Huang |Dattatraya Patil |Mark A. Rubin
AbstractDiagnostic tests usually need to operate at a high sensitivity or specificity level in practice. Accordingly, specificity at the controlled sensitivity, or vice versa, is a clinically sensible performance metric for evaluating continuous biomarkers. Meanwhile, the performance of a biomarker may vary across sub-populations as defined by covariates, and covariate-specific evaluation can be informative.
-
Sep 24, 2024 | 
cardinalnews.org | Mark A. Rubin
This is part of our Cardinal Way project on promoting civil discussions. Everyone says they want to lower the temperature of our public discourse. Yet, no one seems to know how to work the thermostat. Mediators know a little about lowering the temperature of disputes. They resolve conflicts by acting as third party neutrals with no decision-making authority, lowering the temperature. Here are a few tricks of the trade. The distinction between arguing and fighting is important.
-
Sep 7, 2024 | 
markrubin.substack.com | Mark A. Rubin
Previous justifications for preregistration have focused on the distinction between “exploratory” and “confirmatory” research. However, as I discuss in this recent presentation, this distinction faces unresolved questions. For example, the distinction does not appear to have a formal definition in either statistical theory or the philosophy of science.
-
May 22, 2024 | 
journals.sagepub.com | Béatrice Sternberg |Amanda Sesko |Mark A. Rubin |Constantina Badea
Get full access to this articleView all access and purchase options for this article. ReferencesAbbey J. D., Meloy M. G. (2017). Attention by design: Using attention checks to detect inattentive respondents and improve data quality. Journal of Operations Management, 53–56(1), 63–70. https://doi.org/10.1016/j.jom.2017.06.001Bushman B. J., Bonacci A. M. (2004). You’ve got mail: Using e-mail to examine the effect of prejudiced attitudes on discrimination against Arabs.
-
May 11, 2024 | 
markrubin.substack.com | Mark A. Rubin
Sabina Leonelli’s new book – “Philosophy of Open Science” – will be published later this year. However, there is an open access preprint available on the PhilSci Archive here. In the book, Leonelli provides “a constructively critical reading” of the standard approach to open science which, she argues, is focused on sharing “objects” such as data and materials. In Leonelli’s view, this object-sharing approach has become an obstacle to promoting open science.
-
May 11, 2024 | 
markrubin.substack.com | Mark A. Rubin
Tom Hostler has just published an article titled “The invisible workload of open research” in the Journal of Trial and Error’s special issue on the “Consequences of the scientific reform movement: Is the scientific reform movement headed in the right direction?” It’s an insightful and thought-provoking piece that uncovers the potential workload costs of open research, considers why these costs may be ignored by university management, and makes some useful recommendations for moving forward.
-
May 11, 2024 | 
markrubin.substack.com | Mark A. Rubin
In this new article, I consider questionable research practices in the field of metascience. A questionable metascience practice (QMP) is a research practice, assumption, or perspective that’s been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. I discuss 10 QMPs that relate to criticism, replication, bias, generalization, and the characterization of science.
-
May 11, 2024 | 
markrubin.substack.com | Mark A. Rubin
The December 2022 issue of the journal Industrial and Organizational Psychology includes a very interesting discussion of the pros and cons of open science. There’s a target article titled “Open science, closed doors: The perils and potential of open science for research in practice” (Guzzo et al., 2022) and nine commentaries on this article. You can find all 10 papers here.
-
May 11, 2024 | 
markrubin.substack.com | Mark A. Rubin
I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process. In particular, I consider his evidence that researchers’ discretion over research decisions is unavoidable when they follow research plans that are either overdetermined (i.e., too prescriptive) or underdetermined (i.e., too vague).
-
May 11, 2024 | 
markrubin.substack.com | Mark A. Rubin
Felipe Romero presented his work - “The conceptual origins of metascience: Fashion or revolution?” - in The Popper Seminar at the London School of Economics on 30th May 2023. Here, I highlight a few points that he raised and provide some comments along the way. Metascience is often described as the “science of science.” However, as Peterson and Panofsky (2023) recently observed, contemporary metascience is something more than this.
