Qualitative Sociologists Find Standard Randomness

Sociologists Sarah Babb, Lara Birk, and Luka Carfagna surveyed qualitative sociologists about their IRB experiences and heard many of the usual horror stories, from insistence on inappropriate consent forms to the dribbling out of concerns over several rounds of comments. Few of their respondents are happy with the present system, though getting the right people in key positions can help.

[Sarah Babb, Lara Birk, and Luka Carfagna, “Standard Bearers: Qualitative Sociologists’ Experiences with IRB Regulation,” American Sociologist, October 6, 2016, 1–17, doi:10.1007/s12108–016–9331-z. Note: I read a version of this article in manuscript and am so credited in the article.]

More failures of "local precedents"

Laura Stark’s 2012 book, Behind Closed Doors: IRBs and the Making of Ethical Research, devotes a chapter to what Stark calls “local precedents,” her term for “the past decisions that guide board members’ evaluations of subsequent research.” “By drawing on local precedent,” Stark claims, “board members can read new protocols as permutations of studies that they have previously debated and settled based on members’ warrants. The result is that IRBs tend to make decisions that are locally consistent over time.” (47)

But I keep getting stories about IRBs that are locally inconsistent.

Ethics of big data research are unsettled, and so are mechanisms

Sarah Zhang of WIRED uses the OKCupid data dump to explore the unsettled state of big data research ethics and mechanisms to promote them.

[Sarah Zhang, “Scientists Are Just as Confused About the Ethics of Big-Data Research as You,” WIRED, May 20, 2016.]

Texas A&M IRB Imposed Review for Surveys of Public Officials

In their contribution to the PS symposium, Kenneth Meiera and Apolonia Calderona complain of IRB interference in work that is clearly exempt or not even human subjects research.

[Kenneth J. Meier and M. Apolonia Calderon, “Goal Displacement and the Protection of Human Subjects: The View from Public Administration,” PS: Political Science & Politics 49, no. 02 (April 2016): 294–98, doi:10.1017/S1049096516000238.]

IRB Chair: "Nobody Really Knows" If IRBs Do Any Good

A former chair of the University of Wisconsin-Madison Education and Social/Behavioral Science IRB guesses that IRB review “most likely” protects subjects from harm, but concedes that “nobody really knows.” He also notes that it consumes tens of thousands of hours of work, mostly by researchers, at his university each year.

[Kenneth R. Mayer, “Working through the Unworkable? The View from Inside an Institutional Review Board,” PS: Political Science & Politics 49, no. 02 (April 2016): 289–93, doi:10.1017/S1049096516000226.]

Protecting He-Man Subjects

After frustrating encounters with IRBs concerning two research projects, sociologists Liberty Walther Barnes and Christin L. Munsch argue that “IRBs are gendered institutions in which members base their decisions on culturally dominant, normative images of women and men.”

[Liberty Walther Barnes and Christin L. Munsch, “The Paradoxical Privilege of Men and Masculinity in Institutional Review Boards,” Feminist Studies 41, no. 3 (2015): 594–622, doi:10.15767/feministstudies.41.3.594.]

NPRM: Escape for Many, Scant Relief for Those Left Behind

While the NPRM might do much to reduce the number of projects requiring IRB review, it would do little to improve the quality of review for those projects for which it is still required. This is a retreat from the more ambitious plans of the 2011 advance notice of proposed rulemaking.

[This post will be cross-posted to the Petrie-Flom Center's Bill of Health, which is conducting an online NPRM Symposium.]

Schrag Reviews Klitzman, Ethics Police?

Just in time for the NPRM comment period, Society has published my review of Robert Klitzman’s book, The Ethics Police?: The Struggle to Make Human Research Safe (New York: Oxford University Press, 2015). I note that “By offering the subjective worldview of IRB members, Klitzman shows how good intentions combine with ethical ineptitude to produce arbitrary decisions.”

Per my agreement with Springer, what follows is the accepted manuscript of the review. The final publication is available at Springer via http://dx.doi.org/10.1007/s12115–015–9935-x.

Klitzman Wants "Case Law." As Did Katz, 42 Years Ago

In an opinion piece drawn from his new book, The Ethics Police?, Robert Klitzman calls for IRB transparency and respect for precedent. That is a good idea, and one that should have been implemented decades ago.

[Robert Klitzman, “Who Polices the ‘Ethics Police’?,” CNN, May 26, 2015]

OHRP Inaction Leaves IRBs Reliant on Gut Feelings

Theresa Defino’s Report on Research Compliance describes an April 14 webcast by Robert Klitzman about his new book, The Ethics Police.

[“Books, Bioethics Panel Say OHRP Inaction Weakens Protection System, Thwarts Trials,” Report on Research Compliance, May 2015.]

Most of the excerpts from Klitzman concern the way that OHRP silence hampers IRBs:

When they reach out to OHRP for support, IRB officials reported getting nowhere. In the chapter titled, “Federal Agencies vs. Local IRBs,” Klitzman wrote that one chair told him, “Many times when you call for advice, they essentially just read back the regulations.”

One recounted waiting two years to hear from OHRP on changes it had made. When federal officials respond, “they often refrain from doing so in writing, or say that the clarification does not apply more generally,” Klitzman was told.

Without assurance that they are acting correctly, IRBs act arbitrarily:

IRB chairs and members, according to Klitzman, “relied on gut feelings, intuition, the sniff test. People wanted to feel comfortable….They wanted peace of mind” about the studies they approved. Decisions were influenced by “pet peeves” and the “prudishness” of IRB members and chairs. Some IRBs are “user-friendly” or “pro-research,” he said.

In truth, such arbitrariness serves neither researchers nor research participants. Defino quotes Alice Dreger’s new book Galileo’s Middle Finger, which argues that “in practice, protections for people who become subjects of medical research may be their weakest in decades.”

The IRB system is premised on the notion that, at times, researchers and subjects have competing interests. Thanks to OHRP, they also have a common enemy.

IRB Asked, USB or FireWire. Silly, but Is It Bullying?

Caleb Carr, assistant professor of communication at Illinois State University, argues that abusive IRBs are best thought of as bullies.

Though IRBs are a legally required element of many higher education institutions and an important ethical part of all, their overextension of unchecked power is creating a hostile work environment for many social scientists, and calling them for what they are – systemic bullies – can empower administrators and faculties to finally respond to the increasing calls for IRB reform.

[Carr, Caleb T. “Spotlight on Ethics: Institutional Review Boards as Systemic Bullies.” Journal of Higher Education Policy and Management 37 (2015): 1–16. doi:10.1080/1360080X.2014.991530.]

Horror Story Buffet

We end the year with two collections of IRB horror stories.

[Varma, R. “Questioning Professional Autonomy in Qualitative Inquiry.” IEEE Technology and Society Magazine 33, no. 4 (winter 2014): 57–64. doi:10.1109/MTS.2014.2363983; Glenda Droogsma Musoba, Stacy A. Jacob, and Leslie J. Robinson, The Institutional Review Board (IRB) and Faculty: Does the IRB Challenge Faculty Professionalism in the Social Sciences? Qualitative Report 19 (2014), Article 101, 1-14, http://www.nova.edu/ssss/QR/QR19/musoba101.pdf]

University of Washington IRB Demanded Dangerous Consent Form

The recent Nature story on ethics consultancies includes an example of counterproductive interference by an intransigent IRB.

[Dolgin, Elie. “Human-Subjects Research: The Ethics Squad.” Nature 514, no. 7523 (October 21, 2014): 418–20. doi:10.1038/514418a.]

Most IRB Chairs Can't Recognize Exempt Research or Non-Research

A study of criminal justice researchers' knowledge of IRB rules has found that IRB chairs can't agree on what makes a project exempt from review and think that IRB review is needed for public records. The authors of the study, one of whom is an IRB chair, seem not to realize the significance of these findings.

[Tartaro, Christine, and Marissa P. Levy. "Criminal Justice Professionals' Knowledge of Institutional Review Boards (IRBs) and Compliance with IRB Protocol." Journal of Criminal Justice Education 25, no. 3 (2014): 321–41. doi:10.1080/10511253.2014.902982.]

IRB Still Isn't Peer Review

A bit off-topic here (this is a health-related study), but here's an illustration of the benefits of IRB shopping.

[Cordner, Alissa, and Phil Brown. “Moments of Uncertainty: Ethical Considerations and Emerging Contaminants.” Sociological Forum 28, no. 3 (September 2013): 469–94. doi:10.1111/socf.12034.]

NRC Report: Assess Risk Empirically

One theme running throughout the NRC report is the need to replace the worthless gut reactions decried by Ezekiel Emanuel with a system that would base its judgments on the latest empirical evidence. But the report does not present a clear set of reforms that would effect this change without scrapping the current system of local IRB review.

Armchairs vs. Evidence in the Journal of Law, Medicine & Ethics

Last week I promised some comments on the Winter 2012 issue of the Journal of Law, Medicine & Ethics, which features a symposium entitled "Research Ethics: Reexamining Key Concerns."

The contributions reinforced my sense that the IRB debate is in part a contest between evidence-based approaches and armchair ethics.

Law Professor Decries, Ponders IRB Variability

Christopher Robertson, associate professor at the James E. Rogers College of Law, University of Arizona, laments the variation in IRB policies and practices from one institution to another and sees it as an opportunity for research.

[Christopher Robertson, "Variability in Local IRB Regulation: A Gold Mine for Future Research," Bill of Health, November 24, 2012. http://blogs.law.harvard.edu/billofhealth/2012/11/24/variability-in-local-irb-regulation-a-gold-mine-for-future-research.]

"Community Members" Play Murky Roles

Robert Klitzman continues to publish findings from his 2007-2009 series of interviews with 46 IRB chairs, directors, administrators, and members. In an Academic Medicine article, he finds that IRBs' "community members" struggle because their "roles can be murky."

Robert Klitzman, "Institutional Review Board Community Members," Academic Medicine 87 (July 2012), doi: 10.1097/ACM.0b013e3182578b54, post author corrections version, 22 May 2012.]

Minimal Risk Approval: 27 months, $170,000

A team of health services researchers found that getting approval for a minimal risk study took 27 months and consumed $170,000 in staff time.

[Laura A. Petersen, Kate Simpson, Richard SoRelle, Tracy Urech, and Supicha Sookanan Chitwood, "How Variability in the Institutional Review Board Review Process Affects Minimal-Risk Multisite Health Services Research," Annals of Internal Medicine 156, no. 10 (May 15, 2012): 728–735. h/t Human Subject News.]