Showing posts with label qualitative. Show all posts
Showing posts with label qualitative. Show all posts

Monday, October 31, 2016

Qualitative Sociologists Find Standard Randomness

Sociologists Sarah Babb, Lara Birk, and Luka Carfagna surveyed qualitative sociologists about their IRB experiences and heard many of the usual horror stories, from insistence on inappropriate consent forms to the dribbling out of concerns over several rounds of comments. Few of their respondents are happy with the present system, though getting the right people in key positions can help.


[Sarah Babb, Lara Birk, and Luka Carfagna, “Standard Bearers: Qualitative Sociologists’ Experiences with IRB Regulation,” American Sociologist, October 6, 2016, 1–17, doi:10.1007/s12108–016–9331-z. Note: I read a version of this article in manuscript and am so credited in the article.]


Wednesday, December 31, 2014

Horror Story Buffet

We end the year with two collections of IRB horror stories.

[Varma, R. “Questioning Professional Autonomy in Qualitative Inquiry.” IEEE Technology and Society Magazine 33, no. 4 (winter 2014): 57–64. doi:10.1109/MTS.2014.2363983; Glenda Droogsma Musoba, Stacy A. Jacob, and Leslie J. Robinson, The Institutional Review Board (IRB) and Faculty: Does the IRB Challenge Faculty Professionalism in the Social Sciences? Qualitative Report 19 (2014), Article 101, 1-14, http://www.nova.edu/ssss/QR/QR19/musoba101.pdf]

Friday, July 11, 2014

A Reply to Maxine Robertson

In an essay in Research Ethics, Maxine Robertson, Professor of Innovation and Organisation at Queen Mary University of London (QMUL), responds to my essay, "The case against ethics review in the social sciences," published in the same journal in 2011. I wish she had responded to more of the broader ethics-review critique and offered more details about ethics review at her own institution.

[Robertson, Maxine. “The Case for Ethics Review in the Social Sciences: Drawing from Practice at Queen Mary University of London.” Research Ethics 10, no. 2 (June 2014): 69–76. doi:10.1177/1747016113511177]

Tuesday, June 17, 2014

TCPS Envy

How good is TCPS2, Canada's current framework of research regulation?

Martin Tolich, with co-authors, thinks it's pretty good. He suggests that at the very least, it can serve as a starting point for other countries interested in reforming their systems of research ethics oversight to make them more responsive to the concerns of social scientists and the people they study.

[Tolich, M, and BP Smith. “Evolving Ethics envy—New Zealand Sociologists Reading the Canadian Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans.” Kōtuitui: New Zealand Journal of Social Sciences Online 9, no. 1 (2014): 1–10. doi:10.1080/1177083X.2013.867513; Hoonaard, Will C. van den, and Martin Tolich. “The New Brunswick Declaration of Research Ethics: A Simple and Radical Perspective.” Canadian Journal of Sociology 39, no. 1 (March 31, 2014): 87 – 98]

Thursday, December 13, 2012

Northeastern U. IRB Makes Sex Research Untenable

Carey Noland, associate professor of communcation studies at Northeastern University, complains that "many IRBs . . . seem to have difficulty accurately assessing the potential harm involved with qualitative research on sex."

[Carey M. Noland, “Institutional Barriers to Research on Sensitive Topics: Case of Sex Communication Research Among University Students.” Journal of Research Practice 8, no. 1 (November 24, 2012): Article M2, http://jrp.icaap.org/index.php/jrp/article/view/332/262]

Thursday, May 3, 2012

Qualitative Sociology Ventures Beyond the IRB

Back in December, as I was still dealing with a crush of ANPRM-related reading, I mentioned that the journal Qualitative Sociology had published a special issue on "Ethics Beyond the IRB". I have finally found some time to read the intriguing essays it contains.

Friday, February 4, 2011

Cautious Optimism on Canada's TCPS2

Ted Palys and John Lowman of the School of Criminology, Simon Fraser University, find that the second edition of Canada's Tri-Council Policy Statement (TCPS2), released in December 2010, offers significant improvements over the first edition of 1998.

[Ted Palys and John Lowman, "What's Been Did and What's Been Hid: Reflections on TCPS2," 18 January 2011]

Wednesday, December 22, 2010

First, Do Some Harm, Part I: Denzin's Qualitative Manifesto

Three recent documents demonstrate the confusion that arises when people try to apply medical ethics to non-medical fields. I will describe them in individual entries.

In June 2010, Norman Denzin, Research Professor of Communications at the University of Illinois at Urbana-Champaign, published The Qualitative Manifesto: A Call to Arms (Left Coast Press). Chapter five seeks


to outline a code of ethics, a set of ethical principles for the global community of qualitative researchers. I want a large tent, one that extends across disciplines and professions, from anthropologists to archeologists, sociologists to social workers, health care to education, communications to history, performance studies to queer and disability studies.


Part of the impetus for this effort is Denzin's recognition that IRB guidelines may not match "guidelines grounded in human rights, social justice considerations" or disciplinary codes. He is familiar with the debate concerning IRBs, having read the Illinois White Paper, the AAUP reports, and "even a humanities and IRB blog where complaints are aired."

Denzin is also familiar with oral historians' concerns that IRBs impose inappropriate requirements, as well as statements of ethics from other qualititative researchers. He seeks to synthesize what he has learned in a footnoted dialogue, part of a "one-act play" entitled "Ethical Practices":


SCENE FOUR: Oral Historians

. . .

Speaker Two:: We do not want IRBs constraining critical inquiry, or our ethical conduct. Our commitment to professional integrity requires awareness of one's own biases and a readiness to follow a story, wherever it may lead. We are committed to telling the truth, even when it may harm people (Shopes, 2007a, p.4).

Speaker One:: When publishing about other people, my ethics require that I subject my writing to a fine-mesh filter: do no harm (Richardson, 2007, p. 170).

Speaker Two:: So there we have it. A set of methodological guidelines. (83)


No. What we have is a debate between Linda Shopes, a historian, and Laurel Richardson, a sociologist, about the ethical responsibility of an interviewer to a narrator. Their perspectives reflect important differences between their professions. They also refelct the particulars of the book in which Richardson's statement appears, an account of the last months of a dying friend--hardly the typical oral history or sociological study.

Denzin turns a blind eye to this debate, instead seeming to endorse both sides. In the play, Speaker Two states that "Beneficience, do no harm, is challenged in the oral history interview, for interviews may discuss painful topics, and they [sic] have the right to walk away at any time." That seems to endorse Shopes's position. But they book closes with a proposed ethical code that leans toward Richardson, calling on all qualitative researchers to "strive to never do harm." (122)

How can Denzin read and reprint historians' arguments, then reject them without even realizing he is doing so? Is the historians' position so hard to understand? Or is the lure of innocuity so powerful?

Monday, March 15, 2010

Sociologists Split on Ethics Review

Two researchers from the University of Toronto find Canadian qualitative sociologists divided in their responses to research ethics boards.

[Judith Taylor and Matthew Patterson, "Autonomy and Compliance: How Qualitative Sociologists Respond to Institutional Ethical Oversight," Qualitative Sociology, published online 23 February 2010, DOI: 10.1007/s11133-010-9148-y]

Three Ethics Orientations



Judith Taylor and Matthew Patterson interviewed one qualitative sociologist from each of 21 of Canada's 22 PhD-granting sociology departments. They found that respondents fell into three general groups of "ethics orientations," which they characterize as "active engagement, apparent accommodation, [and] overt opposition."

The angriest sociologists are "overt opposers" who "passionately defend unencumbered intellectual pursuit, sociological traditions of inquiry, experiments and innovations in inquiry, the primacy of sociological understandings of ethics, faculty discretion, and critical or autonomous sociology. Such scholars see institutional ethical review as putting intellectually-credible human-based sociology and academic freedom in peril, threatening the nature and legacy of the discipline of sociology and the job of sociologists." Faced with IRB/REB requirements, they do whatever they can to resist, even deceiving the boards when necessary.

At the other extreme, "active engagers believe regulators and practitioners can collectively manage conflicts by working together as virtual peers within the same committees and institutional settings." They welcome ethics review and may even serve on boards themselves.

In the middle, "apparent accommodators accept the necessity of ethics regulation, but fret over the practical implications of these regulations for their research and teaching." This is the largest group, comprising ten of the 21 responses, with six opposers and five engagers making up the rest. As the authors note, this split means that while three-quarters of sociologists think ethics review is necessary, two-thirds of those are also engaged in "some form of resistance toward ethical oversight."

Though Taylor and Patterson "argue that the ways in which academics understand and act toward ethical oversight is far more complex and variable than is represented in the current literature," the range of responses they report closely resembles the range of viewpoints I have reported on this blog and in my forthcoming book. For example, "Communication Scholars’ Narratives of IRB Experiences," Journal of Applied Communication Research 33 (August 2005): 204-230, are not broken down into categories, but they express views quite similar to those found here.

Where You Stand Depends on Where You Sit



More intriguing are Taylor and Patterson's explanations of why scholars think as they do. They attribute viewpoints to scholars' age and status, noting that "Overt opposition tends to be exhibited mostly by senior men in the discipline who began teaching in the 1970s or 1980s, although some senior women are also opposers. Overt opposers also tend to hold appointments at the most research-intensive and elite institutions." The more tolerant apparent accommodators "tend to be mid-career scholars at research-intensive institutions who share their oppositional colleagues’ analyses while also internalizing blame for the transgressions of their predecessors." And active engagers "tend to be younger, untenured women faculty with less than a decade of teaching experience, holding positions at less research-intensive universities."

Taylor and Patterson suggest that as the youngest cohort, the engagers will inherit sociology. "As the generation of opposers retires and engagers increase in prevalence and power, the range of available orientations and methodological approaches may markedly narrow, with possible effects on the production of sociological knowledge."

A Liberal Is a Conservative Who Has Been Arrested



Another possibility, however, is that attitudes toward ethics boards reflect knowledge gained from reading and experience. Direct experience with ethics boards breeds skepticism. Only one respondent is quoted as having direct knowledge of sensible advice dispensed by an ethics committee: the suggestion of a "graduated consent form." But many faced inappropriate demands by ethics boards, either regarding their own research or that of their students. As the authors note, when accommodators "sense that those reviewing their ethics protocols do not share [their] understanding of sociology, they lose faith in the ethics review process." One or two incidents of "decisive trespass" may be forgiven. But the reality of ethics review eventually may wear out their trust.

The only thing that keeps these frustrated accommodators from becoming opposers is their belief that "a history of ethical violation" by sociologists "prevents them from more outwardly opposing their boards." I would be curious to know just what the respondents believed about the history of their discipline, and how they had come to those beliefs. Do they get their history from historians, from sociologists, or from ethics boards?

If attitudes toward ethics boards are shaped by experience, rather than status, then opposition may not fade as today's opposers retire. Graduate students may enter the profession as idealistic engagers. But as they pursue their careers, the missteps of ethics committees (and perhaps a better grasp of history) could drive them into the camps of accommodation, then opposition. Today's engagers may be tomorrow's accommodators, and today's mid-career accommodators could be tomorrow's senior opposers.

Tuesday, July 28, 2009

A Defense of RECs

Professor Adam Hedgecoe of Cardiff University kindly pointed me to his article, "Research Ethics Review and the Sociological Research Relationship," Sociology 42 (2008): 873-886.

The article is a response to longstanding criticisms of British research ethics committees (RECs), especially those affiliated with the National Health Service (NHS). For example, Sue Richardson and Miriam McMullan surveyed "UK academic social researchers working in Health, or health services researchers, who had experience of using the NHS research ethics process prior to March 2004," in "Research Ethics in the UK: What Can Sociology Learn from Health?," Sociology 41 (2007): 1115-1132. Fifty-one percent of their respondents reported degrading their research design as a result of the committee approval process, while only 32 percent reported making changes for the better. Overall, 59 percent offered negative comments, while only 15 percent offered positive comments. And Richardson and McMullan set a pretty low bar for a positive comment, counting this: "It’s a lot of paperwork but once you know what is required, it’s acceptable." Overall, it seems, NHS RECs are inhibiting the sociological study of health care in the United Kingdom.

Hedgecoe seeks to rebut this impression, based on his observation of three NHS RECs in 2005 and 2006, and some follow-up interviews. He argues that "NHS RECs are not inherently hostile to social science research, especially qualitative research." (882) The double-negative construction of that thesis suggests Hedgecoe's problem: he's trying to prove that something doesn't happen, or at least not as often as ethics-committee critics believe. That's not an easy task, and I congratulate him for trying. But I find the article unpersuasive.

Friday, June 13, 2008

IRB Disciplines and Punishes a Qualitative Researcher

Tara Star Johnson reports her experiences in "Qualitative Research in Question: A Narrative of Disciplinary Power With/in the IRB," Qualitative Inquiry 14 (March 2008): 212-232.

Johnson left teaching high school to pursue a PhD in Language Education at the University of Georgia. As she completed her preparatory work, she found "no qualitative studies investigating the phenomenon of sexual dynamics in the classroom." She decided, for her dissertation work, "to address this void in educational research through in-depth interviewing of teachers who have experienced desire for and/or from students to trace how these attractions happen and open the door for dialogue about embodiment, desire, and sexuality in education." Her professors were encouraging, and her advisor accompanied her to her appointment with the IRB.

After waiting an hour and a half beyond their scheduled appointment, Johnson and her advisor finally met with about twenty members of the IRB. The chair listed several restrictions, which Johnson found disappointing, but "not unreasonable or completely unexpected." Then the fun began.