Showing posts with label behavioral. Show all posts
Showing posts with label behavioral. Show all posts

Wednesday, May 27, 2015

A/B ≠ A&B

A/B testing is the comparison of two products by providing each, simultaneously, to two randomly selected groups. As Michelle Meyer notes, the practice is less ethically suspect than a common alternative: imposing a new product on all of one’s customers without first testing it.


A&B is an abbreviation for assault and battery. Depending on the jurisdiction, the two may be a single crime or distinct crimes, but everywhere A&B is unlawful.


Law professor James Grimmelmann has confused the two:


Suppose that Professor Cranium at Stonewall University wants to find out whether people bleed when hit in the head with bricks, but doesn’t want to bother with the pesky IRB and its concern for “safety” and “ethics.” So Cranium calls up a friend at Brickbook, which actually throws the bricks at people, and the two of them write a paper together describing the results. Professor Cranium has successfully laundered his research through Brickbook, cutting his own IRB out of the loop. This, I submit, is Not Good.


IRBs for everyone, or you get hit with a brick. I suggest that this parade of horribles is missing its elephant. Blame the IACUC?


Anyway, thanks for the link.


ETA(2:18PM): I originally linked to the wrong Meyer paper. Of course, that one's worth reading too.

Tuesday, July 8, 2014

Computer Scientist: Informed Consent is the Wrong Metaphor

Michael Bernstein, assistant professor of computer science at Stanford and a former postdoctoral scholar on Facebook’s Data Science team, argues that "Hammering ethical protocols designed for laboratory studies onto internet experimentation is fundamentally misguided."

[Bernstein, Michael. “The Destructive Silence of Social Computing Researchers.” Medium, July 7, 2014. https://medium.com/@msbernst/9155cdff659.]

Monday, March 25, 2013

Report from the National Academies Workshop

Last week I attended the Revisions to the “Common Rule” in Relation to Behavioral and Social Sciences Workshop sponsored by the National Academies.

I live-tweeted the event on my @IRBblog account, and I have collected those tweets on Storify.

What follows are what I consider some of the key messages from selected presenters. The statements following each name represent my summary of the remarks, not necessarily a quotation or paraphrase.

Wednesday, October 5, 2011

What is Behavioral Research?

An anonymous comment on an earlier post asks, "Could you clarify the difference between behavioral science and social science?"

Robert Veatch stated the basic problem in his 1973 testimony to the House Subcommittee on Public Health and Environment:

If the proposal before us is an act for the protection of human subjects of biomedical and behavioral research, it is crucial to have a clear understanding of what constitutes "behavioral research." I note that in the definitions (sec. 1213) the term is nowhere defined. It may have two meanings. To many social scientists it will have a rather limited meaning--research in behaviorist psychology--while to the layman it may mean more broadly any research to study human behavior including all social scientific investigation. It is my hope that the intent of the bill is to use the latter meaning. If not, the act may be considerably less inclusive in application than the present HEW guidelines, which clearly are meant to apply to all social scientific research (in which subjects are 'at risk). To leave such ambiguity is a tragedy.

[U.S. House of Representatives, Biomedical Research Ethics and the Protection of Human Research Subjects: Hearings before the Subcommittee on Public Health and Environment of the House Committee on Interstate and Foreign Commerce (93d Cong., 1st sess., 1973), 240]

Veatch was right about the tragic ambiguity of the statute. But I do not think he was right about the laymen's understanding of behavioral research, at least if laymen are to include congressmen and senators. As the secretary of HEW noted in 1976, "The types of risk situations against which the regulations were designed to protect are suggested by the areas of concern which were addressed in the legislative hearings held in conjunction with the enactment of section 474 of the Public Health Service Act, 42 U.S.C. 289l-3 (added by Pub. L. No. 93-343) . . ."

Congress took almost no testimony about social science (e.g., it did not invite Laud Humphreys to testify), and nothing resembling testimony about the humanities. It did take testimony about behavioral control, and available evidence suggests that it was to oversee that kind of research that the word "behavioral" was included in the statute.

(Much more on this in Ethical Imperialism.)

If we are to align the regulations to the wording and intent of the statute, we have two choices. 1. Define behavioral by method (e.g., intervention, not interaction.) 2. Define behavioral by subject matter (designed to study mental and physical health, not social conditions.) Either could lead to improvements.