Wednesday, February 27, 2008

Article Summary: Charney’s “Empiricism Is Not a Four-Letter Word”

Do empirical methods have a place in the scholarship of technical and professional writing? At the time this article was written (1996), an influential cadre of technical communication researchers had been calling into question not only the validity of these methods but also the moral and ethical character of those who used them. Basing their rejection of empirical methods on feminism and social constructionism, these scholars successfully forced quantitative research in technical communication out of the mainstream. With this article, Charney’s aim was to expose the logical fallacies of this movement, as he saw them, and to attempt to restore the reputation of quantitative methods. His hope was for a community of scholarship that valued qualitative and quantitative research methodologies in equal measure.

The Mischaracterization of Science

Although many critics of science merge objectivity, positivism, rationalism, and materialism (among other terms), Charney notes that these concepts can and should be separated and that many notable scholars have upheld some, but not all, of these ideas. Nevertheless, critics equate the quantitative approach with an ethos of self-interest and political status quo. By eliminating the richness of human experience from their research, empiricists are viewed as misrepresenting the true nature of the world as reducible and fully describable.

A key accusation against empiricism is that it is inherently sexist. Some scholars charge that empiricism reinforces masculine modes of knowledge and shuts out other, feminine, paths, such as intuitions, traditions, and personal experience. Charney counters that, contrarily, the pervasiveness of sexism in our culture has often been revealed through quantitative analyses and that empiricism has probably opened the door to many more people to join in the production of knowledge than were allowed to in cultures that privileged the elitist few. Because science is open and repeatable, it allows anyone to challenge it and add to it.

Indeterminacy

Critics also point to the fundamental contradiction in science that so-called “objective” methods are not really objective at all. In every data set, there is variance; in all methods, there are indeterminate sources of error. How, then, can scientists claim absolute objectivity? Charney concedes that “scientific knowledge and methods are, at least in part, socially constructed.” However, he says, this does not invalidate the central rationality of science. Science is a process, not a discrete, monolithic entity. Imperfect tools are used to continually improve our understanding and to create new tools that are less imperfect than their predecessors. Science is self-critical and self-examining—nothing stands that is shown to be false. To Charney, empiricism is what prevents a totalitarian ethic because it promotes a free and open exchange of ideas. This is in direct contrast to the characterization of science by the opposing side as an upholder of oppressive power structures.

What’s Really Objective about Objectivity?

As noted, critics often charge that science is not objective because its methods are socially constructed and inherently indeterminate. However, to philosophers of science, there is no contradiction between social construction and objectivity—it is largely a misperception of science that leads people to reject it. The social constructivist roots of science are evident in the way that scientific ideas and methods are tested and re-tested. No one individual holds absolute authority. Knowledge is arrived at through consensus via a community-based process. Most scientists do not see their own results as fixed, immutable truths, but rather as probabilities that lean in one direction or another. As a result, scientific articles are best viewed as rhetorical devices to disseminate results and attempt to convince one’s peers of the value of one’s work. This process results in ever-improving methods and knowledge claims. It is precisely this aspect of science, and not the “supposed neutrality or disinterestedness of individual scientists,” that defines objectivity in science.

How Researchers Treat Their Participants

Another critique of empiricism is the cold manner in which quantitative researchers approach their research participants. Critics equate distance with uncaringness, objectivity with amorality. Charney points out that “these characterizations smack of the worst kind of exclusionary identity politics” in that “they essentialize the researchers on the basis of their methods.” In contrast, many quantitative researchers care deeply for their research participants—deeply enough to remain distant and “cold.” This distance is what allows them to report accurately on what they observe, and what allows others to reproduce their studies and validate their results. The methods one uses cannot be used as a gauge of the moral character of those who use them. In that light, the supposed caring and compassionate nature of qualitative researchers cannot be ascertained purely through their own descriptions of their participants. Their reports are just as calculated as those of quantitative researchers—they must assume a particular “voice” in order to appeal to their readers (primarily, other qualitative researchers).

Objectivity Reinforces Collective Authority

Qualitative analyses are inherently situated in the place they were conducted. Studies that rely on qualitative methods are not generalizable to broader contexts, and the validity of these studies cannot be independently verified. Paradoxically, this lends absolute authority to the individual researchers because they are the only ones who can make claims about their own research. Although qualitative research is often viewed as democratizing and collectivist, the opposite is true. Quantitative research, conversely, relies on the community for its credence. And because quantitative research leads toward generalizability, the results of multiple studies build upon one another to form an interconnected web of understanding.

Toward a Synthesis of Qualitative and Quantitative Methods

Neither qualitative nor quantitative methods alone are sufficient to create a robust field of scholarship in technical communication. Both reveal knowledge in their own way, and both reveal different kinds of knowledge. Charney believes that, as a field, we should embrace all methods that have the capability of leading us to our collective goals.

10 comments:

Lance said...

I guess I'll start the comments even though research methodology is far from something I find stimulating and relevant to my work.

I've read enough journal articles to understand the importance of research in the field of technical communication and I understand the need to further research not only in technical communication, but in other academic disciplines also. A robust body of research lends credibility to the discipline, and the academy's approval of a discipline's research is certainly something to strive for.

Charney makes her case here for the inclusion of a variety of research methods in the communication field, but to fully appreciate and understand the article I believe the reader must follow the development of research methods in communication studies more closely than I have done. For that reason, the article fails to strike a chord with me. But my thesis looms before me, I guess I'll have to make my connection to research methodology soon!

Dianna said...

Great job on the summary! The question I most related to in this article was the issue of how researchers treat their participants. I think this is something everyone in this class has or will ponder in the coming days as we conduct our usability tests. I thought Charney’s rebuttal of critiques of empiricism was right on, although I could identify with and understand both sides of the argument. I thought this portion of the article was very complimentary to a couple of Barker’s chapters, particularly Chapter 5 on user analysis and chapter 7 on reviews.

Karen said...

Very interesting observations by the author! As I read, I kept thinking to myself, "No, research doesn't have to be just one extreme or the other!" Coming from a medical background, I initially had a hard time understanding how qualitative research could be of any real value, precisely because it wasn't "objective" enough. But I've come to understand that sometimes you need to know not just what is true, as revealed through statistically significant quantitative research results, but also why. In terms of social research, qualitative studies seem to do a better job of identifying the motivations behind the actions.

The idea of judging the morality or caring of researchers based on the research style they use -- well, that just sounds like name-calling to me! In some cases, being too close to subjects can change their behavior, producing inaccurate results. In other cases, you cannot learn enough unless you closely interact with your subjects. I think this is more a matter of research goals than personal morality.

Amy Beeman said...

I also thought I would comment on the morality of empiricism. I think Karen hit the nail on the head - you need to be careful about how close you get to your participants or you could risk compromising your entire study. I think that Diana is also correct - being actually put into the thick of things with our own research will help us to see, even more so, how these research methods work and what types of responses we get from our subjects.

I think it can be very difficult to be open to certain types of research, especially when you are not as familiar with them as other types. However, in my opinion, as technical communicators, we have to be able to adapt our research, writing and editing styles to best fit our audience and the purpose of our communication, so it is important to have a balance (or at least a general understanding) of what is available to us for research methods.

Vanda Heuring said...

I would have to agree that research methods don't have to be so black and white, all or nothing. I never perceived empirical research as sexist, for I saw it as a mere tool (one of several) to arrive at the outcome of research. I agree that the use of intuition is part of the researcher him/herself, it is the social aspect of research. No one can turn off the mode of their perception/thinking, for that would make us robots and remove any human component from research.

Keeley said...

I come from a background in biology/zoology and currently work in healthcare. I find I am much more comfortable with quantitative research and studies. As I have expressed before,I often find research done in "non-scientific" areas nebulous, often overly wordy, and sometimes hard to understand. I'm admitting this even though it's gotten me into trouble in the past. I recognize this as a weakness on my part and am not attempting to discount the work done by more qualitative authors. But I like things that are logical and can be reproduced and agreed upon. I've never been good at debating philosophy or politics or other topics that can be interpreted and understood in multiple ways. I'll talk to one person and find myself agreeing with them and then talk to someone else who thinks the opposite and they make sense as well. I think that's why I prefer to stick with things that are more black and white.

brunsj1 said...

I have to say that I agree with the last paragraph especially (I posted it below this paragraph). I think that one type of research (qualitative or quantitative) should be valued more than the other. The type of research question you have should warrant the type of research that you do (in my belief). That might even be a mixed methods approach.

"Neither qualitative nor quantitative methods alone are sufficient to create a robust field of scholarship in technical communication. Both reveal knowledge in their own way, and both reveal different kinds of knowledge. Charney believes that, as a field, we should embrace all methods that have the capability of leading us to our collective goals."

brunsj1 said...

Sorry, I meant to say that "I think that one type of research (qualitative or quantitative) should NOT be valued more than the other."

Anna said...

I think that both research methods are applicable for the technical communication field. As I have mentioned before I am new to the technical communication, but there seems to be validity in both methods depending on the research project and the goals of the research project. In the speech communication field which in many areas resembles technical communication (audience, organizational layouts etc) field, the quantitative research method is more accepted and recognized because it can produce results that can possibly be replicated.

J.J. Carlson said...

Without a doubt, technical communicators need to consider both quantitative and qualitative methods in research. There will be times where one may be used and not the other, but excluding one all together in technical communication research is just asinine.

Since the user experience is crucial in technical communication, we cannot ever let go of the human element. If we use qualitative studies, we gain insight into how some users respond to what it is they are using. If we use quantitative studies, we make quick and concrete comparisons as to whether something is successful.

Both methods offer outcomes that make direct implications on technical communication. Do we use only qualitative? Not unless we want to be biased!