This chapter discusses four alternatives to laboratory and survey research: field observations, focus groups, intensive interviews, and case studies. Field observation involves the study of a phenomenon in natural settings. The researcher may be a detached observer or a participant in the process under study. The main advantage of this technique is its flexibility; it can be used to develop hypotheses, to gather preliminary data, or to study groups that would otherwise be inaccessible. Its biggest disadvantage is the difficulty in achieving external validity.

 

The focus group, or group interviewing, is used to gather preliminary information for a research study or to gather qualitative data concerning a research question. The advantages of the focus group method are the ease of data collection and the depth of information that can be gathered. Among the disadvantages: the quality of information gathered during focus groups depends heavily on the group moderators' skill; focus groups can only complement other research because they provide qualitative not quantitative data.

 

Intensive interviewing is used to gather extremely detailed information from a small sample of respondents. The wealth of data that can be gathered with this method is its primary advantage. Because intensive interviewing is usually done with small, nonrandom samples, however, generalizability is sometimes a disadvantage. Interviewer bias can also be a disadvantage.

 

The case study method draws from as many data sources as possible to investigate an event. Case studies are particularly helpful when a researcher desires to explain or understand some phenomenon. Some problems with case studies are that they can lack scientific rigor, they can be time-consuming to conduct, and the data they provide can be difficult to generalize from and to summarize.

 

The quantitative approaches discussed in the preceding chapter are not suitable for all research problems. There may be certain situations in which a different technique is appropriate. This chapter outlines the major differences between the two methods and examines the most frequently used techniques of qualitative research.

5.1 Aims and Philosophy

Qualitative research differs from quantitative research along three main dimensions. First, the two methods have a different philosophy of reality. For a quantitative researcher, reality is objective; it exists apart from the researcher and is capable of being seen by all. In other words, it's out there. For the qualitative researcher, there is no one single reality. Each observer creates reality as part of the research process; it is subjective and exists only in reference to the observer. Further, the quantitative researcher believes that reality can be divided into component parts, and he or she gains knowledge of the whole by looking at these parts. On the other hand, the qualitative researcher examines the entire process believing that reality is holistic and cannot be subdivided.

 

Second, the two methods have different views of the individual. The quantitative researcher believes all human beings are basically similar and looks for general categories to summarize their behaviors or feelings. The qualitative investigator believes that human beings are all fundamentally different and cannot be pigeonholed.

 

Third, quantitative researchers aim to generate general laws of behavior and explain many things across many settings. In contrast, qualitative scholars attempt to produce a unique explanation about a given situation or individual. Whereas quantitative researchers strive for breadth, qualitative researchers strive for depth.

The practical differences between these approaches are perhaps most apparent in the research process. The following five major research areas describe significant differences between quantitative and qualitative research.

 

1. Role of the researcher. The quantitative researcher strives for objectivity and is separated from the data. The qualitative researcher is an integral part of the data; in fact, without the active participation of the researcher, no data exist.

 

2. Design. In quantitative methods, the design of the study is determined before it begins. In qualitative research, the design evolves during the research; it can be adjusted or changed as it progresses.

 

3. Setting. Quantitative researchers try to control contaminating and/or confounding variables by conducting their investigations in laboratory settings. Qualitative researchers conduct their studies in the field, in natural surroundings. They try to capture the normal flow of events, without trying to control the extraneous variables.

 

4. Measurement instruments. In quantitative research, these exist apart from the researcher. In fact, another party could use the instruments to collect data in the researcher's absence. In qualitative research, the investigator is the instrument; no other individual could fill in for the qualitative researcher.

 

5. Theory building. In the quantitative area, research is used to test theory and to ultimately support or reject it. In the qualitative area, theory is "data driven" and emerges as part of the research process, evolving from the data as they are collected.

 

These differences will become more apparent throughout this chapter. Four common qualitative techniques are discussed: field observations, focus groups, intensive interviews, and case studies.


5.2 Field Observations

Before 1980, field observation was rarely used in scientific research. It was reported that only 2%-3% of the articles published in journalism and broadcasting journals had employed the technique. Recently, however, field observations have become more common in the research literature.

 

Field observation is useful for collecting data as well as for generating hypotheses and theories. Like all qualitative techniques, it is more concerned with description and explanation than it is with measurement and quantification.

 

Field observations are classified along two major dimensions:

(1)       The degree to which the researcher participates in the behavior under observation; and

(2)       The degree to which the observation is concealed.

 

Overt observation is represented by Quadrant 1. In this situation, the researcher is identified as such when the study begins. Those under observation are aware that they are being studied. Further, the researcher's role is only to observe, refraining from participation in the process under observation. Quadrant 2 represents overt participation. In this arrangement, the researcher is also known to those being observed, but unlike Quadrant 1, the researcher goes beyond the observer role and becomes a participant in the situation. Quadrant 3 represents the situation where the researcher's role is limited to that of observer, but those under observation are not aware they are being studied. A study in which the investigator participates in the process under investigation, but is not identified as a researcher, is represented by Quadrant 4, see Figure 5.1.

 

To illustrate the distinction between the various approaches, assume a researcher wants to observe and analyze the dynamics of writing comedy for television. The researcher could choose the covert observer technique and perhaps pretend to be doing something else (such as fixing a typewriter) while actually observing the TV writing team at work. Alternatively, the researcher could be introduced as someone doing a study of comedy writing and allowed to watch the team in action. If the research question is best answered by active participation, the investigator might be introduced as a researcher but would still participate in the writing process. If the covert participant strategy is used, the researcher might be introduced as a new writer just joining the group (such an arrangement might be made with the head writer who would be the only person to know the true identity of the researcher).

Figure 5.1: Dimensions of field observation

Overt

Observer

1

2

Participant

3

4

Covert

The choice of technique depends upon the research problem and the degree of cooperation available from the group or individual being observed, as well as ethical considerations. Covert participation may affect subjects' behavior and also raises the ethical question of deception. On the other hand, the information gathered may be more valid if subjects are unaware of being scrutinized.

 

5.2.1 Advantages of Field Observations

 

Field observation is not an appropriate technique for every research question, owing to the lack of control and quantification, but it does possess several unique advantages. For one thing, many mass media problems and questions cannot be studied using any other methodology. Field observation often helps the researcher to define basic background information necessary to frame a hypothesis and to isolate independent and dependent variables. For example, a researcher interested in how creative decisions in advertising are made could observe several decision-making sessions to see what actually transpires. Field observations often make excellent pilot studies in that they identify important variables and provide useful preliminary information. In addition, since the data are gathered firsthand, observation is not dependent on the subjects' ability or willingness to report their behavior. For example, young children may lack the reading or verbal skills necessary to respond to a questionnaire concerning their play behavior, but such data are easily gathered by the observational technique.

A field observation is not always used as a preliminary step to other approaches, however. In many cases it alone is the only appropriate approach, especially when quantification is difficult. Field observation is particularly suitable for a study of the gate keeping process in a network television news department, because quantification of gate keeping is rather tenuous. Field observation may also provide access to groups that would otherwise be difficult to observe or examine. For example, a questionnaire sent to a group of producers of X-rated movies is not likely to have a high return rate. An observer, however, may be able to establish enough mutual trust with such a group to persuade them to respond to rigorous questioning.

Field observation is usually inexpensive. In most cases, writing materials or a small tape recorder will suffice. Expenses increase if the problem under study requires a large number of observers, extensive travel, or special equipment (such as video recording machines).

 

Perhaps the most noteworthy advantage of field observation is that the study takes place in the natural setting of the activity being observed and can, thus, provide data rich in detail and subtlety. Many mass media situations, such as a family watching television, are complex and are constantly subjected to intervening influences. Field observation, because of the opportunity for careful examination, allows observers to identify these otherwise unknown variables.

 

5.2.2 Disadvantages of Field Observations

 

On the negative side, field observation is a bad choice if the researcher is concerned with external validity. This difficulty is partly due to the potentially questionable representativeness of the observations made and partly to problems in sampling. Observing the television viewing behavior of a group of children at a day-care center can provide valuable insights into the social setting of television viewing, but it probably has little correlation to what preschoolers do in other places and under different circumstances.

 

Moreover, since field observation relies heavily on a researcher's perceptions and judgments as well as on preconceived notions about the material under study, experimenter bias may unavoidably favor specific preconceptions of results, while observations to the contrary are ignored or distorted. This, primarily, is why one observer is rarely used in a field observation study. Observations need to be cross-validated by second or third observers.

 

Finally, like field experiments, field observations suffer from the problem of reactivity. The very process of being observed may influence the behavior under study. Of course, reactivity can be a problem with other research methods, but it is most often mentioned as a criticism of field observation. Scholars provide some perspective on observer effects using data taken from an observational study of families' TV viewing behavior They found that the presence of an observer in the house did have some impact on family members. About 20% of parents and 25% of children reported that their overall behavior was affected by the presence of an observer. The majority of those who were affected thought that they became nicer or more polite and formal because of the observer's presence. When it came to differences in the key behavior under study, 87% said that the observer's presence had no effect on their TV viewing activity. Additionally, among those who reported an observer effect, there were no systematic differences in the distribution of changes. About the same number said that they watched more because the observer, as they said, watched less. Obviously, additional studies of different groups in different settings are needed before this problem is fully understood, but Lull's data suggest that although reactivity is a problem with observational techniques, its impact may not be as drastic as some suggest.

 

In any case, at least two strategies are available to diminish the impact of selective perception and reactance. One is to use several observers to cross-validate the results. A second strategy has to do with the notion of triangulation - the supplementing of observational data with data gathered by other means (questionnaires, existing records, and so on). Accuracy is sought by using multiple data collection methods.

 

5.2.3 Field Observation Techniques

 

There are at least six stages in a typical field observation study: choosing the research site, gaining access, sampling, collecting data, analyzing data, and exiting.


5.3 Choosing the Research Site

The choice of a research site depends upon the general nature of the research question. The area of inquiry usually suggests a behavior or a phenomenon of interest. Once that is identified, the next step is to select a setting in which the behavior or phenomenon occurs with sufficient frequency to make observation worthwhile. The setting should also accommodate the recording forms and instruments the observer plans to use. For example, if videotaping certain scenes is planned, there must be enough light available for the camera to operate.

 

It is recommended that the researcher select two or three possible research sites and then "hang around"  each of them to discover their main advantages and disadvantages. He goes on to caution researchers that the site must be permanent and stable enough to permit observations over a period of time.

 

5.3.1 Gaining Access

 

Once the site is selected, the next step is to establish contact.  It is noted that the degree of difficulty faced by researchers in gaining access to settings is a function of two factors: (1) how public the setting is, and (2) the willingness of the subjects in the setting to be observed. The easiest setting to gain access to is one that is open to the public and where people have little reason to keep their behavior secret (for example, TV watching in public places such as airports, bars, dormitory viewing rooms). The most difficult setting to gain access to is one where entry is restricted and where participants have good reason to keep their activities secret (for example, the behavior of hostage takers).

 

Observation of a formal group (such as a film production crew) often requires permission from management and perhaps union officials. School systems and other bureaucracies usually have a special unit to handle requests from researchers and to assist them in obtaining necessary permissions.

 

Gaining permission to conduct field observation research requires persistence and public relations skills. Researchers must determine how much to disclose about the nature of the research. In most cases, it is not necessary to provide a complete explanation of the hypothesis and procedures, unless there may be objections to sensitive areas. Researchers interested in observing which family member actually controls the television set might explain that they are studying patterns of family communication. Once the contact has been made, it is necessary to establish a rapport with the subjects). Bogdan and Taylor (1984) suggested the following techniques for building rapport: establish common interests with the participants; start relationships slowly; if appropriate, participate in common events and activities; and do not disrupt participants' normal routines.

 

5.3.2 Sampling

 

Sampling in field observation is more ambiguous than in most other research approaches. In the first place, there is the problem of how many individuals or groups to observe. If the focus of the study is communication in the newsroom, how many newsrooms should be observed? If the topic is family viewing of television, how many families should be included? Unfortunately, there are no guidelines to help answer these questions. The research problem and the goals of the study are often used as indicators for sample size: if the results are intended for generalization to a population, one subject or group is probably inadequate.

 

Another problem is deciding what behavior episodes or segments to sample. The observer cannot be everywhere and see everything, so what is observed becomes a de facto sample of what is not observed. If an observer views one staff meeting in the newsroom, this meeting represents other, unobserved meetings; one conversation at the coffee machine is a sample of all such conversations. In many cases researchers cannot adhere closely to the principles of probability sampling, but they should keep in mind the general notion of representativeness.

 

Most field observations use purposive sampling: observers draw on their knowledge of the subject(s) under study and sample only from the behaviors or events that are relevant. In many cases, previous experience and study of the activity in question will suggest what needs to be examined. In a study of newsroom decision making, for example, researchers would want to observe staff meetings, since they are obviously an important part of the process. However, restricting the sampling to observations of staff meetings would be a mistake; many decisions are made at the water fountain, over lunch, and in the hallways. Experienced observers tend not to isolate a specific situation but rather to consider even the most insignificant situation for potential analysis. For most field observation, researchers need to spend some time simply getting the feel of the situation and absorbing the pertinent aspects of the environment before beginning a detailed analysis.

 

5.3.3 Collecting Data

 

The traditional tools of data collection—the notebook and pen—have given way to radically new equipment in many cases, due to recent advances in electronics. For example, television cameras may be installed in a small sample of households to document the families' television-viewing behavior. Two cameras, automatically activate when the television set is turned on, videotaped the scene in front of the set. However, while a camera is able to record more information than an observer with a notebook, the problems in finding consenting families, maintaining the equipment, and interpreting tapes shot at low light levels made the project difficult.

 

Similarly, it was noted that although the advantages offered by audio and video recording are tempting, there are five major drawbacks to their use:

¨      Recording devices take time away from the research process because they need regular calibration and adjustment to work properly.

¨      The frame of the recording is different from the frame of the observer; a human observer's field of view is about 180°, whereas a camera's is about 60°.

¨      Recordings have to be catalogued, indexed, and transcribed, adding extra work to the project.

¨      Recordings take behavior out of context.

¨      Recordings tend to atomize (fragment) behavior and distract attention from the whole process.

Consequently, researchers must weigh the pros and cons carefully before deciding to incorporate recording equipment into the observational design.

 

Note taking in the covert participant situation requires special attention. Continually scribbling away on a notepad is certain to draw attention and suspicion to the note taker and might expose the researcher's real purpose in a particular setting. In a situation of this type, it is advisable to make mental notes and transcribe them at the first opportunity. If the researcher is initially identified as such, the problem of note taking is somewhat alleviated. Nonetheless, it is not recommended that the observer spend all of his or her time furiously taking notes. Subjects are already aware of being observed, and conspicuous note taking could make them more uneasy. Brief notes jotted down during natural breaks in a situation attract a minimum of attention and can be expanded at a later time.

 

The field notes constitute the basic corpus of data in any field study. In them, the observers record not only what happened and what was said, but also personal impressions, feelings, and interpretations of what was observed. A general procedure is to separate personal opinions from the descriptive narrative by enclosing the former in brackets.

 

How much should be recorded? It is always better to record too much information than too little. An apparently irrelevant observation made during the first viewing session might become significant during the course of the project. If the material is sensitive, or if the researcher does not wish to make it known that research is taking place, the notes may be written in abbreviated form or in code.

 

5.3.4 Analyzing data

 

In field observation, data analysis consists primarily of filing and content analysis. Constructing a filing system is an important step in observation. The purpose of the filing system is to arrange raw field data in an orderly format to enable systematic retrieval later (the precise filing categories are determined by the data). Using the hypothetical study of decision making in the newsroom, filing categories might include the headings "Relationships," "Interaction—Horizontal," "Interaction—Vertical," and "Disputes." An observation may be placed in more than one category. It is a good idea to make multiple copies of all notes, and periodic filing of notes throughout the observation period will save time and confusion later.

 

A rough content analysis is performed to search for consistent patterns once all the notes have been ascribed to their proper files. Perhaps most decisions in the newsroom are made in informal settings such as hallways rather than in formal settings such as conference rooms. Perhaps most decisions are made with little superior-subordinate consultation. At the same time, deviations from the norm should be investigated. Perhaps all reporters except one are typically asked their opinions on the newsworthiness of events. Why the exception?

 

The overall goal of data analysis in field observation is to arrive at a general understanding of the phenomenon under study. In this regard, the observer has the advantage of flexibility. In laboratory and other research approaches, investigators must at some point commit themselves to a particular design or questionnaire. If it subsequently turns out that a crucial variable was left out, there is little that can be done. In field observation, the researcher can analyze data during the course of the study and change the research design accordingly.

 

5.3.5 Exiting

 

A participant must also have a plan for leaving the setting or the group under study. Of course, if the participant is known to everyone, exiting will not be a problem. Exiting from a setting that participants regularly enter and leave is also not a problem. Exiting can be difficult, however, when participation is covert. In some instances, the group may have become dependent on the researcher in some way and the departure may have a negative effect on the group as a whole. In other cases, the sudden revelation that a group has been infiltrated or taken in by an outsider might be unpleasant or distressing to some. The researcher has an ethical obligation to do everything possible to prevent psychological, emotional, or physical injury to those being studied. Consequently, leaving the scene must be handled with diplomacy and tact.


5.4 Focus Groups

The focus group, or group interviewing, is a research strategy for understanding audience/ consumer attitudes and behavior. From 6 to 12 people are interviewed simultaneously, with a moderator leading the respondents in a relatively free discussion about the focal topic. The identifying characteristic of the focus group is controlled group discussion, which is employed to gather preliminary information for a research project, to help develop questionnaire items for survey research, or to understand the reasons behind a particular phenomenon.

 

5.4.1 Advantages of Focus Groups

 One advantage of focus groups is that they allow for the collection of preliminary information about a topic or phenomenon. Focus groups may be used in pilot studies to detect ideas that will be investigated further using another research method, such as a telephone survey, or another qualitative method.

 

A second important advantage is that focus groups can be conducted very quickly. The major portion of time is spent recruiting the respondents. A good research company that specializes in recruiting for focus groups can usually recruit respondents in about 7—10 days, depending on the type of person required.

 

The cost of focus groups also makes the approach an attractive research method; most focus groups can be conducted for about $1,000-$3,000 per group, depending on the type of respondent required for the group, the part of the country in which the group is conducted, and the moderator or company used to conduct the group. When respondents are difficult to recruit, or the topic requires a specially trained moderator, a focus group may cost several thousand dollars. The price, however, is not excessive if the groups provide valuable data for future research studies.

 

Researchers also like focus groups because of the flexibility in question design and follow-up. In conventional surveys, interviewers work from a rigid series of questions and are instructed to follow explicit directions in asking the questions. A moderator in a focus group, on the other hand, works from a list of broad questions as well as more refined probe questions; hence, follow-up on important points raised by participants in the group is easy. The ability to clear up confusing responses from respondents makes focus groups valuable in the research process.

 

Most professional focus group moderators or research companies use a procedure known as an extended focus group, in which respondents are required to complete a written questionnaire before the start of the group. The pregroup questionnaire, which basically covers the material that will be discussed during the group session, serves to "force" the respondents to commit to a particular answer or position before entering the group session. This commitment eliminates one potential problem created by group dynamics, namely, the person who does not wish to offer an opinion because he or she is in minority.

 

Finally, focus group responses are often more complete and less inhibited than those from individual interviews. One respondent's remarks tend to stimulate others to pursue lines of thinking that might not have been brought out in an individual situation. With a competent moderator, the discussion can have a beneficial snowball effect, as one respondent comments on the views of another. A skilled moderator can also detect the opinions and attitudes of those who are less articulate by noting facial expressions and other nonverbal behavior while others are speaking.

 

 5.4.2 Disadvantages of Focus Groups

 

Focus group research is not totally free from complications; the approach is far from perfect. Some of the problems are discussed here.

 

Some groups become dominated by a self-appointed group leader who monopolizes the conversation and attempts to impose her or his opinion on the other participants. Such a person usually draws the resentment of the other participants and may have an extremely adverse effect on the performance of the group. The moderator needs to control such situations tactfully before they get out of hand.

 

Gathering quantitative data is inappropriate for a focus group. If quantification is important, it is wise to supplement the focus group with other research tools that permit more specific questions to be addressed to a more representative sample. Many people unfamiliar with focus group research incorrectly assume that the method will answer questions of "how many" or "how much." Focus group research is intended to gather qualitative data to answer questions such as "why" or "how." Many times people who hire a person or company to conduct a focus group are disgruntled with the results because they expected exact numbers and percentages. Focus groups do not provide such information.

 

As suggested earlier, focus groups depend heavily on the skills of the moderator, who must know when to probe for further information, when to stop respondents from discussing irrelevant topics, and how to get all respondents involved in the discussion. All these things must be accomplished with professionalism and care, since one sarcastic or inappropriate comment to a respondent may have a chilling effect on the group's performance.

 

There are other drawbacks, as well. The small focus group samples are composed of volunteers and do not necessarily represent the population from which they were drawn, the recording equipment or other physical characteristics of the location may inhibit respondents, and if the respondents are allowed to stray too far from the topic under consideration, the data produced may not be useful.

 

5.4.3 Methodology of Focus Groups

 

There are seven basic steps in focus group research.

 

 

 

1. Define the problem. This step is similar in all types of scientific research: a well-defined problem is established, either on the basis of some previous investigation or out of curiosity. For example, many television production companies that produce pilot programs for potential series will conduct 10-50 focus groups with target viewers to determine their reactions to each concept.

2. Select a sample. Because focus groups are small, researchers must define a narrow audience for the study. The type of sample depends on the purpose of the focus group: the sample might consist of consumers who use a particular type of laundry detergent, men aged 18—34 who listen to a certain type of music, or teenagers who purchase more than 10 record albums a year.

 

3. Determine the number of groups necessary. To help eliminate part of the problem of selecting a representative group, most researchers conduct two or more focus groups on the same topic. Results can then be compared to determine whether any similarities or differences exist; or, one group may be used as a basis for comparison to the other group. A focus group study using only one group is rare, since there is no way to know if the results are group-specific or characteristic of a wider audience.

                                         

4. Prepare the study mechanics. A more detailed description of the mechanical aspects of focus groups is in; suffice it to say here that this step includes arranging for the recruitment of respondents (by telephone or possibly by shopping center intercept), reserving the facilities at which the groups will be conducted, and deciding what type of recording (audio and/or video) will be used. The moderator must be selected and briefed about the purpose of the group. In addition, the researcher needs to determine the amount of co-op money each respondent will receive for participating. Respondents usually receive between $10 and $50 for attending, although professionals such as doctors and lawyers may require up to $100 or more for co-op.

 

5. Prepare the focus group materials. Each aspect of a focus group must be planned in detail; nothing should be left to chance — in particular, the moderator must not be allowed to wing it. The screener questionnaire is developed to produce the correct respondents; recordings and other materials the subjects will hear or see are prepared; any questionnaires the subjects will complete are produced (including the presession questionnaire); and a list of questions is developed for the presession questionnaire and the moderator's guide.

Generally, a focus group session begins with some type of shared experience, so that the individuals have a common base from which to start the discussion. The members may listen to or view a tape or examine a new product, or they may simply be asked how they answered question 1 on the presession questionnaire.

 

The existence of a moderator's guide does not mean that the moderator cannot ask questions not contained in the guide. Quite the opposite is true. The significant quality of a focus group is that it allows the moderator to probe comments that respondents make during the session. A professional moderator is often able to develop a line of questioning that no one thought about before the group began, and many times the questioning provides extremely important information. Professional moderators who have this skill receive very substantial fees for conducting focus groups.

 

6. Conduct the session. Focus groups may be conducted in a variety of settings, from professional conference rooms equipped with two-way mirrors to hotel rooms rented for the occasion. In most situations, a professional conference room is used. Hotel and motel rooms are used when a focus facility is not located close by.

 

7. Analyze the data and prepare a summary report. The written summary of focus group interviews depends on the needs of the study and the amount of time and money available. At one extreme, the moderator/researcher may simply write a brief synopsis of what was said and offer an interpretation of the subjects' responses. For a more elaborate content analysis, or a more complete description of what happened, the sessions can be transcribed so that the moderator/ researcher can scan the comments and develop a category system, coding each comment into the appropriate category. For example, a researcher who notices that most respondents focus on the price of a new product can establish a content category labeled "Price," code all statements in the transcript referring to price, and arrange these statements under the general heading. The same technique is followed for other content categories. When the coding is completed, the researcher makes summastatements about the number, tone, and consistency of the comments that fall into each category. Needless to say, this approach requires some expenditure of time and money on the researcher's (or client's) part.


5.5 Intensive Interviews

 

Intensive interviews, or in-depth interviews, are essentially a hybrid of the one-on-one personal interview approach discussed in Chapter 6. Intensive interviews are unique in that they:

¨      Generally use smaller samples.

¨      Provide very detailed information about the reasons why respondents give specific answers. Elaborate data concerning respondents' opinions, values, motivations, recollections, experiences, and feelings are obtained.

¨      Allow for lengthy observation of respondents' nonverbal responses.

¨      Are usually very long. Unlike personal interviews used in survey research that may last only a few minutes, an intensive interview may last several hours, and may take more than one session.

¨      Are customized to individual respondents. In a personal interview, all respondents are asked the same questions. Intensive interviews allow interviewers to form questions based on each respondent's answers.

¨      Can be influenced by the interview climate. To a greater extent than with personal interviews, the success of intensive interviews depends on the rapport established between the interviewer and respondent.

 

5.5.1 Advantages and Disadvantages of Intensive Interviews

 

As is probably obvious, the biggest advantage of the in-depth interview is the wealth of detail that it provides. Further, when compared to more traditional survey methods, intensive interviewing provides more accurate responses on sensitive issues. The rapport between respondent and interviewer makes it easier to approach certain topics that might be taboo in other approaches. In addition, there may be certain groups for which intensive interviewing is the only practical technique. For example, a study of the media habits of U.S. senators would be hard to do as an observational study. Also, it would be difficult to get a sample of senators to take the time to respond to a survey questionnaire. But in some cases, such persons might be willing to talk to an interviewer.

 

On the negative side, generalizability is sometimes a problem. Intensive interviewing is typically done with a small, nonrandom sample. Further, since interviews are usually non-standardized, each respondent may answer a slightly different version of a question. In fact, it is very likely that a particular respondent may answer questions not asked of any other respondent. Another disadvantage of in-depth interviews is that they are especially sensitive to interviewer bias. In a long interview, it's possible for a respondent to learn a good deal of information about the interviewer. Despite practice and training, some interviewers may inadvertently communicate their attitudes through loaded questions, nonverbal cues, or tone of voice. The effect this may have on the validity of the respondent's answers is hard to gauge. Finally, intensive interviewing presents problems in data analysis. A researcher given the same body of data taken from an interview may wind up with interpretations significantly different from the original investigator.

 

5.5.2 Procedures

 

The procedures for conducting intensive interviews are similar to those used in personal interviews in reference to problem definition, respondent recruiting, and data collection and analysis. The primary differences with intensive interviews are:

 

¨      Co-op payments are usually higher, generally from $50-$1,000.

¨      The amount of data is tremendous. Analysis may take several weeks to several months.

¨      Interviewers get extremely tired and bored. Interviews must be scheduled several hours apart, which makes data collection take much longer.

¨      It is very difficult to arrange intensive interviews because of the time required. This is especially true with respondents who are professionals.

¨      Small samples do not allow for generalization to the target population.


5.6 Case Studies

 

The case study method is another common qualitative research technique. Simply put, a case study uses as many data sources as possible to investigate systematically an individual, group, organization, or event. Case studies are performed when a researcher desires to understand or explain a phenomenon. Case studies are frequently used in medicine, anthropology, clinical psychology, management science, and history. Sigmund Freud wrote case studies of his patients; economists wrote case studies of the cable TV industry for the FCC; the list is endless.

 

On a more formal level, a case study was defined as an empirical inquiry that uses multiple sources of evidence to investigate a contemporary phenomenon within its real-life context in which the boundaries between the phenomenon and its context are not clearly evident. This definition highlights how a case study differs from other research strategies. For example, an experiment separates phenomenon from real-life context. The context is controlled by the laboratory environment. The survey technique tries to define the phenomenon under study narrowly enough to limit the number of variables to be examined. Case study research includes both single and multiple cases. Comparative case study research, frequently used in political science, is an example of the multiple case study technique.

 

Four essential characteristics of case study research:

  1. Particularistic. This means that the case study focuses on a particular situation, event, program, or phenomenon, making it a good method for studying practical real-life problems.

  2. Descriptive. The final result of a case study is a detailed description of the topic under study

  3. Heuristic. A case study helps people to understand what's being studied. New interpretations, new perspectives, new meaning, and fresh insights are all goals of a case study.

  4. Inductive. Most case studies depend on inductive reasoning. Principles and generalizations emerge from an examination of the data. Many case studies attempt to discover new relationships rather than verify existing hypotheses.

 

 

5.6.1 Advantages of Case Studies

 

The case study method is most valuable when the researcher wants to obtain a wealth of information about the research topic. Case studies provide tremendous detail. Many times researchers want such detail when they don't know exactly what they are looking for. The case study is particularly advantageous to the researcher who is trying to find clues and ideas for further research. This is not to suggest, however, that case studies are to be used only at the exploratory stage of research. The method can also be used to gather descriptive and explanatory data.

 

The case study technique can suggest why something has occurred. For example, in many cities in the mid-1980s, cable companies asked to be released from certain promises made when negotiating for a franchise. To learn why this occurred, a multiple case study approach, examining several cities, could have been used. Other research techniques, such as the survey, might not be able to get at all the possible reasons behind this phenomenon. Ideally, case studies should be used in combination with theory to achieve maximum understanding.

 

The case study method also affords the researcher the ability to deal with a wide spectrum of evidence. Documents, historical artifacts, systematic interviews, direct observations, and even traditional surveys can all be incorporated into a case study. In fact, the more data sources that can be brought to bear in a case, the more likely it is that the study will be valid.

 

5.6.2 Disadvantages of Case Studies

 

There are three main criticisms. The first has to do with a general lack of scientific rigor in many case studies. It was observed that in too many times, the case study investigator has been sloppy, and has allowed equivocal evidence or biased views to influence the findings and conclusions. It is easy to do a sloppy case study; rigorous case studies require a good deal of time and effort.

 

The second criticism is that the case study is not easily open to generalization. If the main goal of the researcher is to make statistically based normative statements about the frequency of occurrence of a phenomenon in a defined population, some other method may be more appropriate. This is not to say that the results of all case studies are idiosyncratic and unique. In fact, if generalizing theoretic propositions is the main goal, the case study method is perfectly suited to the task.

 

Finally, like participant observation, case studies are likely to be time-consuming and may occasionally produce massive quantities of data that are hard to summarize. Consequently, fellow researchers are forced to "wait years for the results of the research, which too often are poorly presented. Some authors, however, are experimenting with nontraditional methods of reporting to overcome this last criticism.

 

5.6.3 Conducting a Case Study

 

The precise method of conducting a case study has not been as well documented as the more traditional techniques of the survey and the experiment. Nonetheless, there appear to be five distinct stages in carrying out a case study: design, pilot study, data collection, data analysis, and report writing.

 

Design

The first concern in a case study is what to ask. The case study is most appropriate for questions that begin with "how" or "why." A research question that is clear and precise will focus the remainder of the efforts in a case study. A second design concern is what to analyze. What exactly constitutes a "case"? In many instances, a case may be an individual, several individuals, or an event or events. If information is gathered about each relevant individual, the results are reported in the single or multiple case study format; in other instances, however, the precise boundaries of the case are harder to pinpoint. A case might be a specific decision, a particular organization at a certain point in time, a program, or some other discrete event. One rough guide for determining what to use as the unit of analysis is the available research literature. Since researchers want to compare their findings with the results of previous research, it is sometimes a good idea not to stray too far from what was done in past research.

 

Pilot Study

Before the pilot study is conducted, the case study researcher must construct a study protocol. This document contains the procedures to be used in the study and also includes the data-gathering instrument or instruments. A good case study protocol contains the procedures necessary for gaining access to a particular person or organization and the methods for accessing records. It also contains the schedule of data collection and addresses the problems of logistics. For example, the protocol should note whether a copy machine will be available in the field to duplicate records, whether office space is available to the researchers, and what will be needed in the way of supplies. The protocol should also list the questions central to the inquiry and the possible sources of information to be tapped in answering these questions. If interviews are to be used in the case study, the protocol should contain the questions to be asked.

 

Once the protocol has been developed, the researcher is ready to go into the field for the pilot study. A pilot study is used to refine both the research design and the field procedures. Variables that were not foreseen during the design phase can crop up during the pilot study, and problems with the protocol or with study logistics can also be uncovered. The pilot study also allows the researchers to try different data-gathering approaches and to observe different activities from several trial perspectives. The results of the pilot study are used to revise and polish study protocol.

 

Data Collection

At least four sources of data can be used in case studies. Documents, which represent a rich data source, may take the form of letters, memos, minutes, agendas, historical records, brochures, pamphlets, posters, and so on. A second source is the interview. Some case studies make use of survey research methods and ask respondents to fill out questionnaires, others may use intensive interviewing.

Observation/participation is the third data collection technique. The same general comments made about this technique earlier in this chapter apply to the case study method as well. The last source of evidence used in case studies is the physical artifact—a tool, a piece of furniture, or even a computer printout. Although artifacts are commonly used as a data source in anthropology and history, they are seldom used in mass media case study research. (They are, however, frequently used in legal research concerning the media.)

 

Most case study researchers recommend using multiple sources of data, thus affording triangulation of the phenomenon under study. In addition, multiple sources help the case study researcher improve the reliability and validity of the study. Not surprisingly, a study of the case study method found that the ones that used multiple sources of evidence were rated higher than those relying on a single source.

 

Data Analysis

Unlike more quantitative research techniques, there are no specific formulas or "cookbook" techniques to guide the researcher in analyzing the data. Consequently, this stage is probably the most difficult in the case study method. Although it is hard to generalize to all case study situations, three broad analytic strategies were suggested: pattern matching, explanation building, and time series.

In the pattern-matching strategy, an empirically based pattern is compared with a predicted pattern or several alternative predicted patterns. For instance, suppose a newspaper is about to institute a new management tool: a regular series of meetings between top management and reporters, excluding editors. Based on organizational theory, a researcher might predict certain outcomes, namely, more stress between editors and reporters, increased productivity, weakened supervisory links, and so on. If analysis of the case study data indicates that these results did in fact occur, some conclusions about the management change can be made. If the predicted pattern did not match the actual one, the initial study propositions would have to be questioned.

 

In the analytic strategy of explanation building, the researcher tries to construct an explanation about the case by making statements about the cause or causes of the phenomenon under study. This method can take several forms. Typically, however, an investigator drafts an initial theoretical statement about some process or outcome, compares the findings of an initial case study against the statement, revises the statement, analyzes a second comparable case, and repeats this process as many times as necessary. For example, to explain why some new communication technologies are failing, a researcher might suggest lack of managerial expertise as an initial proposition. But an investigator who examined the subscription television industry might find that lack of management expertise is only part of the problem—inadequate market research is also contributory.

 

Armed with the revised version of the explanatory statement, the researcher would next examine the direct broadcast satellite industry to see whether this explanation needs to be further refined, and so on, until a full and satisfactory answer is achieved.

 

In the analytic strategy of time series analysis, the investigator tries to compare a series of data points to some theoretic trend that was predicted before the research, or to some rival trend. If, for instance, several cities have experienced newspaper strikes, a case study investigator might generate predictions about the changes in information-seeking behaviors of residents in these communities and conduct a case study to see whether these predictions were supported.

 

Report Writing

The case study report can take several forms. The report can follow the traditional research study format: problem, methods, findings, and discussion. Or it can use a nontraditional technique. Some case studies are best suited for a chronological arrangement, whereas case studies that are comparative in nature can be reported from that perspective. No matter what form is chosen, the researcher must consider the intended audience of the report. A case study report written for policy makers would be done in a style different from one that was to be published in a scholarly journal.