You are viewing a free preview of this lesson.
Subscribe to unlock all 10 lessons in this course and every other course on LearningBro.
Theoretical issues in research methodology address the most fundamental evaluative question in the whole subject: what kind of knowledge does a particular method produce, and how good is that knowledge? They form the T of the PET framework (practical, ethical, theoretical), and they supply the precise vocabulary with which every study you meet is judged. The three central concepts are validity (does the method capture a true picture?), reliability (would it produce the same results if repeated?), and representativeness (is the sample typical enough to generalise?). Alongside these sit objectivity and the value-freedom debate, and the strategies of triangulation and methodological pluralism that try to combine the strengths of different approaches. The decisive insight running through this lesson is that these criteria frequently trade off against one another — most importantly, validity and reliability pull in opposite directions — so there is no perfect method, only methods more or less suited to a given aim. And because positivists and interpretivists prioritise different criteria, theoretical issues are inseparable from the positivism/interpretivism debate. Mastering this vocabulary is what allows a candidate to evaluate rather than merely describe.
Theoretical issues sit at the core of the Theory and Methods component of the AQA A-Level Sociology specification (7192). They are examinable on Paper 1 (7192/1) — Education with Theory and Methods and on Paper 3 (7192/3) — Crime and Deviance with Theory and Methods, where they can be tested as a 10-mark "Outline and explain two…" question (for example, two reasons interpretivists prioritise validity) and as the evaluative backbone of the 30-mark essay on Paper 3. They are indispensable to the Methods in Context question on Paper 1 (20 marks), because evaluating a method for an educational issue means assessing its validity, reliability and representativeness for that specific group and topic. Mark schemes explicitly reward candidates who explain how a method's features affect these criteria, rather than merely asserting that a method is "valid" or "unreliable" — so this vocabulary, used precisely, is the route to the higher bands across the whole qualification.
Theoretical issues are the lens through which every substantive study is evaluated.
Key Definition: Theoretical issues — the methodological concerns (validity, reliability, representativeness, objectivity, and the role of values) that determine the kind and quality of knowledge a method produces, and which derive from a researcher's underlying theoretical perspective.
Validity refers to the extent to which a method measures what it claims to measure and produces a true, authentic picture of the social phenomenon studied.
Key Definition: Validity — the degree to which a research method or instrument accurately measures or captures what it is intended to. Valid data gives a genuine, truthful representation of social reality.
| Type | Definition | Example |
|---|---|---|
| Internal validity | Whether the method genuinely captures the phenomenon it claims to study | Does a questionnaire on 'religious belief' measure belief, or something else (cultural conformity, social desirability)? |
| External validity | Whether findings generalise beyond the study to other settings, populations or times | Can findings from one school apply to all schools in England? |
| Face validity | Whether the method appears, on the surface, to measure what it claims | A reading test that involves reading passages has face validity as a measure of reading ability |
| Construct validity | Whether the method accurately operationalises the theoretical concept | Does measuring 'social class' by occupation capture the full complexity of the concept? |
| Ecological validity | Whether findings reflect real-life behaviour and settings, not artificial conditions | Laboratory experiments typically have low ecological validity because the setting is artificial |
| Factor | Effect on Validity |
|---|---|
| Imposed frameworks | Pre-set questions and answer categories (questionnaires, structured interviews) force respondents into the researcher's framework of meaning, distorting their true views |
| Social desirability bias | Respondents give socially acceptable rather than truthful answers, so data does not reflect genuine beliefs or behaviour |
| Hawthorne effect | People who know they are observed alter their behaviour, so the researcher records a 'performance' rather than natural behaviour |
| Interviewer effect | The interviewer's characteristics or behaviour influence responses, so data reflects the interview situation rather than the respondent's real views |
| Researcher interpretation | In qualitative work, the researcher's interpretation may not match the participant's intended meaning |
| Context | The setting (a formal interview room versus the participant's home) shapes how people respond |
| Method | Typical Validity | Explanation |
|---|---|---|
| Questionnaires (closed) | Low | Pre-set categories impose the researcher's framework; social desirability bias; no chance to explore meaning |
| Structured interviews | Low–Medium | As above, though the interviewer can clarify questions |
| Unstructured interviews | High | Participants speak in their own words; the researcher can explore meaning in depth |
| Participant observation | High | Observes actual behaviour in natural settings over time (though the Hawthorne effect threatens overt work) |
| Experiments | Low ecological validity | Artificial settings do not reflect real life; demand characteristics may alter behaviour |
| Official statistics | Contested | Positivists treat them as valid; interpretivists (Cicourel, Atkinson) argue they are social constructions |
The recurring theme across these factors is that validity is threatened whenever the act of researching changes what is being studied or substitutes the researcher's framework for the participant's. This is why interpretivists insist that validity is the supreme criterion and why they reach for methods — unstructured interviews, participant observation — that minimise the imposition of pre-set categories and let meaning emerge in context. It is also why the contested status of official statistics is so important: when Cicourel argues that crime figures measure police labelling rather than criminal behaviour, he is making a validity claim — that the statistic does not measure what it purports to — which shows that even apparently "hard", objective quantitative data can be challenged on exactly the grounds interpretivists use against questionnaires. Validity, in other words, is not the exclusive concern of qualitative research; it is the criterion on which the entire interpretivist critique of positivist data rests.
Reliability refers to the consistency and replicability of a method. A reliable method, if repeated by another researcher or at another time, would produce the same or very similar results — which is why positivists prize it as the precondition of a cumulative, checkable science.
Key Definition: Reliability — the extent to which a research method produces consistent results when used repeatedly under the same conditions. A reliable method is one that can be replicated.
| Type | Definition |
|---|---|
| Test–retest reliability | Whether repeating the same study with the same participants at a different time produces the same results |
| Inter-rater reliability | Whether different researchers using the same method on the same data produce the same results |
| Factor | Effect on Reliability |
|---|---|
| Standardisation | Highly standardised methods (questionnaires, structured interviews) produce consistent, comparable, replicable data — high reliability |
| Researcher involvement | The more personally involved the researcher (unstructured interviews, PO), the less replicable the study — low reliability |
| Subjectivity | Qualitative methods involve interpretation; different researchers may read the same data differently |
| Changing social context | Society changes, so repeating a study later may give different results — not because the method is unreliable but because the world has changed |
| Small samples | Small, purposive samples are hard to replicate because the specific participants cannot be replaced |
| Method | Typical Reliability | Explanation |
|---|---|---|
| Questionnaires | High | Standardised questions and format; easy to replicate |
| Structured interviews | High | Fixed schedule; each interview follows the same procedure |
| Unstructured interviews | Low | Each interview is unique; depends on rapport and the direction of conversation |
| Participant observation | Low | Each study is unique; depends on the researcher's relationship, setting and period |
| Experiments | High | Controlled conditions and standardised procedures make replication straightforward |
| Official statistics | High (but qualified) | Standardised collection (though changing definitions over time reduce comparability, and discretionary data such as crime figures is less trustworthy than registration data) |
One of the most important insights in sociological methodology — and the single most powerful evaluative tool in the exam — is that validity and reliability often pull in opposite directions.
| High Reliability | High Validity |
|---|---|
| Standardised, structured methods | Flexible, open-ended methods |
| Pre-set questions and categories | Participants express themselves freely |
| Easy to replicate | Unique, non-replicable studies |
| Quantitative data | Qualitative data |
| Large samples | Small, in-depth studies |
| Positivist preference | Interpretivist preference |
Researchers therefore face a trade-off: increasing reliability by standardising a method tends to reduce its validity by constraining responses, and vice versa. A postal questionnaire is highly reliable (anyone could re-administer the identical instrument) but may be invalid (its fixed categories may not capture what respondents really think); an unstructured interview is highly valid (the respondent speaks freely) but unreliable (no two interviews are alike). The classic analogy is a set of bathroom scales that always reads 5kg too high: perfectly reliable (consistent) yet wholly invalid (consistently wrong). This is exactly why positivists distrust qualitative depth and interpretivists distrust statistical tidiness — and why triangulation is so often recommended, since combining methods can pair reliability with validity. The exam-relevant conclusion is conditional: whether a method's trade-off is acceptable depends on the research aim, because a study measuring broad patterns can tolerate some loss of validity, whereas a study of personal meaning cannot.
Exam Tip: The validity–reliability trade-off is the most powerful evaluative tool you can deploy. When evaluating any method, state whether it prioritises validity or reliability and explain the consequence of that choice — never assert one criterion without explaining the mechanism.
Representativeness refers to the extent to which the sample studied is typical of the wider population, allowing the researcher to generalise findings — the criterion, alongside reliability, that positivists most prize.
Key Definition: Representativeness — the degree to which a sample accurately reflects the characteristics of the target population, enabling generalisation of findings from the sample to the population.
| Factor | Effect on Representativeness |
|---|---|
| Sample size | Larger samples are generally more representative — but size alone does not guarantee it |
| Sampling method | Probability methods (random, stratified) produce more representative samples than non-probability methods (snowball, purposive, opportunity) |
| Sampling frame | An incomplete or inaccurate frame excludes some of the population, introducing bias |
| Response rate | Low response rates mean respondents may be atypical — non-response bias (cf. the Hite reports) |
| Self-selection | Volunteers differ systematically from non-volunteers (more motivated, more opinionated) |
| Attrition | In longitudinal studies, those who drop out may differ from those who remain, biasing the panel over time |
| Method | Typical Representativeness | Explanation |
|---|---|---|
| Questionnaires | Potentially high | Can reach large samples, but depends on response rates |
| Structured interviews | Medium | Smaller samples than questionnaires, but probability sampling is possible |
| Unstructured interviews | Low | Small, purposive samples that cannot be generalised |
| Participant observation | Low | Typically a single group or setting |
| Experiments | Low | Small, often self-selected samples in artificial settings |
| Official statistics | High | Often cover the whole population (Census) or very large samples |
The AO3 point is that representativeness is only a virtue relative to the aim: for positivists seeking to generalise it is essential, but for interpretivists seeking to understand a social process in depth, an unrepresentative purposive sample is an acceptable price for validity. A single rich case (one gang, one religious movement) can illuminate processes that recur far more widely, even though it cannot establish how common they are.
Objectivity is the principle that research should be conducted without the researcher's personal values, beliefs or biases influencing the process or findings. It is contested across perspectives, and deploying this debate adds analytical depth.
| Perspective | Position on Objectivity |
|---|---|
| Positivists | Objectivity is essential; the researcher should be detached and value-free, and standardised quantitative methods minimise bias |
| Weber | Total value-freedom is impossible — values inevitably guide the choice of topic — but once chosen, the research itself should be as objective as possible |
| Feminists | All research is value-laden; feminists (e.g. Oakley) openly commit to advancing women's interests and argue that claiming value-freedom is itself a political stance |
| Marxists | Research reflects the interests of the dominant class; Gouldner attacked the "myth of a value-free sociology", and Marxists are explicit about challenging inequality |
| Postmodernists | Objectivity is a myth; all knowledge is partial and situated, with no single 'truth' to discover |
Key Definition: Value-freedom (Wertfreiheit) — the idea, associated especially with Weber, that research should be conducted without the researcher's personal values influencing the findings. Weber distinguished value-relevance (values legitimately influence what we choose to study) from value-freedom (values should not distort how we conduct and interpret the study).
The link to the other criteria is important: positivists treat objectivity as bound up with reliability (standardised methods remove the researcher's subjectivity), whereas Becker's argument that sociology should take the side of the "underdog", and Oakley's feminist case for engaged research, deny that detachment is either possible or desirable — for them, a supposedly "neutral" stance is itself a value position.
Subscribe to continue reading
Get full access to this lesson and all 10 lessons in this course.