Skip to content
Back to search results

Diary Method — Research Diary Method

Introduced by
Gordon Allport (systematic social-science use); Nels Anderson (early fieldwork diaries)
Year
1920s–1940s (systematised by Allport, 1942)
Type
Qualitative / mixed-methods data-collection technique
Family
Data collection
Font size

What does it do?

The diary method is a data-collection technique in which participants record their thoughts, behaviours, events, or experiences in their own words at regular or event-contingent intervals over a defined study period.

By capturing data close in time to the event, diaries reduce retrospective recall bias and give researchers access to the texture of everyday life as it unfolds — something one-off surveys and retrospective interviews cannot provide.

The intuition behind the method

Think of asking participants to keep a personal journal for a research study. Every evening they write a short entry about their stress, eating habits, or social interactions — or they write an entry whenever a specific trigger event occurs. Because they record experiences as they happen rather than weeks later, the data reflect real-time experience rather than reconstructed memory. Researchers then read across dozens or hundreds of entries to identify patterns across participants and over time, turning intimate daily accounts into systematic evidence.

History

Personal diaries have been used as historical and biographical sources for centuries, but the systematic use of researcher-assigned diaries as a social-science data-collection tool was pioneered in the 1920s and 1930s by Chicago School sociologists such as Nels Anderson and W.I. Thomas. Gordon Allport's 1942 monograph on personal documents in psychology provided the first methodological framework for diary research. The method was revitalised in the 1990s with the rise of ecological momentary assessment and, later, smartphone-based diary apps, culminating in Bolger, Davis, and Rafaeli's influential 2003 review in the Annual Review of Psychology, which remains the standard methodological reference.

When to use it

Use the diary method when your research question concerns within-person change, variation, or experience over time — and when proximity to the event matters (e.g., mood fluctuation, daily stress, health behaviour, relational dynamics). It is also well-suited when retrospective recall would introduce systematic distortion, such as research on eating behaviour, pain, or interpersonal conflict. Do not use diaries when: (a) the phenomenon is rare enough that participants may go days or weeks without a recordable event; (b) the population cannot sustain the burden of repeated entries (e.g., severe cognitive impairment); (c) the research question calls for a single cross-sectional snapshot rather than temporal process; or (d) tight experimental control over stimulus presentation is required.

Limitations and considerations

  • Compliance degrades over time; longer study periods see higher rates of missing entries, selective dropout, or retrospective filling-in.
  • Reactivity: the act of diary-keeping can change the very behaviours or thoughts being recorded, introducing a measurement artefact.
  • Open narrative diaries produce large volumes of text that are time-intensive to code and analyse.
  • Participants must be able and willing to record entries consistently — populations with low literacy, high time pressure, or limited digital access present practical barriers.

Source conditions do not replace independent scientific review or validation by an analysis engine.

Strengths

  • Captures naturally occurring behaviour and experience in context, close in time to the event, sharply reducing retrospective recall bias.
  • Enables within-person analysis, revealing how the same individual varies across days or situations — a level of granularity impossible with single-occasion surveys.
  • Flexible format: open narrative entries suit qualitative questions; structured rating scales suit quantitative or mixed designs.
  • Participants become active recorders of their own lives, which can itself increase engagement and reflective awareness.
  • Suitable for longitudinal research without requiring repeated lab or clinic visits, making large geographically dispersed samples feasible.

Applications

  • Tracking daily stress, mood, and coping in clinical and health psychology research.
  • Studying eating behaviour, physical activity, or sleep patterns in health and nutrition research.
  • Examining relationship quality, conflict, and social support in close-relationships and family research.
  • Capturing the daily work experiences, task demands, and emotional labour of employees in organisational research.
  • Documenting language use, literacy events, or learning episodes in educational and applied-linguistics research.
  • Investigating symptom fluctuation and illness management in chronic disease and patient-experience studies.

How it works

How it works

1

The researcher decides on the diary format (open narrative, structured rating scales, or a combination), the recording schedule (interval-contingent: fixed times each day; signal-contingent: random prompts; event-contingent: triggered by a target event), the study duration, and the medium (paper booklet, email, app, or SMS). The format must be light enough that participants can complete it consistently without fatigue.

2

Participants who have direct experience of the phenomenon under study are selected and fully briefed. They receive clear instructions, an example entry, and any tools needed (paper diary, app login). Crucially, they are trained to record entries promptly and not to fill in missed days retrospectively, as delayed entries reintroduce the recall bias the method is designed to eliminate.

3

Participants complete diary entries over the agreed study period — typically from a few days to several weeks, rarely beyond three months without attrition risk. Each entry captures the target variables (feelings, behaviours, events) at or close to the moment of experience. Prompts or reminder notifications help maintain compliance without being so frequent as to feel intrusive.

4

The researcher checks compliance during the data-collection window: reviewing submission rates, sending gentle reminders for missed entries, and conducting brief mid-study check-ins if the study is long. Early dropout and entry quality issues are identified and addressed before they compromise the dataset, since no amount of post-hoc analysis can recover data that was never recorded.

5

Completed diaries are compiled and analysed according to the data type. Qualitative entries undergo thematic or narrative analysis to identify recurring themes and within-person patterns. Quantitative ratings support multilevel modelling or time-series analysis to partition between-person and within-person variance. Mixed diaries allow triangulation of the two analytical streams.

Common pitfalls

  • Setting an entry burden that is too heavy: asking for long, detailed entries multiple times a day leads to fatigue, shallow entries, and dropout. Pilot the format to calibrate realistic length.
  • Allowing retrospective filling-in: if participants complete missed entries days later, the core advantage of the method — proximity to the event — is lost. Build in time-stamping or submission windows to detect this.
  • Ignoring attrition: participants who drop out are rarely random; they tend to be those experiencing the most demanding versions of the phenomenon. Analyse dropout patterns before drawing conclusions from completers only.
  • Conflating diary method with experience sampling method (ESM): ESM uses random signal-contingent prompts specifically designed for ecological momentary assessment, often at very high frequency. The diary method is broader and typically lower-frequency; treat them as distinct designs with different analytic assumptions.
  • Neglecting the training phase: participants who receive only brief instructions produce inconsistent entries. Adequate orientation — including a practice entry — is essential for data quality.

Frequently asked questions

How long should the diary study period be?

There is no universal rule; the period should be long enough to capture meaningful within-person variation but short enough to sustain compliance. Most published studies run between one and four weeks. Studies shorter than three days risk missing the phenomenon of interest; studies beyond two months see sharp attrition unless entries are very brief and participants are highly motivated.

How many participants do I need?

Sample size depends on the analytic goal. For qualitative thematic analysis, 10–20 participants generating rich narrative entries is often sufficient to reach saturation. For multilevel modelling of quantitative data, at least 30–50 participants and 10–20 occasions per person are common minimum recommendations, though power depends heavily on the expected effect size and the intraclass correlation.

What is the difference between a diary method and experience sampling (ESM)?

Experience sampling method (ESM) is a specific variant that uses randomly timed signal-contingent prompts — typically multiple times per day — to capture momentary states with minimal memory bias. The diary method is a broader family that includes interval-contingent (end-of-day) and event-contingent designs at lower frequency, and often accommodates narrative as well as structured data. ESM is the stronger design for momentary states; diaries are more practical for daily summaries or less frequent events.

Can diary data be analysed quantitatively?

Yes. When diary entries include structured rating scales or counts, the resulting multilevel data (occasions nested within persons) are typically analysed with multilevel modelling (HLM / mixed-effects models), which partitions variance into within-person and between-person components. This allows researchers to ask both how people differ on average and how the same person varies across situations.

How do I minimise reactivity?

Full elimination is rarely possible, but reactivity can be reduced by: using shorter, less obtrusive entry formats; framing entries as simple records rather than self-improvement exercises; including a brief run-in period whose data are excluded from analysis to allow initial reactivity to diminish; and measuring reactivity directly by including a reactivity check item.

Related methods

Sources

  1. Alaszewski, A. (2006). Using Diaries for Social Research. Sage.

    ISBN: 978-0761941415
    Copied.
  2. Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54(1), 579–616.

    Open DOI reference
    Copied.