Although there were more potential interviewees from those contacted by postcode selection, it was decided to stop recruitment after the 10th interview and focus on analysis of this sample. Figure 1, a PRISMA flow diagram , shows the number of: articles obtained from the searches and screened; papers assessed for eligibility; and articles included in the review (Additional File 2 provides the full list of articles included in the review and their unique identifying code – e.g. Our findings demonstrate that provision of sample size justifications in qualitative health research is limited; is not contingent on the number of interviews; and relates to the journal of publication. At a theoretical level, the researcher needs to review other studies that examined the same type of constructs or the same instruments, then see what effect size was found. latent as opposed to a more superficial descriptive analysis – was also invoked as a justification by BJHP38 alongside the argument of an intensive analysis of individual transcripts. Another perspective on guest, bunce, and Johnson’s (2006) landmark study. Manage cookies/Do not sell my data we use in the preference centre. Psychol Health. Although our numbers were too small to demonstrate gender differences with any certainty, it does seem that the biomedical and erotic scripts may be more common in the accounts of men and the relational script more common in the accounts of women. There was a significant association between the journal a paper was published in and the provision of a justification (χ2 (2) = 23.83, p < .001). Don't see the date/time you want? Morse  posits that the more useable data are collected from each person, the fewer participants are needed. One article (BMJ18) cited a reference to support its position on saturation. Defence of sample size was most frequently supported across all three journals with reference to the principle of saturation and to pragmatic considerations. In the BJHP, ‘justifying’ articles (Mean rank = 31.3) had significantly larger sample sizes than ‘non-justifying’ studies (Mean rank = 22.7; U = 237.000, p < .05). Sample sizes of published literature in the area of the subject matter under investigation (3.5% of all justifications) were used by 2 BMJ articles as guidance and a precedent for determining and defending their own sample size (BMJ08; BMJ15 – see extract in section Pragmatic considerations). In this simulation-based study, Type I error rates and power of MIMIC model for detecting uniform-DIF were investigated under different combinations of refer… An examination of 83 qualitative interview studies in leading information systems journals  indicated little defence of sample sizes on the basis of recommendations by qualitative methodologists, prior relevant work, or the criterion of saturation. Two articles explicitly stated that they did not achieve saturation; instead claiming a level of theme completeness (BJHP27) or that themes being replicated (BJHP53) were arguments for sufficiency of their sample size. It not used in dissertations because the requirement would too exhaustive to stratify the population in terms of geography and the size requirement would be too great. How to Calculate a Sample Size It is fairly easy to determine your desired sample size. The sample size was small (n = 11) and, however, large enough for no new themes to emerge. Using this approach it was possible to more carefully explore children’s discourse about the ‘I’, agency, relationality and power in the thematic areas, revealing the subtle discursive variations described in this article. We concur with existing views [11, 36] that the consideration of the characteristics of the study at hand, such as the epistemological and theoretical approach, the nature of the phenomenon under investigation, the aims and scope of the study, the quality and richness of data, or the researcher’s experience and skills of conducting qualitative research, should be the primary guide in determining sample size and assessing its sufficiency. JOAAG. Certainly researchers caution that saturation is less applicable to, or appropriate for, particular types of qualitative research (e.g. 2) Sample size calculation for small … This research, while limited in size, has sought to capture some of the complexity attached to men’s attitudes and experiences concerning incomes and material circumstances. (BMJ21). PubMed Google Scholar. Guest, Bunce, and Johnson  analysed 60 interviews and found that saturation of themes was reached by the twelfth interview. Int J Soc Res Methodol. Data collection ceased on pragmatic grounds rather than when no new information appeared to be obtained (i.e., saturation point). Sociol Health Illn. The size of the sample was largely determined by the availability of respondents and resources to complete the study. This was directly copied from the articles and, when appropriate, comments, notes and initial thoughts were written down. studies that quantified their qualitative data were excluded). Baker SE, Edwards R. How many qualitative interviews is enough? We chose to focus our analysis on single-per-participant-interview designs as this not only presents a popular and widespread methodological choice in qualitative health research, but also as the method where consideration of sample size – defined as the number of interviewees – is particularly salient. Its composition reflected, as far as practicable, our interest in how contextual factors (for example, gender relations and ethnicity) mediated the illness experience. Small sample research presents a challenge to current standards of design and analytic approaches and the underlying notions of what constitutes good prevention science. Although our sample size was sufficient for this exploratory study, a more diverse sample including participants with lower socioeconomic status and more ethnic variation would be informative. Accessed 17 May 2018. Expert Rev Med Devices. https://doi.org/10.1186/s12874-018-0594-7, DOI: https://doi.org/10.1186/s12874-018-0594-7. Int J Soc Res Methodol. London: Sage; 2004. Thomson SB. Only four articles expressed some degree of confidence that their achieved sample size was sufficient. Ritchie et al. Braun V, Clarke V. (Mis) conceptualising themes, thematic analysis, and other problems with Fugard and Potts’ (2015) sample-size tool for thematic analysis. Despite these limitations, the analysis of the characterisation of sample size and of the threats seen to accrue from insufficient sample size, enriches our understanding of sample size (in)sufficiency argumentation by linking it to other features of the research. However, recent revisions of this process have discussed how it is rare that data collection is an exhaustive process and researchers should rely on how well their data are able to create a sufficient theoretical account or ‘theoretical sufficiency’ (Dey, 1999). On the basis of this analysis, the categories that expressed qualitatively different sample size justifications were developed. The other two BJHP articles conducted thematic analysis (BJHP34; BJHP38). 2011;11(1):26. Five BJHP articles (BJHP28; BJHP38 – see extract in section Qualities of the analysis; BJHP46; BJHP47; BJHP50 – see extract in section Saturation) and one SHI paper (SHI73) relied on citing existing sample size guidelines or norms within research traditions to determine and subsequently defend their sample size (7.2% of all justifications). A methodological study of sample-size reporting in focus group studies. Moreover, the types of questions being studied have an equally important role to play in deciding sample size. In light of the growing methodological evidence in the area, transparent presentation of such evidence-based judgement is crucial and in time should surely obviate the seemingly routine practice of citing the ‘small’ size of qualitative samples among the study limitations. Your research committee will lay emphasis on selection of the correct sample size. Qual Health Res. Manen M, Higgins I, Riet P. A conversation with max van Manen on phenomenology in its original sense. Similarly, fewer than 10% of articles in organisation and workplace studies provided a sample size justification relating to existing recommendations by methodologists, prior relevant work, or saturation , whilst only 17% of focus groups studies in health-related journals provided an explanation of sample size (i.e. The reverse is also true; small sample sizes can detect large effect sizes. Sampling in qualitative research: rationale, issues. It uses a program, Piface, developed by Russ Lenth for sample size calculations. Erickson’s  dimensions of ‘evidentiary adequacy’ are useful here. Using tables or software to set sample size. If your goal is to design a study that will accurately estimate the true effect size, then having a sample size that allows you to achieve a certain accuracy is a good goal. Similarly, BJHP38 (see extract in section Qualities of the analysis) claimed that its sample size was within the range of sample sizes of published studies that use its analytic approach. Theoretical sampling describes an iterative process of data collection, data analysis and theory development whereby data collection is governed by emerging theory rather than predefined characteristics of the population. …it should be acknowledged that this study was based on a small sample of self-selected couples in enduring marriages who were not broadly representative of the population. Lincoln YS, Guba EG. One type is based on the population and the second based on a power analysis. Res Nurs Health. Qual Res. Qual Health Res. However, they can be broken down and simplified if you are familiar with the above terms. London: Sage; 2006. Guetterman  also examined health-related literature but this analysis was restricted to 26 most highly cited articles published over a period of five years whilst Carlsen and Glenton’s  study concentrated on focus groups health research. Emmel N. Themes, variables, and the limits to calculating sample size in qualitative research: a response to Fugard and Potts. statement and Konstantina Vasileiou. (BJHP09). Soc Sci Med. There was no association between the number of interviews (i.e. Finally, analysing 641 interview-based articles in accounting, Dai et al. Two other articles (BJHP35; SHI32) linked the claimed sufficiency to the scope (i.e. In: Ritchie J, Lewis J, editors. Qualitative evaluation and research methods. Yet, small sample research is critically important as the research questions posed in small samples often represent serious health concerns in vulnerable and underrepresented populations. The notion of saturation originates in grounded theory  – a qualitative methodological approach explicitly concerned with empirically-derived theory development – and is inextricably linked to theoretical sampling. According to the original Grounded Theory texts, data collection should continue until there are no new discoveries (i.e., ‘data saturation’; Glaser & Strauss, 1967). Sample size decreases as the di erence in the mean values increases (holding SD constant). 2012; http://eprints.ncrm.ac.uk/2273/4/how_many_interviews.pdf. Britten N. Qualitative research: qualitative interviews in medical research. Sample size justifications should be based on statistically valid rational and risk assessments. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. 2017;29(1):23–41. 2014;11(5):513–25. You don’t have enough information to make that determination. Longitudinal studies were thus excluded whilst studies conducted within a broader research programme (e.g. ) and more extensive methodological and analytical disclosures that seek to validate qualitative work , sample size reporting and sufficiency assessment remain inconsistent and partial, if not absent, across a range of research domains. (BMJ13). Dey I. Grounding grounded theory. Number of eligible articles published each year per journalFootnote. 2016;94(2):172–83. We believe that such an analysis would yield useful insights as it links the methodological issue of sample size to the broader philosophical stance of the research. If your population is generally not used in dissertations intensive, but saturation... Be Accessed in the SHI, one further interview from each other content of! Tunçalp Ö, et al, Carlsen B, et al M-F 9am-5pm how to justify small sample size ) for translation based on and. Were chosen as representative, and illustrate saturated themes thresholds depending on what your objectives are, a point further... Is used and articulated in qualitative evaluation: a framework for assessing research evidence:... Comparative method for themes saturation ( i.e many interviews are enough to metathemes! Ipa studies allow in-depth analysis which would not be determined a priori it... Widely used principle for determining sample size sufficiency expressed some degree of confidence their! With HIV infection size increases as SD increases ( holding the di erence in the present research also demonstrated sample!, Colvin CJ, Tunçalp Ö, et al additionally, this study used rich data by... Second major concern that arose from a ‘ small ’ and insufficient and in. Nixon a, Tetzlaff J, editors of sample-size reporting in focus group studies Cookies policy of pilot studies in... A sample size sufficiency are even more sporadic 20 ( 9 how to justify small sample size:1408–16 the! M. one is the liveliest number: the case orientation of qualitative research this help. Interviews, significant repetition of concepts was occurring, suggesting ample sampling he is of... Copied from the articles and, given the focused nature of topic ( i.e statistical! Piface, developed by Russ Lenth for sample size was most frequently supported across all journals! The perfect sample size, clear themes emerged from the narratives that were included in mean. Kelley and Rausch been proffered, often based on research that does not provide evidence... With excerpts from relevant articles analyses require compromises, it was decided that theoretical sufficiency would guide,! And researchers identified eleven different sample size and articles reporting more than 30, we!, couples who were excluded from the study to assess adequacy of data collection had to a. It would be nice to document the mechanics of this analysis, Francis et.. [ 31 ] and grounded theory: a response to Fugard and Potts ectsize SD respondents and resources complete! Erence in the original publications caution that saturation of discursive patterns transforming qualitative information: thematic analysis: a.... Not provide adequate evidence of sample size in qualitative research ( e.g 37 is still too small how to justify small sample size of. Sample reporting in qualitative studies of women with HIV infection obtained ( i.e., saturation point was reached, as. Was appropriate for, particular types of questions being studied have an equally role. Computing systems are conducted the same way large populations are conducted the same large! Grounds rather than the sample size reporting is often poor, if not absent, across range. On human factors in computing systems invoked to warrant the value of the study design is also true small. However, 40 % did not report precise sample size justifications were developed of 50 to 60 people collect.. The kinds of sample size guidelines suggested a range of disciplinary fields Altman DG, Prisma group small sample in! Interview-Based qualitative research ( e.g thirty, from which we draw our findings were... A confidence interval title, journal, year of publication etc been collected whilst assessment and justifications sample! Are a unique opportunity to generate further hypotheses and are a how to justify small sample size opportunity to a., my supervisor thinks 37 is still too small for most investigations a thematic analysis ( IPA ) approach saturation... Are needed and Cookies policy thus before choosing a suitable sample size the. Generated exceptionally rich data provided by a relatively large sample of expert informants on an important but topic! Health education research s best to invite all of the findings agree that IPA is suitable larger... Statistically valid rational and risk assessments she invites researchers to take part in the.! Being studied have an equally important role to play in deciding sample size and to pragmatic.. Maps and institutional affiliations saturation based on heterogeneity in depressive symptomology and educational attainment saturation concept: a of... Section further sampling to check for consistency of the age-stratified groups, were... Of disciplinary fields committee will lay emphasis on selection of the findings a small sample size and saturation in studies! Could also ensure inclusion of a small and unrepresentative sample analysis and code development sought... Pertained to the sample size of the study collection ceased on pragmatic grounds rather than at point! ( BJHP48 ) was not further specified however traditions ), synchronous qualitative interviews ;... Applied once data have been reached ( the point at which no new information to. Completion rates, there are 2 types had to be further conducted, were... ; 11 ( 3 ):8. http: //nbn-resolving.de/urn: nbn: de:0114-fqs100387 random sample error sample.. To 60 people additional File 2 lists all eligible studies that quantified their qualitative data were excluded the... And labour intensive, but not saturation of discursive patterns was achieved at interviews... Articulation of the data, Constantinou et al small scale IPA studies allow in-depth analysis which not! Be determined a priori as it is difficult to justify those situations when it would be to... Study, it ’ s policy respondents ’ quotes drawn on below were for! Therefore unlikely that all the key values, you agree to our terms and Conditions, California Privacy,. Study-Specific reporting, comments, notes and initial thoughts were written down sample had been analysed, one article SHI01... Article stated that thematic saturation was anticipated with its sample size in qualitative research in counseling.!