How to Calculate Statistically Significant Sample Size - Affiliate Marketing Blog by Geno Prussakov

Every year we see multiple surveys being conducted around various areas of digital marketing, but sometimes when looking at the number of respondents, we think: “Nah… This is just too small of an audience to be indicative of the overall trend!” or “350 people they’ve surveyed can’t be sufficient enough of a number to make the conclusions they’re making for the whole industry!”

In some cases, the above reactions may be right, while in others a statistically significant sample size may actually be very different from what we may imagine it should be.

Definition first:

Statistical significance — put simply, this is the likelihood that a finding or a result is caused by something other than just chance. Usually, this is set at less than 5% probability (p< 0.05), meaning that the result is at least 95% likely to be accurate (or that this result would be produced by chance no more than 5% of the time). [source]

Now let’s turn to our statistically significant sample size. How do we determine how large it has to be (to ensure our survey findings are most likely to be accurate than not)?

The following table from a paper by Bartlett, Kotrlik & Higgins answers the question:

Table for Determining Minimum Sample Size for Continuous and Categorical Data

Read about the differences between continuous and categorical data here and here. Also, see the original Organizational Research: Determining Appropriate Sample Size in Survey Research manuscript (PDF file).

About Geno Prussakov

CEO & Founder of AM Navigator – an award-winning OPM agency. Founder & Chair of Affiliate Management Days conference. Author of numerous books including "Affiliate Program Management: An Hour a Day" (2011) and "Quick Start Guide to Affiliate Marketing" (2013), international speaker, marketing consultant, affiliate and influencer marketing evangelist.

Tags: ,

3 Responses to “How to Calculate Statistically Significant Sample Size”

  1. […] at statistical confidence (although a smaller sampler might be just fine in some cases). Naturally there’s a proper statistical way to go about determining the needed samples size, but unless you’re a data geek, use this […]

  2. […] at statistical confidence (although a smaller sampler might be just fine in some cases). Naturally there’s a proper statistical way to go about determining the needed samples size, but unless you’re a data geek, use this […]

  3. […] at statistical confidence (although a smaller sampler might be just fine in some cases). Naturally there’s a proper statistical way to go about determining the needed samples size, but unless you’re a data geek, use this […]

Leave a Reply

You can use these tags: <a href="" title="" rel=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>