Custom Audience Sampling

Setting Sampling Parameters

Userleap offers the ability to customize the audience samplings for the Web and Mobile platforms.



Sprig, by default, will determine the total number of responses that need to be collected in order to meet statistical significance (yes we do all the math, so you don't have to!).

When adjusting microsurvey sampling, there are two things you have to consider:

  1. Delivery Options
  2. Setting Confidence

There are two delivery options to choose from, Deliver until statistically confident or Deliver Continuously.

Deliver Until Statistically Confident



Sprig will collect a fixed number of responses, after which the microsurvey will be set to complete.

Deliver Continuously



Sprig will deliver a fixed number of responses per day and will continue doing so until paused (or marked as completed).

Setting Confidence

We automatically recommend that all microsurveys run at the 95% confidence interval (High confidence, slower results). However, you do have the option to adjust to accommodate your own user research needs.


  • Lower confidence, fastest results (80% confidence interval)
  • Medium confidence, faster results (90% confidence interval)
  • High confidence, slower results (95% confidence interval)
  • Highest confidence, slowest results (98% confidence interval)
  • Custom

Custom Audience Sampling

Sprig incorporates best in class practices to limit sampling bias. How does this sampling work? We use what's known as the leaky bucket.

What you should know is that under standard guidelines, not everyone that qualifies for a microsurvey will receive one. Instead, we throttle sends to ensure a microsurvey runs over a period of time (days or in some cases a week, depending on response rate)

How to Override Sampling in Sprig

Want to have more control over your microsurvey delivery? By setting a Sprig microsurvey to Deliver Continuously AND selecting Custom from the dropdown you can effectively nullify our pre-sets for sampling


📘

Info

Please enter a value between 1 - 100% for custom sampling. Setting this value to 100% will ensure that all qualifying users will receive a microsurvey.

Another option is to tell Sprig exactly how many responses to collect before the microsurvey should be set to complete