Skip to main content
Quotas allow you to get a balanced data set from their audience without needing to micromanage who the survey has been shared with. Balanced data allows for more in-depth analysis and ensures smaller populations are properly represented.

Overview

Surveys support response-based quotas. As respondents submit their responses to specified questions Sprig evaluates if the responses match the criteria for any quotas set up in the Survey. If the quota has not yet collected its target number of responses, and the respondent’s answers align with the criteria, they will be allowed to move forward and complete the Survey. If their answers don’t match any quota criteria, after the screener questions are complete the Survey will end for the respondent. 

Set Up Response-based Quotas

  1. Navigate to an existing or new Survey.
    1. It is possible to add a quota to an In-Progress Survey, more information on that below.
  2. Click Edit to access the Audience settings for the Survey.
  3. Scroll down to the Response Settings section.
  4. Select how the Survey should run.
    1. Until a specific number of responses are collected.
    2. Until a specific date.
    3. Ongoing.
  5. Use the toggle to enable quotas.
    1. Depending on how the survey is set to run, how quotas interact with that setting is slightly different:
      1. Specific number - the total of the quota targets will take precedence over anything in this field.
      2. Specific date - if quotas are still open when the specified date arrives, the survey will still move to Completed status; the date takes precedence.
      3. Ongoing - once all quotas are filled, the survey will change to “Competed.”
  6. Set how responses should be assigned to quotas using the Quotas Match setting.
    1. This is for when a respondent’s answers allow them to fit the criteria for multiple quotas.
    2. All Matching Quotas - every quota will be incremented.
    3. Least Filled - quota that is least filled will be incremented.
    4. Priority Order - quotas will be filled in the order they are listed in this section.
  7. Name the quota using the Segment field, for example “Millennial Vegan Coffee Drinkers.”
    1. This will be used to display responses and to filter responses on the Data and Responses tabs of the Survey.
  8. Set the responses that should be used to determine if a respondent matches the quota, for example:
    1. Do you drink coffee? > Yes.
    2. What diet do you follow? > Vegan.
    3. What is your age group? > 30 - 40.
  9. Add additional quotas as necessary.
  10. Set the message to display when the quota a respondent matches is full.
    1. This will show instead of the typical Thank You language added in the Study Builder.
  11. Set the message to display if a respondent’s answers result in them not matching any quota.
    1. This will show instead of the typical Thank You language added in the Study Builder.
  12. Continue building the Survey as normal.

Manage Quotas for Active Surveys

It is possible to work with quotas after a Survey has been launched with a few specific limitations:
  • The questions, response values, and operators defined in a quota can’t be changed, i.e. you cannot change the option of “Yes” in a Single Select to “Meh”.
  • Questions and responses that are used in a quota can’t be changed in the Survey Builder
  • Quotas can be added to an active Survey.
  • Quotas CANNOT be deleted from an active Survey.
  • The target (value) for a quota can be increased or decreased.
    • i.e. The quota target for Vegan coffee drinkers can be increased from 100 to 150.
    • If a target is decreased below the number of responses in the quota, the quota will be considered filled. The existing responses will remain in the quota.

Screener Questions

The following question types can be used as screeners for quotas:
  • Multi-Choice: Single Select
  • Rating Scale
  • NPS
When being used to specify criteria for a quota, the questions will be set to Required if not already required. We recommend not having any Display or Skip Logic on screener questions to ensure that responses can be correctly matched to quota criteria. If an answer for a question that’s part of quotas isn’t given because the question isn’t displayed, the respondent won’t be considered for quotas.

Respondent Experience

If a quota is still open, and the respondent’s answers match the criteria, the respondent will move forward in the Survey. Their response will only increment the quota count if they reach the end of the Survey. They will see the normal Thank You screen at the end of the Survey.  If a respondent’s answers do not match any quota after they complete all the screener questions, the Survey will end for them. They will see the Disqualification Message If a respondent’s answers matched a filled quota and the Survey was still open due to other quotas not being filled, they will see the Quota Filled Message. If all the quotas are filled, the Survey will show the “Survey closed” screen for them since its state will be “Completed.”
Closed Survey

Reviewing Responses in a Survey that has Quotas

When reviewing responses collected in a Survey that has quotas, the responses will be grouped in several ways:
  • By quota - this will use the name of the quota, “Millennial Vegan Coffee Drinkers”
    • A quota may have an Overflow group - this is where any respondents who matched the criteria but came in after the quota was filled will be shown (for example when multiple users submitted responses at once and the quota was nearly full). This group will also appear if you reduce a quota target for a quota that has already collected more responses than the new target allows. 
  • By Non-quota matches - these are respondents whose responses didn’t match any quotas.
When filtering responses by a quota on the Data or Responses tab of a Survey, a maximum of 3,000 responses will be shown. It is not possible to filter by the Non-quota matches group.

FAQs

How many quotas can a Survey have?
As many as needed, there is no limit.
Is a Survey required to have a quota?
No, Surveys do not need quotas, how they run can be controlled with the standard overall response limit, by specifying an end date, or allowing it to run continuously.
Why does my quota have more responses than I asked for?
If a quota is very close to filling, and several responses come in at the same time that qualify for that quota, they will all be added to that quota.
What kind of response counts towards a quota?
Only respondents who finish the Survey will count towards a quota. If someone passes the screener questions but drops out of the Survey before completing it, their response won’t count towards any quota. There response will be counted in the overall total for the Survey and it’ll be visible in the full response list and through the normal export options.