Survey Diagnostics Funnel

Understand the estimated population of end users at particular steps in Sprig’s survey selection and contact engine

Survey Diagnostics Funnel Overview

The Survey Diagnostics Funnel allows you to understand the estimated population of end users at particular steps in Sprig’s survey selection and contact engine. The funnel will enable study owners to self diagnose why they may not be getting as many responses as expected and troubleshoot survey design.

Inspect Response Rate Modal

Inspect Response Rate Modal

Using the Diagnostics Funnel

  1. For any active or completed Web or Mobile Survey, navigate to the Survey Results page.
  2. Select Inspect to launch the Inspect Response Rate modal.
  1. The debugger will show you a list of checkpoints and the estimated population of end users at each checkpoint.

Note on Limitations:

  • Survey Diagnostics Funnel will be unavailable for surveys completed before October 2023.
  • Audience population estimations are limited to the last 30 days of an active survey.
  • If any edit is made to an active study, including copy updates or targeting criteria, the diagnostics funnel will reset and begin collecting data from time last updated.
Launch from the Response Rate tile

Launch from the Response Rate tile

Checkpoints

Checkpoint steps and corrective measures are detailed below:

CheckpointStep DetailsPossible Corrective Measure
Has required SDK*Users that are sent to Sprig and have the correct SDK installed Update SDK version
Met resurvey criteriaUsers that are qualified based on global or survey level recontact period settings Override global contact period, or adjust survey level recontact period
Triggered eventUsers that triggered the survey contact eventAdd additional events to trigger this survey
Hadn't seen this study yetUsers that have not seen this survey before
(Shown only when “Show once per user” is on)
Adjust “Show once per user” setting
Matched filtersUsers that meet Audience, Event, or Group targeting filter criteria
(Shown only when at least one filter set)
Adjust filter settings to be more inclusive, or verify that filters are configured correctly
Included in send limitStudy send limit (#of times per day or sampling) settings are captured under Audience > Response settings
(Shown only when this count is different than the previous stage)Adjust sampling or send limit criteria to be more expansive
Selected for this studyStep is relevant only when multiple studies have the same targeting criteria
(Shown only when # selected for this study differs from previous step)
Modify this study, or a conflicting study to have different triggering events
Received studyUsers that have received the studyN/A
Viewed studyUsers that have viewed the studyModify the "waiting period" delay to be shorter
Started respondingUsers that have started respondingN/A
Completed studyUsers that have completed the entire surveyUpdate study design (shorter, question types, etc) to increase completion rates

*For mobile studies, if SDK update is bundled with an app update, end users will need to update your native app in order to qualify for a study with a minimum SDK requirement.

FAQs

How is overall response rate calculated?

The response rate graph is calculated by dividing the number of responded surveys by the number of seen surveys within a day based in Universal Time Coordinated (UTC).