Online Survey Protections
Brief Overview
Most reputable study platforms, such as Qualtrics and SurveyMonkey, already provide somedetection and protection features from online bots. If additional protections are needed for onlinebots and survey speeders, the summary below are some recommendations and tools on howyou can protect your online survey. Additional protections can include designing a survey tocatch bots and speeders or using different technology resources to filter out bots.
Survey Design
- Add questions that check whether a survey taker is actually paying attention. Forexample, insert the instruction “Ignore the rest of the content of this passage and selectthe second response option” in a long question. Those who select anything other thanthe second option would then be flagged.
- Ask the same question at two separate points and check for differences in responses.
- Add questions that direct survey takers to skip one or more questions that are notapplicable to their circumstances. Those who did not skip questions would be flagged.
- Embed eligibility question checks within the survey to catch people who do not fit intoyour inclusion and exclusion criteria.
Use Technology
- Prevent “ballot-stuffing” by tracking IP addresses to prevent your survey from beingcompleted more than once from the same IP address.
- Provide a personal link for each participant to the survey and ensure the link can only beused once.
- Use Completely Automated Public turing Test to tell Computers and Humans Apart(CAPTCHA) or reCAPTCHA to prevent bot response.
- Include “honeypot” questions that are embedded in the survey. Human participants willnot be able to see these questions; however, bots would see these questions andrespond to them.
- Use metadata to track study time stamps for impossible dates and times.
- Prevent search engines from finding/indexing your survey. Search engines work bycreating what is called an index, or a map of all pages on the internet so they can besearched quickly. With the prevent indexing option, you can keep search engines fromfinding your survey and presenting it in their search results. If your survey is createdusingQualtrics, for example, the prevent indexing is selected by default under thesurvey options.
- Conduct a pre-screening survey prior to launching your survey, in order to filter out bots.
- Put the survey on a site that requires a unique username and password for eachparticipant
References and Tools
Image Credit: broken NEC CRT computer monitor by youngthousands(via Wikimedia Commons)