Feedback and Data

The Benefits of Using Online Survey Tools: A Guide

A plain guide to building an online survey: question types, sensible length, neutral wording and how to read results without over-claiming from small samples.

On this page
  1. What online survey tools do well
  2. Start with the decision, not the questions
  3. Common question types
  4. Wording that avoids bias
  5. Length and order
  6. Test before you send
  7. Reading the results without over-claiming
  8. Presenting what you found
  9. Ethics and respect for respondents

What online survey tools do well

An online survey tool lets you write questions, send a link, and collect answers into a table. Compared with gathering opinions by email or in conversation, it offers a few real advantages: answers arrive in a consistent format, respondents can reply when it suits them, simple logic can skip irrelevant questions, and the results are ready to summarize. The tool cannot do the hardest part, though. A survey is only as useful as its questions and the people who answer it.

Start with the decision, not the questions

Before writing anything, finish this sentence: “After this survey, I will decide whether to ___.” If you cannot, the survey is probably too vague. Each question should earn its place by informing that decision. A question that is merely interesting adds length and lowers the number of people who finish.

Also decide who you need to hear from. Asking existing customers, newsletter readers or course learners yields different answers, and none of them speak for people outside the group.

Common question types

  • Multiple choice (single answer). Easy to answer and to count. Make sure the options do not overlap and include “Other” or “Not applicable” where appropriate.
  • Checkboxes (multiple answers). Useful when more than one option may apply. Counting becomes more complex, since percentages will add up to more than 100.
  • Rating scales. For example, 1 to 5 from “strongly disagree” to “strongly agree”. Label the ends, and keep the direction consistent across questions.
  • Ranking. Ask respondents to order items. This is tiring beyond four or five items.
  • Open text. Rich and unexpected, but slow to read and summarize. Use a few, and place them where people have something to say.
  • Yes or no. Simple, but it hides nuance. Use it for factual questions.

Wording that avoids bias

Small changes in wording can change answers, so keep questions neutral and concrete.

  • Avoid leading questions. “How great was our support?” nudges people toward praise. “How would you rate our support?” is more neutral.
  • Avoid double-barreled questions. “Was the course clear and affordable?” asks two things. Someone who found it clear but costly cannot answer honestly.
  • Avoid jargon. If respondents may not know a term, use plain words.
  • Be specific about time. “In the last month” is easier to answer accurately than “recently”.
  • Provide balanced options. If you offer three positive choices and one negative one, results will lean positive.
  • Keep sensitive questions optional. Ask about personal details only when you need them, and say why.

Length and order

Shorter surveys are generally finished by more people. A common guideline is to keep a survey to a few minutes, which often means roughly five to ten well-chosen questions, though the right length depends on your audience and how motivated they are. State the expected time at the start, and be honest about it.

Order matters too. Start with easy, engaging questions, group related topics together, and put demographic or personal questions near the end. Show a progress indicator if your tool offers one. Check that the survey works on a phone, since many people will open the link there, and follow the habits in mobile design basics: short questions, large tap targets and little horizontal scrolling. Clear wording and accessible form design also matter for respondents using assistive technology, which ties into web accessibility.

Test before you send

Ask two or three people, ideally from your intended audience, to complete the survey while telling you what they think each question means. You will usually find at least one question that is read differently than you intended. Fix those, then check that skip logic works and that the results arrive in the table the way you expect.

Reading the results without over-claiming

This is where many surveys go wrong. Some principles keep you honest.

Sample size and who answered. Suppose, hypothetically, you send a survey to 200 readers and 40 respond. The response rate is 40 / 200 = 20 percent. If 30 of those 40 say they would like a weekly digest, that is 75 percent of respondents, but only 30 out of 200 readers, or 15 percent, actually said so. The other 160 are unknown. People who respond often differ from people who do not, so the figure describes respondents, not your whole audience.

Small groups swing widely. With 10 respondents, one person is 10 percent. A difference between 6 and 4 people is not a reliable finding. Report the counts alongside the percentages, and avoid presenting small differences as meaningful.

Averages on rating scales. An average of 3.5 out of 5 can come from everyone choosing 3 or 4, or from a split between 1s and 5s. Look at the distribution, and consider why a median average may tell a different story than the mean.

Open-ended answers. Read them all if you can, group them into themes, and quote a few representative comments. Keep in mind that vivid comments feel more common than they are.

Cause and effect. If learners who watched more lessons also report higher satisfaction, the survey cannot tell you which led to which, or whether something else explains both.

Do not stretch the claim. Write “Of the 40 people who replied, 30 said…” instead of “75 percent of our audience wants…”. The first is accurate, the second is a guess.

Presenting what you found

Before drawing charts, tidy the data: remove obvious test entries, check for duplicates and handle blank answers consistently, as covered in data cleaning. A bar chart sorted by response count is usually clearer than a pie, and the right chart types help you match a visual to the question asked. Share findings with the number of respondents shown on every chart.

Ethics and respect for respondents

Tell people who is running the survey, how responses will be used and whether answers are anonymous. If you collect email addresses or other personal details, store them carefully and collect no more than needed; a plain statement on a privacy policy page helps set expectations. Do not promise anonymity if your setup can identify people. Finally, thank respondents and, where you can, share what you learned and what you will do about it. People who see their answers lead somewhere are more likely to respond next time.

Surveys are one source among several. Ongoing channels such as customer feedback tools catch problems you did not think to ask about, and the two work well together.

The complete guide to feedback and data

How to Use Online Tools for Data Analysis and Visualization
Read the guide

Keep exploring

Guides from other topics

All topics →