Blog topic

Survey Design & Measurement

For organizations and research teams developing questionnaires, adapting scales, or deciding whether their scores are trustworthy. Explore questionnaire validation, adaptation, reliability, factor analysis, and comparisons across groups. Use the free measurement-review checklist to plan the evidence your intended decisions require.

Start with your measurement question

Developing a questionnaire?
Plan validation around the decisions your scores will support.
Changing an existing scale?
Review what shortening, translation, or new wording changes.
Reporting reliability?
Choose and explain alpha or omega for your intended score.
Investigating the factor structure?
Decide whether to explore a structure or evaluate a specified model.
Comparing groups or time points?
Check whether the scores support comparable interpretations.

Bring the decisions together in the free printable measurement-review checklist.

Browse topics

All articles Statistical Analysis Survey Design & Measurement Study Design Program Evaluation AI Evaluation Statistical Consulting Data Literacy

Featured

{{ p.readingTime }} min read

Survey Design & Measurement

Cronbach’s Alpha vs. Omega: What Should You Report?

3 min read

Choose a reliability estimate that matches your score and measurement model, and explain what the number can support.

Read post →

Survey Design & Measurement

EFA vs. CFA: Which Does Your Questionnaire Need?

3 min read

Use exploratory factor analysis to investigate structure and confirmatory factor analysis to evaluate a specified model. Plan the distinction before collecting data.

Read post →

Survey Design & Measurement

Can You Compare Survey Scores Across Different Groups?

3 min read

Before interpreting a group difference, investigate whether the questionnaire measures the same construct in comparable ways.

Read post →

Survey Design & Measurement

How to Validate a Questionnaire for Your Organization

4 min read

A published scale or a high reliability coefficient does not settle whether your scores support your decisions. Plan the evidence around your respondents and intended use.

Read post →

Survey Design & Measurement

Can You Change a Validated Questionnaire?

4 min read

Shortening a scale, changing response options, or translating items can change what its scores mean. Document the changes and match the new evidence to the intended use.

Read post →

Study DesignAI EvaluationSurvey Design & Measurement

How Do You Measure Inter-Rater Reliability?

3 min read

Percent agreement and correlation can look excellent when raters barely agree. How to choose between Cohen's kappa, Krippendorff's alpha, and the ICC.

Read post →

AI EvaluationSurvey Design & Measurement

The AI Raters That Scored Like Humans and Judged Nothing Like Them

4 min read

Nine LLMs rating hate speech correlated with human judgments at 0.911 — a number that would pass almost any validation check. Decomposed into its parts, the two scales disagreed on severity, item calibration, question order, and who the comment was about.