You can sometimes adapt a questionnaire, but the original validation evidence does not automatically apply to the revised version. What matters is whether the changes affect the meaning of the answers, the score, or the decision you want to make.
Start with the instrument's permissions and documentation, then plan the measurement review. Permission to modify an instrument and evidence supporting its revised scores are separate questions. This guide addresses measurement implications; it does not interpret a particular license.
Changes can include deleting items, rewriting wording, translating into another language, changing response options or recall periods, altering instructions, switching administration formats, and changing scoring rules.
Their implications differ. A layout revision may leave the wording intact yet change what respondents notice or how they navigate. Replacing “during the past week” with “during the past year” changes the task respondents perform. Document the change rather than relying on whether it feels minor.
First check whether the instrument already has an appropriate short form and whether its evidence supports your intended use. Selecting a published version with relevant evidence is different from creating a new short form.
If you remove items yourself, consider which parts of the concept disappear. A shorter scale could retain a high consistency coefficient while covering a narrower construct. Deleting an item because alpha increases is not enough to justify the change.
Review coverage and scoring, investigate the revised structure and precision, and examine whether the shortened scores support the intended interpretation. Do not keep the original name, reference values, or cutoffs in a way that implies the versions are interchangeable without supporting evidence.
Wording that sounds more familiar may also change the situation or behavior being described. Suppose a fictional organization changes an item about asking a supervisor for help to an item about asking anyone for help. The revision broadens the relationship being measured, even though the new wording is easier to answer.
Ask respondents from the intended population to explain how they understood the original and revised wording. Combine those findings with subject-matter review. Record why each change was needed and which interpretation it is meant to preserve or revise.
Replacing agreement categories with frequency categories changes the answer being requested. Reducing the number of response options can also affect score distributions and precision. Changing the recall period may alter both what experiences are included and how easily they can be remembered.
Specify the revised scoring and missing-response rules before examining outcomes. Do not assume that a rescaled number has the same interpretation as the original score merely because both can be converted to a percentage.
Translation requires attention to cultural and linguistic meaning as well as literal wording. The International Test Commission's adaptation guidance covers preparation, development, confirmation, administration, scoring, interpretation, and documentation.
Use an appropriate translation and review process, involve people familiar with the target population, and evaluate how the items are understood. Back-translation can reveal discrepancies, but it is not, by itself, evidence that the two versions measure comparably.
If you plan to compare scores across languages or groups, that comparison needs its own supporting evidence. An acceptable reliability estimate in each group does not establish equivalent score meaning.
Keep the instrument version and administration date attached to each record. Do not quietly pool raw scores across versions or report a trend as though the measure never changed. Review whether a linking or comparison study is feasible and what claims the existing records can support.
If no evidence establishes comparability, separate descriptive reporting may be more defensible than a single combined score. More responses cannot, by themselves, resolve a change in what is being measured.
Use the free measurement-review checklist to document the version, changes, and open questions. For a broader plan, see How to Validate a Questionnaire for Your Organization. DASS can help review a proposed adaptation before it becomes another round of data that is hard to interpret.
One email whenever we publish something new. No spam, unsubscribe anytime.
{{ subscribeErrorMsg }}