---
title: "Research Guard questionnaire review competitive analysis"
source: internal-research
created: "2026-04-18"
status: active
tags: [competitive, research-guard, questionnaire-review, qualtrics, internal]
---
# Competitive Analysis: Questionnaire Review Workflow vs Current Market Features
Date checked: 2026-04-18
## Scope
This note compares the current questionnaire review workflow defined in this repo against current external products that explicitly review, score, or guide questionnaire logic and design.
Important caveat:
- This repo is "the working space for designing, testing, and maintaining the artefacts" and "is not the production workflow itself" (`00_foundation/questionnaire_workflow_project_index_v1.md`).
- So this comparison separates:
- what the repo demonstrably specifies today
- what the repo implies as a product proposition if operationalized
- what vendors currently claim in their published product/help pages
## Executive Summary
- The strongest external benchmark is Qualtrics overall, because it combines build-time survey review, post-collection response-quality controls, and a documented enterprise security posture.
- The closest direct design-review competitor is Conjointly Script review, because it explicitly checks wording, scales, order, screening, response bias, and other methodological issues before launch.
- SurveyMonkey Genius is a meaningful but lighter competitor for questionnaire-review governance. However, SurveyMonkey's broader AI surface (default sentiment analysis, response quality scrubbing, thematic analysis) is expanding faster than the questionnaire-review comparison alone suggests.
- Toluna Start is a meaningful competitor where sample quality and launch checks matter, but the "Quality Center" label used in earlier versions of this analysis was not confirmed on current Toluna pages. What Toluna actually advertises: QProbe (AI probing for insufficient answers during fieldwork) and embedded AI fraud detection — still launch-quality focused, not redesign governance.
- QuestionPro, Alchemer, and Medallia are more adjacent than direct. Alchemer's AI investment has concentrated in Alchemer Pulse (a post-collection VoC/open-text synthesis platform launched late 2025), not in pre-launch design review — so the "adjacent" classification is still correct but for a different reason than creation-time assistance.
- Forsta (formerly Confirmit + FocusVision, merged) competes for the same enterprise research OS positioning and should be tracked. It positions AI agents across setup, analysis, and reporting. It is not a direct questionnaire-review competitor, but it is relevant context for any full-platform conversation.
- The repo's biggest competitive strength is not just "finding issues." It is the staged governance model: early review, follow-up, canonical review, structured packaging, revision, final QA, provenance, and frozen run artefacts.
- The repo's biggest competitive weakness is productization: no visible production UI, no documented enterprise security/compliance controls, and no vendor-grade post-field response-fraud/data-quality layer.
- **Naming note:** Qualtrics support URLs now reference the umbrella term "QualityIQ," with ExpertReview appearing as a component or prior name. This analysis uses "ExpertReview" throughout, which remains accurate per Qualtrics' own documentation, but the product may be migrating to the QualityIQ label.
## What The Current Workflow Actually Offers
The current workflow is materially more than a survey checker.
| Current workflow capability | Repo evidence | Competitive significance |
|---|---|---|
| Run-first frozen execution bundles | `README.md`, `WORKFLOW_STATUS.md`, `run_management/initialize_run_bundle.py` | Strong auditability and reproducibility; unusual in survey-builder competitors |
| Separate early and canonical review passes | `25_best_practice_review_early/`, `55_best_practice_review_canonical/`, `99_review/best_practice_review_integration_handoff.md` | Differentiates between provisional early critique and target-aware final review |
| Review authority pack with rubric + handbook + provenance registry | `00_foundation/Questionnaire_Best_Practice_Review_Rubric_v1.md`, `00_foundation/Questionnaire_Best_Practice_Review_Handbook_v1_Compact.md`, `99_review/best_practice_claim_registry_v1.md` | Stronger methodological traceability than most in-product AI review features |
| Screening alignment checks | `25_best_practice_review_early/Questionnaire_Best_Practice_Review_Output_Schema_v1_Compact.md` | Explicitly checks audience criteria against screener, routing, quota, and termination logic |
| Ordered issue map across stages 25 / 45 / 40 | same schema | Creates an ordered live conversation spine, not just a flat list of warnings |
| One-by-one design-tradeoff follow-up | `45_best_practice_followup/`, integration handoff | Supports co-design and approvals rather than silent auto-rewrite |
| Design previews before approval | review schema, clarification schema | Strong user-trust feature; rare in competitor docs reviewed |
| Package candidates and structured change packaging | review schema + `60_change_packaging/` | Converts review into governable edits instead of leaving findings as prose |
| Revision receipt + final QA gate | `70_revision/`, `80_final_qa/` | Closes the loop after review; most competitors stop at suggestions |
| Stateless JSON persistence and provenance | project index, integration handoff, revision receipt schema | Good fit for API orchestration and audit-heavy workflows |
## Why The Repo Proposition Is Different
The workflow is optimized around a research-operations problem that most survey platforms do not center:
- recover a questionnaire from source material
- review it against a methodology authority pack
- ask only the live questions that matter
- convert approved findings into structured changes
- regenerate a revised canonical representation
- verify that the approved changes were actually applied
That makes the proposition closer to "questionnaire review and governed redesign system" than to "survey builder with a checker."
## Feature-By-Feature Competitive Readout
| Workflow feature / proposition | Closest external analogue | Competitive read |
|---|---|---|
| Early review from fast scaffold plus intake | Qualtrics ExpertReview; SurveyMonkey Genius | Repo is stronger on strategic, pre-canonical review framing; vendors are stronger on direct builder integration and immediacy |
| Canonical target-aware review after reconciliation / clarification | No clear like-for-like competitor found in reviewed docs | Likely distinctive |
| Screening alignment checks against visible screener/routing/termination | Conjointly Script review partly overlaps via screening recommendations | Repo is more explicit and machine-structured |
| Ordered issue map preserving questionnaire order across live review | No clear equivalent found | Distinctive advantage |
| One-question-at-a-time design follow-up | Conjointly AI Helper chat is the nearest analogue | Repo is stronger on governed approvals and downstream linkage |
| Design preview before approval | No clear equivalent found in reviewed docs | Distinctive advantage |
| Package candidates linked to later change packaging | No clear equivalent found | Distinctive advantage |
| Revision + final QA after review | Qualtrics Response Quality is adjacent, but it is post-collection data cleaning, not pre-launch redesign QA | Repo addresses a different, earlier control point |
| Provenance-tagged authority pack | Qualtrics and SurveyMonkey cite research-backed guidance, but not with repo-visible claim registry / coverage matrix style provenance | Repo is stronger on internal methodological auditability |
| Response fraud / duplicate / bot / speeder handling | Qualtrics Response Quality | Major gap for the repo today |
| Enterprise security compliance and admin controls | Qualtrics Security | Major gap for the repo today |
## Competitor Comparison
| Competitor / feature | How direct a competitor it is | What it does well | Where the repo workflow is stronger | Where the competitor is stronger |
|---|---|---|---|---|
| Qualtrics ExpertReview (QualityIQ) | Very direct | Digital survey reviewer inside the builder; checks methodology, survey errors, compliance, sensitive-data requests; predicts survey quality | Multi-stage governance, follow-up, canonical targeting, packaging, revision, provenance | Product maturity, immediate in-builder feedback, broad project support, no workflow assembly required |
| Qualtrics Response Quality | Complementary rather than like-for-like | Flags speeders, bots, duplicates, completion-rate issues, sensitive data; supports filtering low-quality responses | Repo reviews the questionnaire before launch and links critique to redesign | Strong post-field data-quality and fraud controls that the repo currently lacks |
| SurveyMonkey Genius | Direct but lighter on questionnaire-review governance; broader AI surface expanding fast | ML scoring, predicted completion rate, question-linked recommendations; sentiment analysis and response quality scrubbing now enabled by default; thematic analysis now generates natural-language paragraph summaries | Far richer workflow, structured governance, target-aware packaging, redesign pipeline | Easier to use, native builder integration, immediate score and predictions; AI breadth is growing rapidly beyond questionnaire review |
| Conjointly Script review | Very direct | LLM-based script review for wording, scale consistency, missing answers, order, leading bias, screening, data quality | Structured downstream governance, canonical review, packaging, QA loop | Highly similar design-review surface, fast conversational review in-product, low-friction access |
| Toluna Start | Direct but narrower; "Quality Center" label not confirmed on current pages | Launch-readiness guidance, QProbe AI probing for insufficient answers, embedded AI fraud detection, panel-quality framing | Stronger methodology provenance and redesign pipeline | Better integrated with sample and field-quality operations |
| Forsta (formerly Confirmit + FocusVision) | Adjacent — competes on enterprise research OS positioning | AI agents across setup, analysis, and reporting; strong enterprise heritage in quant and qual | Pre-launch questionnaire review depth, governing redesign workflow, screening alignment | Deeper enterprise integration, longer track record with large research operations |
| QuestionPro advanced branching / logic features | Adjacent | Strong survey logic authoring and testing | Explicit design-review system, screening alignment, methodological governance | Better native authoring and logic execution environment |
| Alchemer Pulse / Alchemer AI | Adjacent — AI investment has pivoted to post-collection VoC | Alchemer Pulse (launched Dec 2025): AI-powered open-text synthesis, theme classification, sentiment across large feedback volumes; post-field insights automation | Pre-launch questionnaire design review, governed redesign workflow, screening alignment | Strong post-field open-text analysis and VoC automation at volume |
| Medallia survey design best practices | Adjacent | Templated best practices for CX/digital surveys | General questionnaire review depth and change governance | Stronger operational CX deployment context |
## Qualtrics Deep Dive
### 1. ExpertReview vs this workflow
Qualtrics ExpertReview is the strongest direct benchmark found in the review:
- It is described as a digital reviewer for surveys.
- It measures the quality of survey elements including questions, logic, and quotas.
- It recommends improvements and gives research-based explanations.
- It predicts the quality of the data likely to be collected.
- It checks methodology, survey errors, accessibility/compliance, and sensitive-data requests.
Where Qualtrics is better today:
- Native in-builder review while authoring
- Immediate scoring and issue surfacing
- Mature UX and operational integration
- No need for a separate run-initialization or orchestration layer
Where this repo is stronger:
- Early plus canonical review rather than one main pass
- Explicit separation between source capture, review, packaging, revision, and QA
- Structured live follow-up for research trade-offs
- Screening-alignment checks as a first-class review object
- Ordered issue spine and design-preview objects
- Package candidates flowing into governed change requests
- Frozen run bundles and visible provenance across stages
Bottom line:
- Qualtrics is stronger as an immediately usable product.
- The repo is stronger as a governed questionnaire redesign architecture.
### 2. Response Quality vs this workflow
Qualtrics Response Quality is not a replacement for this workflow. It covers a different control point.
It focuses on data already collected, including:
- speeders
- bots
- duplicates
- completion-rate problems
- sensitive-data responses
- filtering out poor-quality responses after collection
This is valuable because it addresses fieldwork and respondent-behavior risk that the repo does not currently address.
Implication:
- Qualtrics pairs pre-launch review and post-launch response-quality control in one platform.
- The repo currently dominates earlier in the lifecycle, but not after the survey goes live.
### 3. Security vs the repo proposition
This is the clearest area where Qualtrics is ahead today.
| Security aspect | Current repo workflow / proposition | Qualtrics current public posture | Competitive implication |
|---|---|---|---|
| Security documentation | No dedicated security architecture, control catalog, or compliance pack found in the repo review | Public pages cite ISO 27001, ISO 42001, FedRAMP High/IL4, HITRUST, SOC 2 Type 2 | Qualtrics is far easier to buy into regulated enterprises |
| Access control | No repo-documented SSO, MFA, RBAC, or admin console | Public pages cite SSO, MFA, admin reports, user access controls, project approval controls | Major productization gap for the repo |
| Sensitive-data controls | Review rubric includes sensitive-data / ethics checks, but no runtime PII redaction controls were found | Public pages cite sensitive-data controls, redaction/restriction, GDPR deletion controls | Qualtrics is stronger operationally; repo is stronger only at design-review policy framing |
| Auditability | Strong run-level provenance, frozen `used_*` artefacts, stateless JSON outputs | Strong enterprise admin/security posture, but less transparent methodology provenance to end users | Different strengths: repo for review traceability, Qualtrics for platform governance |
| Data-control proposition | Repo architecture suggests the possibility of private or customer-controlled deployment because it is not inherently tied to a vendor cloud | Qualtrics is a documented cloud platform with strong controls and dedicated environments | Repo has a promising sovereignty proposition, but it is still a proposition, not a documented compliance posture |
Bottom line:
- If the buying criterion is enterprise security proof today, Qualtrics wins clearly.
- If the buying criterion is future private deployment plus review provenance and redesign governance, the repo has a differentiated proposition, but it is not yet packaged as a security story.
## Other Meaningful Competitors
### Conjointly Script review
Conjointly is the most important non-Qualtrics direct comparator found.
Why it matters:
- It explicitly reviews survey design before launch.
- It checks wording, scales, missing options, order, methodological bias, and screening/data-quality improvements.
- It offers conversational AI follow-up in-product.
Why the repo still has an edge:
- Conjointly appears to stop at AI review and suggestions.
- The repo continues into structured issue management, packaging, revision, QA, and provenance.
Strategic read:
- Conjointly is the best benchmark for "LLM-based script review."
- Qualtrics remains the best benchmark for "enterprise survey quality platform."
### SurveyMonkey Genius
SurveyMonkey Genius is a real competitor for lightweight teams, but its AI surface is broader and expanding faster than a questionnaire-review comparison alone suggests.
Why it matters:
- It scores the survey draft with ML and predicts completion rate and time.
- It links recommendations to specific questions.
- As of 2025–2026: sentiment analysis and response quality scrubbing are now enabled by default across all surveys.
- Thematic Analysis now generates natural-language paragraph summaries of open-text data without manual effort.
- AI-generated question types (star rating, ranking, matrix) have been added to the builder.
Why it is still lighter than the repo on questionnaire-review governance:
- No governed follow-up, packaging, revision, or final QA.
- No screening-alignment checks or ordered issue management.
- Optimised for completion rate and survey structure, not deep methodology review or redesign governance.
Strategic read:
- SurveyMonkey is a good benchmark for simplicity and product UX, and its AI investment is meaningful beyond questionnaire review. Its post-collection AI features (sentiment, quality scrubbing) increasingly overlap with what Qualtrics Response Quality covers. The questionnaire-governance gap versus the repo remains real, but characterising SurveyMonkey as simply "lightweight" understates how fast its broader AI surface is growing.
### Toluna Start
Toluna is a meaningful competitor where sample quality and launch checks matter, but the "Quality Center" label used in earlier references to this analysis was not confirmed on current Toluna pages.
What Toluna actually advertises (as of 2026-04-18):
- **QProbe**: AI-driven probing that identifies insufficient answers and automatically creates personalised follow-up questions during fieldwork.
- **Embedded AI fraud detection and quality checks**: Described as built into the platform throughout, rather than as a named standalone module.
- The platform supports design, panel reach, analysis, and stakeholder-ready reports in one workflow.
Why it is narrower than the repo:
- The reviewed positioning is closer to panel-integrated launch quality and field-quality guidance than to a full review-to-redesign workflow.
- QProbe operates during fieldwork (probing respondents in-survey), not as a pre-launch design reviewer.
Strategic read:
- Toluna is more threatening on panel-integrated data quality during fieldwork than on method-governed questionnaire redesign before launch. Remove or verify any reference to "Toluna Quality Center" by name in external materials until confirmed.
### Adjacent builders and platforms: QuestionPro, Alchemer, Forsta, Medallia
These are adjacent, not the strongest direct threats on questionnaire review.
QuestionPro:
- Strong on advanced branching and survey logic execution.
- Not obviously positioned as a methodology-review workflow.
Alchemer:
- Alchemer's AI investment has concentrated in **Alchemer Pulse** (launched December 2025), a fully AI-powered insights automation platform for post-collection open-text synthesis, theme classification, and sentiment analysis at volume. Integrates Alchemer Survey, help desk tools (Zendesk, Freshdesk), and public channels (App Store, Google Play, Trustpilot).
- The earlier characterisation of Alchemer as "creation-time assistance" was outdated. Their AI story is now primarily post-field VoC, not pre-launch design review.
- Still adjacent for the same reason: not a questionnaire-review governance competitor. But the competitive read has shifted — Alchemer now competes closer to post-collection insight tools (Dovetail, Stravito) than to design-review tools.
Forsta (formerly Confirmit + FocusVision):
- Significant enterprise research platform with heritage in both quant and qual.
- Positions AI agents across setup, analysis, and reporting.
- Competes for the same enterprise research OS positioning as this platform.
- Not a direct questionnaire-review competitor, but relevant context for full-platform conversations with enterprise buyers already running Forsta.
Medallia:
- Offers design best-practice guidance and prebuilt survey structures in CX contexts.
- Less clearly a general questionnaire-review competitor.
## Competitive Positioning Summary
If we describe the market honestly, it looks like this:
- Qualtrics owns the broadest enterprise-grade position (ExpertReview / QualityIQ + Response Quality + security posture).
- Conjointly is the closest modern AI review threat on questionnaire design.
- SurveyMonkey owns a mainstream position and is expanding its AI surface quickly — including default response quality scrubbing and thematic analysis — though it does not offer governed redesign workflows.
- Toluna owns panel-integrated fieldwork quality territory (QProbe, embedded fraud detection), not pre-launch review governance.
- Forsta competes for enterprise research OS positioning and should be monitored for any questionnaire-review feature expansion.
- Alchemer has moved its AI investment into post-collection VoC (Alchemer Pulse), making it a more relevant comparator to Dovetail-class tools than to Research Guard.
- The repo is strongest when the user needs governed redesign, provenance, and structured transition from critique to approved change.
## Where This Workflow Currently Leads
- Deep methodological governance rather than surface scoring only
- Strong separation of review, approval, change packaging, revision, and QA
- Better auditability and rerun reproducibility through frozen run bundles
- More explicit handling of screening alignment, live issue ordering, and design trade-offs
- Better fit for expert research operations than for lightweight survey self-serve
## Where This Workflow Currently Lags
- No documented production application or survey-builder UI
- No documented post-field response-quality / fraud detection layer
- No documented enterprise security/compliance posture
- No explicit native connectors to leading survey platforms in this analysis
- Higher workflow complexity than mainstream builder-native tools
## Strategic Recommendations
If this workflow is meant to compete credibly with Qualtrics-class tooling, the most leverage appears to be:
1. Productize the review surface.
Add a reviewer UI that shows ordered issues, design previews, approvals, package candidates, and final QA status without exposing raw schema objects.
2. Add a response-quality companion layer.
Introduce a post-field module for speeders, straightlining, bots, duplicates, breakoff, and suspicious open-end behavior so the proposition covers both questionnaire quality and collected-data quality.
3. Write the security story explicitly.
Create a deployment/security architecture note covering hosting model, encryption, access control, audit logging, data retention, secrets handling, and whether private/VPC deployment is supported.
4. Add import/export bridges for dominant platforms.
Qualtrics should be first. SurveyMonkey and QuestionPro are logical follow-ons.
5. Build benchmark demos that show unique value.
The strongest proof point will be side-by-side examples where the repo catches or governs issues that builder-native checkers do not, especially around screening alignment, ordered live trade-offs, and packaged redesign.
## Overall Verdict
The repo is not yet the strongest product in the market, but it is already a stronger review architecture than most of the reviewed alternatives.
In plain terms:
- Qualtrics is the strongest competitor today if the buyer wants one integrated enterprise platform.
- Conjointly is the closest direct AI-review competitor on questionnaire design logic and methodology.
- The repo has the most differentiated position when the need is governed, provenance-rich questionnaire review and redesign rather than a simple in-builder score.
## External Sources Checked On 2026-04-18
- Qualtrics ExpertReview / QualityIQ Functionality:
- Qualtrics Survey Methodology & Compliance Best Practices:
- Qualtrics Response Quality Functionality:
- Qualtrics Response Quality:
- Qualtrics Security:
- Qualtrics Data Sovereignty:
- SurveyMonkey Genius (product page):
- SurveyMonkey Genius / Scoring Your Survey (help page, returned 404 on 2026-04-18):
- Conjointly Script review:
- Toluna Start platform:
- Toluna Start homepage:
- QuestionPro Advanced Branching Logic:
- Alchemer AI (returned 403 on 2026-04-18):
- Alchemer Pulse announcement (Dec 2025):
- Medallia Survey Design Best Practices:
**Second-opinion verification pass completed 2026-04-18.** Claims in this analysis were independently verified against live pages. Key corrections made on second pass: SurveyMonkey AI breadth updated; Alchemer repositioned as post-collection VoC (Alchemer Pulse); Toluna "Quality Center" label not confirmed on current pages — actual features are QProbe and embedded fraud detection; Forsta added as adjacent enterprise OS competitor; QualityIQ naming note added for Qualtrics.
## Internal Repo Sources Used
- `README.md`
- `WORKFLOW_STATUS.md`
- `00_foundation/questionnaire_workflow_project_index_v1.md`
- `00_foundation/questionnaire_workflow_decisions_log_v1.md`
- `00_foundation/Questionnaire_Best_Practice_Review_Rubric_v1.md`
- `00_foundation/Questionnaire_Best_Practice_Review_Handbook_v1_Compact.md`
- `25_best_practice_review_early/Questionnaire_Best_Practice_Review_Output_Schema_v1_Compact.md`
- `99_review/best_practice_review_coverage_matrix_v1.md`
- `99_review/best_practice_review_integration_handoff.md`
- `run_management/initialize_run_bundle.py`