Analysis Across Tests: Question Compatibility

Overview

When you run analysis across tests, each report and on-screen view only works with certain question types. Some reports also have extra conditions, such as requiring questions to be asked per-sample or to be set up identically in every test.

This article lists which question types each report and view across tests supports, along with any other conditions that apply. Use it to plan your tests so the reports you need will be available when it is time to analyze the combined data.

How Question Eligibility Works

Most reports are available as long as at least one of the questions you selected qualifies. Questions that don't qualify are simply left out of that report.
Some reports across tests support fewer question types than the same report run on a single test. These differences are noted in the table below.
Degree of Difference (DoD) questions, and questions that are related to another question (such as Triangle related), are excluded from the PowerPoint and Summary reports.

Reports and Compatibility

Report	Compatible question types	Other conditions	Notes
PowerPoint report (selected by default)	Category, Choose questions (Choose 1, Choose n, CATA), Line scale, LMS, Numeric	Per-sample and demographic questions are both allowed. DoD questions and questions related to another question are excluded. Available if at least one selected question qualifies.	Paired, Triangle and Rank questions are not supported, unlike the single-test PowerPoint report. Date Numeric question type is not supported.
Summary report	Category, Choose 1, Line scale, LMS, Numeric	Per-sample and demographic questions are both allowed. DoD questions and questions related to another question are excluded. Available if at least one selected question qualifies.	Sort, Paired and Rank questions are not supported, although the single-test Summary report supports them. Date Numeric question type is not supported.
Top Box report	Category, Choose 1	Every copy of the question, in every test, must be asked per-sample. All copies must be the exact same question type with identical descriptors. Available if at least one question name qualifies.	Comments are not included, although the single-test Top Box report supports them.
Consumer report	Category, Choose 1	All copies must be the exact same question type with identical descriptors. The analysis is always a 1-way ANOVA. The post hoc test used comes from the analyst's advanced options.	Choose n, CATA and rank questions are not supported. The Comments sheet includes sample-related comment questions, if any are present.
Panelist Summary	Category, Line scale, Numeric, Comments	Questions must be asked per-sample. The section must allow panelists to view results, which requires the section to allow the Back button. Questions that don't qualify are left out without a message. The report only fails if no questions qualify.	LMS questions are not supported. This is the same rule as the single-test Panelist Summary. Date Numeric question type is not supported.
Raw data export (multivariate, all in one file)	Any question type	None	Univariate raw data exports follow the same rule.

⚠ Warning: For the Top Box and Consumer reports, a question must use the same question type and identical descriptors in every test. If one test's copy of the question differs, that question won't be included, so set these questions up consistently before your tests go live.

💡 Idea: If a question type isn't supported by the report you want, use the Raw data export. It includes every question type, so you can still analyze that data outside Compusense.

On-Screen Views

View	Compatible question types	Other conditions
Graphing	Category, Line scale, Numeric, Choose questions	Questions are filtered by type only when you select them.
Pivot table	All question types supported by Graphing, plus Comments	Questions are filtered by type only when you select them.