Analysis Across Tests: Consumer Report

Overview

The Consumer report can be generated across multiple tests in the Advanced search & analysis across tests area. All options available in the single-test Consumer Report are available here, with one exception: the First position data split is not available in the across-tests version.

The report options are shared with the single-test Consumer Report. Any changes you make to the options here will also apply when you run the Consumer Report from within a single test, and vice versa.

Compatibility

The across-tests Consumer report has the same question and test type compatibility as the single-test Consumer Report:

Sample and non-sample related question types below:

Standard test types and survey test types.

The report is not compatible with:

Question types found in the Standard test that are not mentioned in the list above.
Discrimination test types.

Scale equivalence: Questions are grouped by name across the selected tests. If two questions share the same name but have different scales across the selected tests, those questions will be excluded from the report and you will be notified of the reason.

Generate the Report

From the Dashboard, in the top right-hand corner, click Advanced search & analysis across tests.
Specify the test search criteria and select the tests you wish to include in the report.
Click the Reports menu and under the Report type select Consumer Report. If you need to exclude specific samples and/or sample sets from the analysis, in the top right-hand corner, click Filters and specify your criteria.
Under Options, specify the options you wish to include in the report.
1. Sample grouping options - select the sample grouping option that best suits your analysis needs. You can always return to this step and regenerate the report with different option selected if the previous one did not work well for what you expected.
2. Report format and details - control how your data is displayed in the report.
  1. Include Crosstabulations in the form of counts, percentages, or both.
  2. Set the number of decimal places in your report, from 0 to 4. The default is 2. Selection made here will reflect in the rounding of the data.
3. Data splits - specify whether and how you wish to split your data.
  1. Questions in test (splits) - split the data based on the responses in the demographic (non-sample related) questions in the test, such as purchase or consumption frequency.
  2. Panelist fields (splits) - split the data based on the panelist information stored in the Panelists library, such as gender or dietary restrictions.
  The First Position data split is not available when generating the Consumer Report across tests.
  Only non-sample related Category and Choose 1 questions are eligible for data splits.
  The report will use the snapshot of the data in the Panelists library the way it was at the time the panelist results were collected. If you make any changes to the panelist data in the library after results are collected, those changes will not be reflected in the Consumer report.
4. Incl
  ude sheets - if the sheets outlined below are not selected for inclusion in the report, their corresponding data splits will not appear in the report even if those splits were specified in the Data splits steps above.
  1. Dat
    a summary - if any splits were selected, this sheet includes the original analysis per sample and all the splits per sample.
  2. Within sample - if any splits were selected, this sheet includes the splits within each sample. This sheet will not generate in survey tests even if the option was selected.
  3. Demogra
    phic splits - If any splits were selected, this sheet includes the splits within each sample.
5. Analysis options from defaults - click Change advanced analysis options to update the Multiple comparison test as desired. You may select more than one if you wish. Post hoc letters will display only if there is significant difference between samples. There isn't a setting to change this.
The Consumer report always runs a 1-way ANOVA.
Under Questions, select the questions you wish to include in the report. Questions are automatically grouped by name across the selected tests.
If a question appears in more than one of the selected tests but with different scales, it will be excluded from the question list and you will be notified why.
The Export has only one export type, .xlsx.
1. Name the report as desired. The default name is "Multiple test consumer report".
2. Click Create my report to generate the Consumer report across tests.

At the bottom of this page you can see and download an example report.

Report Details

Depending on the test setup, there can be up to five sheets in the report:

Demographics - This sheet is available when at least one of the following is in place:

Demographic (non-sample related) questions with data in them were selected before running the report.
Panelist fields from the Panelists library were selected for data splits prior to running the report.

This sheet includes graphs and crosstabulations (if selected prior to running the report) showing counts and/or percentages. Even when no splits are selected, this sheet will generate when demographic questions are included in the analysis.

Data Summary - This sheet is available when sample related questions with data in them were selected before running the report. Even when no splits are selected, this sheet will generate.

The sheet includes:

Crosstabulations for overall results and on any data splits (if selected prior to running the report).
Means.
Multiple comparison test for attributes that are not JAR (just about right). The Multiple comparison test is coming from the Advanced analysis options described in the steps for generating the report. You may select more than one Multiple comparison test if you wish. The post hoc letters will display only if there is significant difference between samples.

The Consumer Report always runs a 1-way ANOVA.
Collapsed frequencies for JAR (just about right) attributes. The report will display the frequencies for each point in a table, and in a table below that it will also collapse/combine the points (their frequencies). The top points will be combined in one row, the JAR frequencies will be in their own row (not combined with any other points), and the bottom points (those lower than the JAR point on the scale) will be combined and displayed in their own row. For example:

The report will use the snapshot of the data in the Panelists library the way it was at the time the panelist results were collected.

If you make any changes to the panelist data after results are collected, those changes will not be reflected in the Consumer report.

For example, panelist John Smith had in his panelist record that he consumed chocolate on daily basis. You conducted a consumer test and planned on splitting data on chocolate consumption field in the Panelists library. Right after the test, John clicked on the Account button and updated his chocolate consumption frequency to once a week. The next day, after all the expected results were collected, you generated the Consumer report. John's results were included in the calculations for the 'on daily basis' data split, because he updated his record after he completed your test, even though you generated the report after he made the change to his record/account.

Within Sample - The sheet contains the same details the Data Summary sheet does, except the information is further split within each sample based on the demographic data.

This is an example of the collapsed frequencies for JAR (just about right) attributes in this sheet:
Demographic Splits - The sheet contains data splits for every demographic question included in the analysis based on the demographic splits selected before generating the report.
Comments - available if sample related Comment questions with data in them were selected before running the report.

This sheet lists original comments from each panelist for each sample they commented on, and the counts for any data splits (if selected prior to running the report).