Question Type: Preference

Question Type: Preference

Overview

In a Preference question, panelists are presented with two samples and asked to indicate the sample they prefer.

It is possible to provide the "No preference" option to the panelists. The "No preference" data can be either discarded, or split evenly between samples, depending on your selection in the Advanced analysis options.


Question Compatibility

The Preference question is compatible with the Standard test type.

Add the Question:

  1. In the Build tab of your test, in the left sliding pane, click the Preference question. This will add the question to the bottom of your questionnaire.


    You are able to drag and drop a new question to the location of your choice in your questionnaire.
    You can also move your questions after adding them by using the Move question option, or by using the cross-hairs handle.


  2. Click in the Add question name box and update the name to reflect the nature of the question. 

  3. The Preference question will have preset instructions for panelists. Click in the text area to update as needed.
Images, Wildcards , and Snippets can be added in the panelist instructions.



Question Options

By default, the Preference question is set to appear for all samples at last opportunity. This means that if your questionnaire contains other questions ahead of the Preference question, the Preference question will be displayed to panelists after other questions were displayed for each sample.

Click Question options to access a list of options available to further customize your question. This is where you can display the "No preference" button to the panelists, decide how to label the button, where to position it compared to the sample buttons, and more.



If you don't see the menu options on the right, click the question in the Build tab to highlight the question, or click the three vertical blue dots to access the Question options menu.



Options in the General Tab 


Option Name  

Option Description  

Question name  

The  Question name  is the label displayed for analysts in the heading of the following areas: 

  1. Question in the Build tab of your test.

  2. Analysis Reports, Graphs and Exports.

Show question name to panelists   


Click to display the  Question name  to panelists or to hide it from them. 


Display name  


Enter the text that you wish to display to the panelist if your  Question name  is of a sensitive nature and should not be visible to them.


Sensitive data 

Click  Yes  to flag the collected results for this question as sensitive.  


If the panelist unsubscribes or is deleted from the Panelists library by an administrator, their data collected in questions marked as sensitive will also be removed.  

Data collected in questions that are not marked as sensitive will remain in your tests even after a panelist is unsubscribed/deleted.  
Enable requestable question instructions
Provide a button for panelists to bring up additional instructions if they need them. This helps declutter the screen when panelists are fairly familiar with attributes, for example, and occasionally might need a reminder about their descriptions.


Options in the Display Tab


Option Name 

Option Description 


Show question 


This will control whether your question will be sample related, test related, or not sample related. 

  1. For all samples : The default selection. The question will display for all the samples in your test. 

  2. For selected samples: The question will display only for samples that you specify it should display for. If your test had more than 2 samples, but you want to ask the preference question only on two of the samples, you can use this option.  


Present question


Specify how you'd like the question to appear:    

  1. All samples at first opportunity : This will display the question to the panelists for all the samples on the same page, in the first cycle through the questionnaire.  

  2. All samples at last opportunity :  The default selection. This will display the question to the panelist for all the samples on the same page, in the last cycle through the questionnaire.
  


Sample Order


Select the sample order from the following:
  1. Sample set order: The default selection. Sample choices display according to the design order in the sample set (as set up in the Samples & design tab).

  2. Fixed order: Sample choices display according to the order in the Samples list (Sample 1, Sample 2, etc.).
 

Evaluate image as sample  

Displays the image file associated with the presented sample. Images can be uploaded to each sample in the  Samples & design  tab.   


Sample display 


Select an option from the following:
  1. Sample label only: The default selection. Sample buttons display only the label type selected in the Sample label to show option (see the next row below).

  2. Sample multimedia only:  Sample buttons display only the images associated with the samples in Samples & design tab.

  3. Sample label and multimedia:  Sample buttons display both the label type selected in the Sample label to show option and associated images.

Sample label to show 

Select an option from the following:
  1. Sample blinding code:  The default selection. Sample blinding codes display to panelists.

  2. Sample name:  Sample names display to panelists.

  3. Product name:  Product names as stored in the Product library display to panelists.

  4. Product code:  Product codes as stored in the Product library display to panelists.

 


Show no preference button 


Toggle to:

  1. Hide: The default selection. Panelists will not have the "No preference" option.

  2. Show: Panelists will have the "No preference" button available to them. When this option is toggled, two new options become available, as described below in the next two rows.

"No preference" text

Specify the text that you wish to display to the panelists on the "No preference" button. The default text is "No preference".


Location of No preference button 


Select an option from the following:

  1. Left:  The "No preference" button will be the first button on the left, followed by two buttons with sample blinding codes on them. 

  2. Center: The "No preference" button will be in the middle, between two buttons with sample blinding codes on them.

  3. Right: The default selection. The "No preference" button will be the last button on the right, after the two buttons with sample blinding codes on them.



Analysis 

Click the Results tab to access and choose from the following analysis options:  
  1. Graphs - Visual representation of the data.

  1. Data - Raw data display with checkmarks showing which panelist preferred which sample, and the total at the bottom of the table. 

  2. Reports - Create new or view previously generated reports, or schedule and view scheduled reports.

    The following reports are compatible with the Preference question type:
    1. Standard report - Distribution of Responses, Binomial distribution : Null Hypothesis, Alternative hypothesis,  Summary statistics by attribute. Click Change advanced analysis options to indicate how you want to handle the "No preference" data and whether you wish to include the d' (d prime) in the analysis.
      Information found in the Standard report will depend on the question setup of your Preference question.
    1. Summary Report - Provides you with the Summary statistics by attribute, which includes: Counts of how many times each sample was selected as preferred, p-value for one-sided binomial,  p-value for each sample compared to the other, and 2 d' calculations.

    1. PowerPoint report - Visual representation of the data in the PowerPoint Report file format with the statistical conclusion whether the samples are significantly different at a selected confidence level. 

    1. Consumer Report - Provides counts of how many times each sample was selected as preferred.

      Percentages are representative of the proportion of times a sample was selected as first (preferred). Since there is only one (first) option, the results will show 100% in every scenario which is not useful. Therefore we recommend to only select Count in the analysis options.


    2. Raw data export - Choose from the Multivariate, Univariate, and Multivariate Columnar raw data export formats to suit your exporting needs.