Question Type: Rank

Question Type: Rank

Overview

In a Rank question, panelists are presented with a group of samples or concepts/choices and asked to rank the choices in order of preference or perceived intensity.

There are four types of Rank questions available:
  1. Rank all concepts: A panelist is presented a list of concepts and is asked to rank all of the concepts. 

  2. Rank n concepts : A panelist is presented a list of concepts and is asked to rank a subset of concepts. The minimum and maximum number of concepts that can be ranked is predetermined during the test setup. 

  3. Rank all samples:  A panelist is presented a list of samples and is asked to rank all of the samples. 

  4. Rank n samples:  A panelist is presented a list of samples and is asked to rank a subset of samples. The minimum and maximum number of samples that can be ranked is predetermined during the test setup.  

The Preference question for two samples is a separate question type.


For the full page view of this article, in the top right-hand corner, please click on the icon with an arrow.


Question Compatibility

Rank questions are compatible with the following test types:
  1. Standard test
  2. Survey - Only Rank all concepts and Rank n concepts are compatible. 
  3. Same/Different test - Only Rank all concepts and Rank n concepts are compatible.

Add the Question:

  1. From the Build area of your questionnaire, in the left sliding pane, click Rank and click one of the following rank options: 
    1. Rank all concepts
    2. Rank n concepts
    3. Rank all samples
    4. Rank n samples

      This will add the question to the bottom of your questionnaire.

      You are able to drag and drop a new question to the location of your choice in your questionnaire.
      You can also move your questions after adding them by using the Move question option, or by using the cross-hairs handle.
  2. Update the Question Name field. 

  3. Click Add panelist instructions for this question to add text. 
Images, Wildcards , and Snippets can be added in the panelist instructions.


Question Options

Click Question options to access a list of options available to further customize your question.



If you don't see the menu options on the right, click the question in the Build tab to highlight the question.


Options in the General Tab 


Option Name  

Option Description  

Question name  

The  Question Name  is the label displayed for analysts in the heading of the following areas: 

  1. Question in the Build area of your test.
  2. Analysis Reports, Graphs and Exports.

Show question name to panelists   

Click to display the  Question Name  to panelists or to hide it from them. 

Display name  


Enter the text that you wish to display to the panelist if your  Question Name  is of a sensitive nature and should not be visible to them.

Sensitive data 

Click  Yes  to flag the collected results for this question as sensitive.  


If the panelist unsubscribes or is deleted from the Panelists library by an administrator, their data collected in questions marked as sensitive will also be removed.  

Data collected in questions that are not marked as sensitive will remain in your tests even after a panelist is unsubscribed/deleted.  

Question type
Select from the dropdown a different variation of this question type.  
This option is not available in Rank preference question type.

Enable requestable question instructions

Provide a button for panelists to bring up additional instructions if they need them. This helps declutter the screen when panelists are fairly familiar with attributes, for example, and occasionally might need a reminder about their descriptions.  



Options in the Display Tab for Rank all/n Concepts


Option Name 

Option Description 


Show question 


This will control whether your question will be sample related, test related, or not sample related. 

  1. For all samples : The question will display for all the samples in your test. 
  2. Once (not sample related): The question will display only once and will not be sample related. This is useful for collecting demographic data.  


Present question


Specify how you'd like the question to appear:     


  1. Monadically/one sample at a time :  This will display the question to the panelists one sample at a time.   
  2. All samples at first opportunity : This will display the question to the panelists for all the samples on the same page, in the first cycle through the questionnaire.  
  3. All samples at last opportunity This will display the question to the panelist for all the samples on the same page, in the last cycle through the questionnaire.
  4. First Cycle  : This will display a  Once (not sample related)  question in the first cycle through the questionnaire.  
In a test that has all not sample related questions (i.e. in the Survey test type), the question will be displayed in the order it is in the list of questions.  


Show blinding code


  Display the sample blinding code of each sample. 

  Choice display 

Select from the following choice components to be displayed to the panelists:  

  1. Choice label only:  Display the text label only.  
  2. Choice image only:  Display only the image associated with the choice. 
  3. Choice label and image:  The default selection.  Display both the image associated with the choice and the text label. Add an image to your choice in the Choice/Concept tab.  


Evaluate image as sample


Displays the image file associated with the presented sample. Images can be uploaded to each sample in the  Samples & design  area.   

Allow ties 


Allow panelists to rank two or more choices as the same. 
You will not be able to allow ties if your Rank n is set up as a Rank 1 of 2. 



Options in the Concepts Tab

The Concepts tab is only available in Rank all/n Concept questions.

Option Name  

Option Description 


Concept  


Identifies how many choices are in the question.  

Images can be added in the panelist Instructions. Hover over a concept number and the cursor will change like this:  

Click and drag the choice to a different spot in the question. The value will not be updated when the choice is moved to a different order in the list. 

Text 

Edit the text to label the choices.  

Value 

Enter the number indicating the value that will be assigned to each concept in the test results. The values can be updated after results have been collected.  


Image 


Click  Add image  to associate an image with the choice.     

If you want this image to display to panelists, you will need to ensure the Choice display    option, found in the Display   tab, is set to either  Choice image only  or  Choice label and image  .

Presentation order design

The default is Fixed , which displays all the concepts in the order they are added in the table. If you wish to randomize concepts, select Use a design. Use additional options outlined below for managing the presentation order.

Delete

Click     to remove the choice from your question.     

Add Choice

Click to add additional choices at the bottom of the list of your question. 

Add pipped choices

Question piping allows responses from a Choose question to become choices in another question. Responses are piped from one question to another.

Reset values

Click to renumber the values in the Value column to be in the ascending order.  

This is helpful for choices that were manually moved around to ensure that the values reflect the final choice order.

Presentation order design 

By default disabled because the Presentation order design option in the list of concepts is by default set to Fixed . When that option is set to Use a design , you can select a design that best suits your concept presentation needs. The last option, Randomized , uses automatically generated randomization which does not account for any type of balance, while all the other options are coming from the Designs library.

Shuffle concept order

This option is useful if you are not concerned whether the concept order is balanced.

Concept order assignment for samples within each sample set  

Select from the following options:

  1. Same order - Default selection. Panelists will see the concepts in the same order for each of their samples.

  2. Different order - Panelists will see their concepts in a different order for each of their samples.



Additional Display Options for Rank n Concepts  

Option Name  

Option Description  

Max selections allowed  

Set the value for the maximum number of ranked concepts. The highest value equals the total number of choices in the question.    

Min selections allowed  

Set the value for the minimum number of ranked concepts. The lowest value is 1 if  you want to require at least one concept to be ranked. 



Options in the Display Tab for Rank all/n Samples

Option Name 

Option Description 

Show question 



This will control whether your question will be sample related, test related, or not sample related. 

  1. For all samples: This will display the question for all the samples in your test. 

  2. For selected samples: Specify a subset of samples that you wish panelists to rank. This option should be rarely used.


Present question


Specify how you'd like the question to appear:     

  1. All Samples at first opportunity : This will display the question for all the samples all at once to the panelist. 

  2. All Samples at last opportunity :   Default selection. This will display the question for all the samples at once at the end of the cycles to the panelist.   

Sample order

Display the order in which samples will be presented to panelists on screen.  

  1. Sample set order: Sample choices display according to the design order in the sample set.

  2. Fixed order : Sample choices display according to the order in the Samples list (Sample 1, Sample 2, etc.). 

  3. Random order : Sample choices display randomly to every panelist.   

Evaluate image as sample

Displays the image file associated with the presented sample. Images can be uploaded to each sample in the  Samples & design area.  


Allow ties


Allow panelists to rank two or more choices as the same.  


Sample display


Choose how your samples will be displayed to panelists on the screen.
  1. Sample label only  : Sample choices display text label only, as selected in  Sample label to show list.

  2. Sample multimedia only  : Sample choices display only the image associated with the sample in Samples & design.

  3. Sample label and multimedia :  Sample choices display both the image associated with the sample in Samples & design  and the display text.

  4. Sample label to show  : Choose how the sample label will display to panelists on the screen.   


Sample label to show


Choose which information to show as your Sample labels to the panelists. 
  1. Sample blinding code : Sample blinding codes display to panelists.

  2. Sample name :  Sample names display to panelists.

  3. Product name : Product names as stored in the Products library display to panelists.

  4. Product code : Product codes as stored in the Products  library display to panelists.  


Additional Display Options for Rank n Samples 

Option Name   

Option Description 

Max selections allowed

Set the value for the maximum number of samples panelists will rank. The highest value equals the total number of choices in the question.   

Min selections allowed  

Set the value for the minimum number of samples panelists will rank. The lowest value is 1. 


Analysis 

Click the Results tab to access and choose from the following analysis options:  
  1. Graphs - Visual representation of the data.
  1. Data - Raw data display. This will display the rank that each sample/concept was given. 

  2. Reports - Create new or view previously generated reports, or schedule and view scheduled reports.

    The following reports are compatible with the Rank question type:
    1. Standard report - Detailed information about counts, Friedman Analysis of Rank, Distribution of Responses, Binomial distribution : Null Hypothesis, Alternative hypothesis,  statistical decision and Multiple Comparison Test.
      Information found in the Standard report will depend on the question setup of your Rank question.
    1. Consumer Report - Provides counts and/or percentages of how many times each sample was selected as preferred.

      Percentages are representative of the proportion of times a sample was ranked in that position if it was ranked at all. In a rank top sample question (Rank n with Min and Max set to 1), since there is only 1 rank option, the results will show 100% in every scenario which is not useful. Therefore in this specific scenario we recommend to only select Count in the analysis options.


    1. PowerPoint report - Visual representation of the data in the PowerPoint Report file format. 
      The PowerPoint report is not available for Rank all concepts or Rank n concepts .
    1. Raw data export - Choose from the Multivariate, Univariate, and Multivariate Columnar raw data export formats to suit your exporting needs.





    • Related Articles

    • Question Type: Comment

      Overview Comment questions are used to gather panelist comments, observations or demographic information, such as their name. You can specify the size of the comment box (number of characters across/down), and set the maximum number of characters the ...
    • Question Type: Flash Profiling

      Overview The Flash profiling testing is a sensory testing method that helps us understand the sensory positioning of products. It allows both trained and untrained panelists to evaluate a group of samples simultaneously and create their own ...
    • Question Type: Sort

      Overview In a Sort question, Panelists are presented with a group of samples or concepts and asked to organize them into bins. There are three types of Sort questions available: Free sort: The Free Sort question allows panelists to sort products into ...
    • Question Type: Tetrad

      Overview Tetrad test is a discrimination test type that helps you determine if there is a difference between two products by asking panelists to group 4 samples into 2 groups of 2. Unlike most other question types, the Tetrad question is not ...
    • Question Type: Preference

      Overview In a Preference question, panelists are presented with two samples and asked to indicate the sample they prefer. It is possible to provide the "No preference" option to the panelists. The "No preference" data can be either discarded, or ...