2-AFC Test

2-AFC Test

Overview

In 2-AFC (Two-Alternative Forced Choice) discrimination tests, panelists are presented with two samples. From the two samples, panelists are asked to determine the different sample based on the intensity of a specified attribute. E.g. "Which sample is sweeter?"

For Preference testing (where there is no right or wrong answer), please do not use the 2-AFC test template. Instead, use the Standard test type and add a Preference question in it.

For a back to back 2-AFC discrimination test, or a 2-AFC discrimination test with additional questions, please contact our Support Team to discuss your testing objectives and the best solution.

Question Compatibility

The 2-AFC test type is compatible with the following question types:
  1. Category

  2. Choose

  3. Line Scale

  4. Rank

  5. Sort

  6. Comment

  7. Constant Sum

  8. LMS

  9. Numeric

  10. Photo Upload

Text/Time Delay screens are compatible with all test types and question types .


Create the Test 

  1. On the Dashboard , in the Folders list on the left, select the folder where you wish to save your new 2-AFC test.

    If necessary, use the menu from the vertical three dots to create new sub-folders or to edit existing ones.


  2. Click Create a new test .

  3. Next to the 2-AFC test type , click Use .


  4. Type the test name and specify the location for it (in case the folder selected in the first step was not the right one).

  5. Click Create Test . The test will open up.
The Test ID displayed in the top right-hand corner is an important unique identifier useful for test searches. The Test ID can also be found in the Dashboard .

Please have the Test ID handy when you reach out to our Support Team for assistance.


Update the Test

Although the template test has a number of pre-set components that might work for you the way they are, you will still have to update some components to make them reflect your testing needs. Please go through each test tab outlined below and make necessary changes.
  1. Build  
    By default, the 2-AFC question will be displayed in even cycles. This means that if you were to add any monadic questions in your 2-AFC test, those questions will cycle through each sample, while the 2-AFC question will display only once, after the second sample or the 4th, etc, if running a back to back test (i.e. in even cycles). To change this, go to the Question options and make the change in the Present question option.


    You can also evaluate images as samples, and you can allow panelists to indicate that there is no difference between samples.

    If you give panelists the option to indicate that there is no difference between samples (found in the Question options), you can place the 'No difference' button either on the right of the samples, or between the samples, or to the left of the samples (found in the Attribute options). At individual attribute level (in the Attribute options), you can specify whether you want to display the 'No difference' button for that attribute.

    When this feature is enabled, the question is no longer a 2-Alternative Forced Choice question since panelists are able to select the third option.

    When running the reports, you can decide whether the data for 'no difference' will be distributed evenly between samples, or it would be discarded. Please note that the option in the analysis reads 'no preference' because this option is shared with the Preference question data.


    The 2-AFC question is already added to the test along with the 2-AFC related Comment .


    If you wish to ask panelists to evaluate multiple 2-AFC attributes, complete the first attribute setup and clone the attribute. Update the new attribute as necessary. 


  2. Logistics


Preview and Run the Test

When all test components have been added and configured, you may preview the test and then present it to your panelists.


Analysis

Click the Results tab to access and choose from the following analysis options:
  1. Graphs - Visual representation of the data at the attribute level, compatible with 2-sample tests only. If you ran the test on 4 or more samples, use the PowerPoint report instead.

  2. Data - Raw data displayed in the form of check marks indicating whether the panelists selected a sample as different (as 'more' in the evaluated attribute), or they indicated that there was no difference between samples (if this feature was enabled for them). The Total Correct column provides the count of selections per sample and the 'no difference' button (if enabled in the test).

  3. Reports - Create now or view previously generated reports, or schedule reports to be emailed out at a later time. The following reports are compatible with the 2-AFC question type:
    1. Standard report - Detailed information about the tabulated results for samples chosen as different (as 'more' in the evaluated attribute), Binomial distribution: Null Hypothesis (Distribution mean, Number of trials, Chance, Distribution variance), Alternative hypothesis (d' (d prime) - available only when 'no difference' option is disabled), the p-value, and the statistical decision.

      If a follow up questions were included in the test, information for each follow up question will be available in the report.

    2. Summary report - Summary Statistics by Attribute table outlining the counts for each sample being chosen as different ('more' in an attribute), count of 'no difference' selections if the feature was enabled, the p-value for two-tailed test, p-value for one-tailed tests, and d' (d prime) values for one-tailed tests if 'no difference' was not enabled and if the d' option was selected in the Advanced analysis options screen.

    3. PowerPoint report - Visual representation of the percentages for responses in a PowerPoint Presentation report format.

    4. Panelist completion time report - Provides the average test completion time for the test and the total time for each panelist.

    5. Raw data export - Choose from the Multivariate, Univariate, and Multivariate Columnar raw data export formats to suit your exporting needs.


    • Related Articles

    • 3-AFC Test

      Overview The pre-set 3-AFC test type template comes distributed with the software for you to use in a click of a button! Determine if there is a difference between two products for a specified attribute by asking panelists to select the sample that ...
    • 3-AFC Response Related Choose Question

      Overview Do you have a list of options you would like to ask panelists to choose from in a response to the samples they evaluated as same as reference in your 3-AFC test? Not a problem! You can add a Choose question type in such a way that the ...
    • 3-AFC Response Related Comment Question

      Overview If you would like to ask panelists for their comments on the samples that they evaluated in a 3-AFC test, the template 3-AFC test type already comes set up with it! With this setup, the analysis will automatically separate the panelist ...
    • Standard Report: Tetrad Test Results

      Overview Analysis for the Tetrad data in Compusense uses a one-tailed binomial test. The formula that you can use in Excel to reproduce the same analysis is as follows: =1-BINOMDIST(x-1,n,0.3333333333333,TRUE) Where: x-1 = number of correct responses ...
    • Run Test

      Overview In the Run test tab, you can set up and review the final details of your test before you start test . Status The status indicates what stage the test is in. Status Name Status Description In design This status indicates that an analyst is ...