A-not A Test

A-not A Test

Overview

The A-not A test is a discrimination testing method in which panelists are presented with at least two samples. At least one of the samples is a previously identified sample (A) and at least one sample is a test sample. All samples are blind-coded and presented monadically. The panelists are asked to indicate whether they perceive each sample to be A or Not A.

The software will conduct a chi-squared test and provide a d’ estimate.

As a design is added to the section containing this question, in addition to the standard sample blinding codes, another set of blinding codes is included for familiarization/reminding purposes.


A-Not A tests are not compatible with reps.

Example uses for the A-Not A testing:
  1. A trueness-to-type test to confirm that a product meets consumer expectations.

  2. For panelist screening purposes. E.g. To determine whether panelists recognize a particular ingredient relative to other ingredients.

  3. To determine whether an overall difference exists in relatively fatiguing products, etc.

Back to back A-Not A test designs are available in the advanced options of the Edit design screen. Contact our Support Team for more information.


Question Compatibility

The A-Not A test type is compatible with the following question types:
  1. Choose - can be set as related to the A-Not A selection made by panelists.

  2. Comment - can be set as related to the A-Not A selection made by panelists.

  3. Numeric - cannot be set as related to the A-Not A selection made by panelists.

  4. Photo upload - cannot be set as related to the A-Not A selection made by panelists.


Create the Test 

  1. On the Dashboard , in the Folders list on the left, select the folder where you wish to save your new A-Not A test.

    If necessary, use the menu from the vertical three dots to create new sub-folders or to edit existing ones.


  2. Click Create a new test .

  3. Next to the A-Not A test type , click Use .


  4. Type the test name and specify the location for it (in case the folder selected in the first step was not the right one).

  5. Click Create Test . The test will open up.
The Test ID displayed in the top right-hand corner is an important unique identifier useful for test searches. The Test ID can also be found in the Dashboard.

Please have the Test ID handy when you reach out to our Support Team for assistance.


Update the Test

Although the template test has a number of pre-set components that might work for you the way they are, you will still have to update some components to make them reflect your testing needs. Please go through each test tab outlined below and make necessary changes.
  2. You can update all blinding codes, including the familiarization ones.

  3. For training purposes, you may display the feedback to panelists.

    Familiarization screen can be added to the test.

    You can also add an A-not A related Comment or A-not A related Choose questions. 


  5. Logistics

Add Familiarization Screen

  1. In the Build tab, on the left, expand the Text/time delay option and click Familiarization.


    The familiarization text screen will be inserted at the top of the questionnaire/section, its appearance is set to 'first cycle', the duration is 5 seconds, and the preset text implies that the familiarization will take place at the very beginning of the test. You can update text the same way you update the text in other screens.

    Update the Options as needed by following the steps below.

  2. Click the instructions to bring up the Options menu. You will need the one that turns orange when you hover over it.


    1. To change the cycle in which the screen appears, select the appearance that best suits your testing needs. If you wish to display the familiarization screen for more than one cycle with their unique text, clone the first cycle and make necessary changes in the clone.


    2. Set the duration of the familiarization process and indicate whether you want the screen to automatically forward to the next page when the time lapses, or you want to allow panelists to click Next instead. Also indicate whether you wish to display to panelists the countdown timer or not.


    3. Select one sample you wish the panelists to familiarize with. Only one sample can be associated with a single familiarization screen.


    4. If you wish to display message pop ups to panelists during their sample familiarization, click Add message and specify when the message should appear, when it should hide, and what the message is.

    5. Click Save to save the changes.

  3. In the text (instructions) for the familiarization screen, insert the Sample blinding code wildcard to dynamically display the correct familiarization blinding code.


Preview and Run the Test

When all test components have been added and configured, you may preview the test and then present it to your panelists.


Analysis

Click the Results tab to access and choose from the following analysis options:
  1. Graphs - Visual representation of the data.

  2. Data - Raw data display in the form of check marks and x marks indicating whether the panelists correctly or incorrectly selected which sample(s) was A and which sample(s) was Not A. The Total Correct column provides the count of correct responses per panelist in the test.

  3. Reports - Create new or view previously generated reports. The following reports are compatible with the A-not A question type:
    1. Standard report - Detailed information about the tabulated results, the Chi-square Analysis, and it provides a d' (d prime) estimate, the p-value, and the statistical conclusion.

      If a follow up Comment or Choose questions were included in the test, two tables (for correct response related and incorrect response related Comments or Choose data) per follow up question will be available in the report.

    2. Panelist completion time report - Provides the average test completion time for the test and the total time for each panelist.

    3. Raw data export - Choose from the Multivariate, Univariate, and Multivariate Columnar raw data export formats to suit your exporting needs.


    • Related Articles

    • Run Test

      Overview In the Run test tab, you can set up and review the final details of your test before you start test . Status The status indicates what stage the test is in. Status Name Status Description In design This status indicates that an analyst is ...

    • Tetrad Test

      Overview Tetrad test is a discrimination test type that helps you determine if there is a difference between two products by asking panelists to group the four samples into 2 groups of 2. This highly recommended method is useful for a wide range of ...

    • Torgerson's Test

      Overview The pre-set Torgerson's test type template comes distributed with the software for you to use in a click of a button! A Torgerson's test is a discrimination test type that presents three samples, all of which are different from each other. ...

    • Survey Test

      Overview The pre-set Survey test type template comes distributed with the software for you to use in a click of a button! Use this test type to create a survey or screener that has no samples or design. Consider this test when looking to gather ...

    • Triangle Test

      Overview Triangle test is a discrimination test type. Determine if there is a difference between products by asking panelists to select the different sample out of three samples, of which two are the same. This method is commonly used with employee ...