AI Comment Insights

AI Comment Insights

Overview

Use the AI comment insights feature in Compusense to provide actionable summaries of your panelists' Comment data. You can generate a summary using the AI generated themes, or create your own themes. Export the summaries to include them into your reports.

Idea
Reach out to our Support Team if you have any feedback on the Artificial Intelligence integration with the comments' data, or if you have any suggestions and ideas on how you would like to see the AI working for you in Compusense.


Compatibility

The following are compatible with the AI comment insights feature:
  1. Both sample and non-sample related Comment data.

  2. Discrimination test related comments.

  3. One Comment question at a time (it is not possible to select multiple Comment questions to generate a summary).

Info
Comments collected in a Choose question are not compatible with this feature.


You Need To Know This

Please note the following:
  1. The AI comment insights feature in Compusense is powered by Meta Llama 3.

  2. Summaries generated by Meta Llama 3 may be inaccurate or inappropriate.

  3. The data in Compusense is not used for AI training purposes.



Generate a Default AI Summary

Filter the data before generating the report, or before generating the report again, if you need to.


Follow the steps below to generate a summary using our built-in AI call. 

  1. In the Results area, click on the AI comment insights tab.

  2. Select a Comment question from the Question dropdown. You can only select one question at a time.

  3. Click Summarize. Depending on the amount of data in your test, it might take a few moments for the summary to generate.

You will notice that some new options will appear on the screen once the Summary generates. Continue reading below to learn about all the details.

Notes
Every time you click the Summarize button, a new AI call will be sent to our servers and a new summary will be generated.


Summary Details

Whether you generated a summary using the default themes, or you customized the themes and generated the summary, the following details will be available to you:

Themes



Idea
If the Themes section is not visible, that means that no one generated a summary on the selected Comment question in that test yet. In that case, generate a default summary and then you will see the Themes.

  1. The current summary will display a list of up to 6 top key words, or themes, included in the summary. The corresponding graph is displayed in the Top themes. There will likely be more than 6 most frequently used themes found in panelist original comments, however the default summary will always select and display up to 6 themes. The selected themes are graphed in the Top themes section of the report.

    Click inside the Themes box to see the full list of all available themes.

  1. If you wish to remove a theme, click the x in front of it. This will remove the particular theme and it will open up the drop-down list so you can review all the themes, whether they are selected or not. From here you can deselect or select themes as necessary.

  2. If  you start typing in the box, all the themes that begin with the letters you type will start coming up in the list for easier selection.

  3. You can even type your own theme that currently does not exist in the list. Press enter to select newly added theme.

Warning
When adding new themes that are not already in the list, when selected, they will be reflected in the graph regardless of whether or not they were actually referenced in the panelist comments.


Counts



  1. Verbatim comments: The total number of original comments included in the report before generating the summary. In our example product test for the liking comments, two samples are included in the Filters. The sample 1 has 35 comments while the sample 2 has 37 comments. The total Verbatim comments considered when generating the summary is 72 (35 + 37).

    The Verbatim comments count will depend on whether the Comment question was set as required, whether the Connections forced panelists to skip over the Comment question depending on their answers in one of the previous questions, and whether the data was filtered before generating the summary.

  2. Verbatim included in themes: The AI decides which are the top themes and indicates in this count how many original panelist comments per sample (in a product tests) are included in all the themes combined.

  3. Themes: The total number of top themes included in the summary.



Top themes




  1. The graph representation of the summary with the legend below the graph. The themes are on the x-axis, while the percentages are on the y-axis.

  2. Use the toolkit above the graph to customize the appearance of the graph or to export it:
    1. Swap legend. Click the perpendicular arrows to swap the legend. This performs the same action as the blue button described earlier.

    2. Zoom. Enlarge (zoom in) a segment of the graph for a closer look. Click on the icon (the cursor will become a cross) and then click and drag the pointer around the segment on the graph that you wish to zoom in on. You can save the zoomed in segment if you wish by clicking the SVG or the PNG download icon.


    3. Zoom reset. Reset the zoom to the full graph view when done with the zoom.

    4. Data view. View the data table by clicking the paper icon , which you can copy to clipboard and paste in another application, such as Excel. Click Close to return to your graph.

    5. Line chart. Select a different graph format (line graph , bar graph , stacked , or tiled ).

    6. Restore. Click to restore the graph to the original format, if desired.

    7. Save as SVG image. Click to save the graph in the .svg file format.
      If you zoomed a segment of the graph in, you can download that segment. The file will be saved to a location set in your browser's download settings.

    8. Save as PNG image. Click to save the graph in the .png file format.
      If you zoomed a segment of the graph in, you can download that segment. The file will be saved to a location set in your browser's download settings.

  3. Click the arrow in front of the section name to collapse the section, if so desired. Click it again to expand the section.



Summary



  1. This section displays the actual summary or summaries of the comments on the selected Comment question. If more than one sample is included in the analysis, then there will be separate tiles, one for each sample, with their corresponding summaries inside. If only one sample was included in the analysis, or if it was a non-sample related Comment question, then only one summary tile will be displayed.

  2. The tile headings are in different colours for easier distinction between samples, where applicable. It displays the sample number and the sample name as specified in the Samples & design tab.

  3. Click the copy icon to copy the summary to the Clipboard. You may paste the copied data into an MS Word document or a PowerPoint report.


Comparison


Notes
This section is available only if 2 or more samples were included in the analysis for the selected Comment question. 
  1. The comparison contains the Overall Summary at the top, followed by a direct comparison between each sample included in the analysis for each top theme. In our example screenshot, we can see that the Texture was one of the top themes and we can see the summaries for each of the two samples, one after another for this top theme.

  2. Click the copy icon to copy the summary to the Clipboard. You may paste the copied data into an MS Word document or a PowerPoint report. You can also paste in Excel, but if your summary contains any row that start with a dash, Excel might 'think' that a formula is expected and might give you errors on the page.



Save A Summary

By default, every summary is automatically saved in a particular test and for the selected Comment question. Therefore, you do not have to make any additional efforts to save a summary before moving on to your next task.

Notes
The saved summaries will be available to every analyst user that can access to the particular test, until someone intentionally deletes the summary.

Info
Summaries are not transferable to other Comment questions in the same test, nor into a Comment question in a different test.

The auto-saved summaries will be named using the following naming format: "Auto-saved summary (date and time)", where the date and time are the exact date and time when the summary successfully generated.




You may wish to rename a summary to easier distinguish between different summaries for the same Comment question. The steps for renaming summaries are below.



Rename A Summary

If you would like to keep a specific auto-saved summary so you can reload it again in the future, you may rename it by following these steps to make it easier to recognize the summary you like:

  1. From the Questions drop-down list, select the Comment question for which you wish to rename a summary.

  2. From the Saved summaries drop-down list, select the summary you wish to rename.

  3. Click the pencil icon to bring up the Rename summary pop-up.


  4. In the New name box, type the summary name.

  5. Click Rename summary to save the changes. If your renamed summary was the most recently generated summary, it will be automatically selected in the list.


    If, however, your newly named summary was not the most recently generated summary, you will be able to select it from the list of summaries.



Load A Saved Summary

Alert
Selecting a saved summary does not automatically load it in your view.

Please follow these steps to load a saved summary:

  1. From the Questions drop-down list, select the Comment question for which you wish to load a summary.

  2. From the Saved summaries drop-down list, select the summary you wish to load.

  3. Click the icon with a semi-circular arrow. The selected summary will load.

Notes
Every time you click the Load summary icon, the selected saved summary will load the exact information that was originally saved.


Delete A Saved Summary

If you generated multiple summaries and identified those that you wish to keep, and renamed them, you may want to delete those summaries that are not needed to keep the list tidy.

Follow these steps to delete a saved summary:

  1. From the Questions drop-down list, select the Comment question from which you wish to delete a summary.

  2. From the Saved summaries drop-down list, select the summary you wish to delete.

  3. Click the trash can icon and confirm your action. The selected summary will be deleted.



Generate Your Own Summary

In addition to generating summaries using the default AI calls, you can customize the themes in saved summaries and regenerate your own summaries! This will not send a new AI call, but rather refine the saved summary with the updated top themes.

Notes
The themes will become available after the default summary is generated or after a saved summary is loaded for the selected Comment question.


Follow the steps to customize your own summary:

  1. From the Questions drop-down list, select the Comment question from which you wish to generate a custom summary.

  2. Either load a saved summary or generate a default summary to display the themes.

  3. In the Themes list, add new or remove existing themes to suit your reporting needs.

  4. When happy with the themes, click Regenerate summary.


Notes
Every time you click the Regenerate summary icon, a new summary will be generated using the selected themes found in the box at that time. Even if the themes are identical to the last executed summary, the new report will likely be different, due to the nature of the AI functionality.


Info
The saved summaries will be available to every analyst user that can access to the particular test, until someone intentionally deletes the summary.

    • Related Articles

    • Question Type: Comment

      Overview Comment questions are used to gather panelist comments, observations or demographic information, such as their name. You can specify the size of the comment box (number of characters across/down), and set the maximum number of characters the ...

    • Comment Sorting

      Overview Comment sorting allows you to sort individual words provided by panelists in a Comment question into word groups for analysis. Consumer comments can provide valuable information about your products and about consumer trends. Trained panel ...

    • Triangle Response Related Comment Question

      Overview If you would like to ask panelists for their comments on the sample that they selected as an odd sample in a Triangle test, you can set the Comment question up in such way that the analysis will automatically separate the panelist comments ...

    • Torgerson's Response Related Comment Question

      Overview If you would like to ask panelists for their comments on the samples that they evaluated in a Torgerson's test, you can add a Comment question in the Build tab. Similarly you can add a Choose question if you want to gather additional details ...

    • Tetrad Response Related Comment Question

      Overview If you would like to ask panelists for their comments on the samples that they grouped together in a Tetrad test, the template Tetrad test type already comes set up with it! With this setup, the analysis will automatically separate the ...