Review the Intent History for a Custom Skill

The Intent History page of the developer console displays aggregated, anonymized frequent utterances and the resolved intents. You can use this to learn how users interact with your skill to identify improvements you may want to make to your interaction model.

Review intent history in the developer console
Review intent history in the developer console

Available Data

The data displayed on the Intent History page is aggregated and anonymized. This means you will not see all utterances sent to your skill:

  • A locale must have at least 10 unique users in a day for any data from that locale and day to be available. For example, suppose the English (US) version of a skill had 20 unique users on June first, and the English (UK) version had only 9 on that same day. Data from June first would be available for English (US), but not English (UK).

  • The utterances shown represent frequent utterances, selected based on privacy criteria.

The data is available for both development and live skills, and for skills in a beta test. Noted that the 10-unique users per day requirement applies to all skills, so you may not see much data for skills still in development.

The page displays the following columns.

Column Description

Utterance

The utterance the user spoke to your skill.

Confidence

The confidence that the utterance resolved to the correct intent. This can be HIGH. MEDIUM, or LOW. Note that LOW confidence requests are not sent to your skill as an intent request, but trigger a reprompt instead.

Resolved Intent

The intent in your skill that the utterance matched. For a LOW confidence request, this represents the best guess match, but the intent was not sent to your skill.

Resolved Slots

A list of slots that were also resolved (filled) by the utterance.

Dialog Act

If the utterance is part of a dialog, this can be Elicit Slot, Confirm Slot, or Confirm Intent.

Interaction Type

Indicates if the utterance was executed as a ONE_SHOT interaction or MODAL interaction.

  • ONE_SHOT: The user invokes the skill and states their intent in a single phrase.
  • MODAL: The user first invokes the skill and then states their intent.

Search and Filter the Results

You can search and filter the Intent History results. For a free-for search, enter the search terms in the Search Utterances box. To filter based on set criteria, select the criteria:

  • Confidence level
  • A specific Built-in intent
  • A specific Custom Intent

Click Apply to see the results of the search or filter.

You can also use the Export option in the upper right to export the results.

Intent History and AMAZON.FallbackIntent

The AMAZON.FallbackIntent (available in English locales only) built-in intent is triggered when the user's utterance does not match any of your skill's intents. This intent displays just like the others on the Intent History page, so you can see frequent utterances that did not match your interaction model.

This is a useful way to see functionality users may be expecting, or common misspoken phrases that you may want to add to your skill. For example, if many users ask your "plan my trip" skill about the weather in a destination city, you may want to add this functionality to the skill.

Be sure to include AMAZON.FallbackIntent in your interaction model so that you can see these results.