Merci de votre visite. Cette page est disponible en anglais uniquement.

View Skill Metrics

Use the Analytics page in the Alexa Skills Kit developer console to see metrics for a skill. This dashboard can give you useful information about your skill and how customers are using it.

View the metrics for a skill

In the developer console, use one of the following methods to access the Analytics page:

  • When viewing the list of your skills, in the row for the skill, click Analytics.
  • In a skill that you are viewing or editing, in the top navigation, click Analytics.

The metrics available on the Analytics page depend on the type of your skill.

On the Analytics page in the developer console, you can:

  • Use the language drop-down list in the upper left to switch between language models, or choose All to see combined metrics for all of your skill's language models.
  • Use the Jump to analytics for list to go directly to the Analytics page for a different skill in your account.
  • Use the Skill Stage drop-down list to switch between development and live versions of the skill.
  • Use the Time Interval controls to change the time range.
  • Use the Aggregation Period drop-down list to change how the data is grouped (every 15 minutes, hourly, daily, or weekly).
Analytics page
Analytics page

Skill metrics

The Summary section of the Analytics page displays an overview of the metrics available for the skill. For each metric, you can view infographics like charts, grids, or other visualizations. You can export these infographics as PNG or JPEG images, or download the raw data in CSV format.

Most metrics are available for skills in both the development and live stages, except as noted in the following tables. Some metrics are only available for certain types of skills (custom, smart home, and so on), as noted in the following tables. Metrics are not available for meeting skills. All metrics data excludes invocations from the Test page in the developer console.

Metric Description Skill types
Actions Unique customers per action, total actions, and total utterances per action. Smart Home
Customers The total number of unique customers who have accessed the skill. Custom

Flash Briefing

Smart Home
Intents Unique customers per intent, total utterances per intent, total intents, and failed intents. Custom
Interaction Path Shows the paths users take when interacting with your skill. For example, you can see the percentage of users who invoked a particular intent after the LaunchRequest. Custom
Plays Total number of times your skill's content was played. Flash Briefing
Retention
(live skills only)
Shows the usage of your skill over time by groups of customers (cohorts). You can see the number or percentage of customers who returned to your skill over a 12-week period. Custom
Sessions Total sessions, successful session types (sessions that did not end due to an error), average sessions per customer, and a breakdown of successful, failed, and no-response sessions as a percentage of total sessions. Custom
Utterances The metrics for utterances depends on the type of skill.

For custom skills:
Total utterances, average utterances, and utterance responses.
For smart home skills:
Total utterances and average utterances per customer.
Custom

Smart Home

The Skill Activation section of the Analytics page displays metrics related to skill activation, as described in the following table. Skill activation metrics are available from January 1, 2018. They are only available for live skills.

Many of the following metrics relate to account linking. You should understand account linking initiations and completions. For more information, see Understand Account Linking.

Metric Description Skill types
Account Linking Completion Rate The percentage of successful account links. This is the total number of account linking completions divided by the total number of initiations. Custom (with account linking)

Smart Home
Account Linking Initiations Per User The average number of account linking initiations per user. Custom (with account linking)
Total Account Linking Events The total number of account linking initiations and completions. Custom (with account linking)

Smart Home
Total Account Linking Users The total number of unique users who:
  • Enabled the skill.
  • Initiated account linking.
  • Completed account linking.
Custom (with account linking)
User Enablements The definition of this metric depends on the type of skill.

For custom skills without account linking, all flash briefing skills, and music skills without account linking:
The total number of unique users who enabled the skill.
For smart home, video, and baby activity skills:
The total number of unique users who enabled the skill and completed account linking.
Note: Some users might enable your skill, but not launch it. Only users who launch a skill are counted in the number of unique customers. This can help explain a difference between the number of user enablements and the number of unique customers.
Baby Activity

Custom (without account linking)

Flash Briefing

Music (without account linking)

Smart Home

Video

Operational metrics

In the developer console, the Analytics page shows operational metrics for a smart home skill. Metrics include latency and success rate for the skill that are related to device discovery, capability directives, and query state requests. The operational metrics are from as recent as five minutes prior.

On the Analytics page, in the Operational Metrics section, the Discovery, Capability Directives, and Report State pages display the latency and success rate metrics for device discovery, device control, and query state requests, respectively. For each of these metrics, you can view infographics like charts, grids, or other visualizations. You can export these infographics as .png or .jpg images, or download the raw data in .csv format.

On each of the operational metrics pages, use the:

  • Jump to analytics for list to go directly to the Analytics page for a different skill in your account.
  • Skill Stage drop-down list to switch between development and live versions of the skill.
  • Region drop-down list to switch between NA, FE and EU regions.
  • Time Interval controls to change the time range.
  • Aggregation Period drop-down list to change how the data is grouped (every 5 minutes, 15 minutes, hourly, daily, weekly, or monthly).

Discovery page

Alexa sends a discovery request to your skill to discover your customer’s smart devices. The Discovery page shows the latency and success rate graphs for all discovery requests to your skill. For more information about discovery, see Alexa Discovery interface.

Capability Directives page

When a customer asks Alexa to control their smart device, Alexa sends a directive request to your skill to trigger a capability, for example turning on a light. The Capability Directives page shows Latency and Success Rate tabs. Both tabs show multiple graphs, one for the aggregate of all capability directive requests, and one per capability for all capabilities supported by your skill. The capability graphs show the aggregate across all directives and the breakdown per directive for all directives under that capability. For more information about capability directives, see Understand the Smart Home Skill API.

Report State page

Alexa sends a report state directive to your skill to request the state of an endpoint. The Report State page shows the latency and success rate graphs for all the report state requests to your skill. For more information about report state, see State Reporting for a Smart Home Skill.

Operation metric definitions

Latency
Latency is the time until Alexa receives a response from your skill, after Alexa sends a request to your skill. Latency is measured using percentile statistics such as P99, P90, and P50. Use the operational statistics menu (+ icon) in the latency graphs to choose different percentile statistics or the average. You can view multiple statistics on the same graph.
Success rate
Success rate is the total number of successful responses Alexa receives from your skill divided by the total number of requests Alexa sends to your skill.
Request volume
Both latency and success rate graphs show request volume on the 2nd Y-Axis. You can use the + icon on the graphs to toggle the request volume on or off.

In-skill purchasing metrics

The metrics for in-skill purchasing differ depending on the type of in-skill product:

One-time purchases (entitlements) and consumables

The following metrics are available for one-time purchases and consumables:

  • Total Purchases – The total number of offers accepted for all in-skill products of this type (one-time purchases or consumables) within a skill. For consumables, this includes repeat purchases by the same customer.
  • Purchases – The number of offers accepted for each in-skill product. For consumables, this includes repeat purchases.
  • Upsell to Offer Conversion – The percentage of upsell impressions for which customers agreed to hear the offer. This metric is only available when you use the upsell directive.
  • Offer to Purchase Conversion – The percentage of offer impressions that resulted in a purchase.
  • Upsell to Purchase Conversion – The percentage of upsell impressions that resulted in a purchase. This metric is only available when you use the upsell directive.
  • Offer Impressions – The total number of times customers heard the purchase prompt from Amazon, describing your product and its price, and decided whether or not to buy. This metric does not include messages provided within the upsell directive. For consumables, this includes both the first time purchase as well as repeat purchases of the same item.

Subscriptions

The following metrics are available for subscriptions:

  • Active Subscriptions –The total number of active subscriptions for your skill. This includes paid subscriptions that are set to expire at a future date.
  • Trial to Paid Conversion Rate – The percentage of trials that became paid subscriptions.
  • Churn – The percentage of active paid subscriptions that expired or canceled.
  • Subscriptions Started – The total number of new subscriptions.
  • Offer Conversion Rate – The percentage of offer impressions that resulted in the customer signing up for a new trial or paid subscription.
  • Upsell to Offer Conversion – The percentage of upsell impressions for which customers agreed to hear the offer. This metric is only available when you use the upsell directive.
  • Offer Impressions – The total number of times customers heard the purchase prompt from Amazon, describing your product and its price, and decided whether or not to buy. Offer impressions includes both free-trial and paid offers. This metric does not include messages provided within the upsell directive.
  • Upsell to Purchase Conversion – The percentage of upsell impressions that resulted in a purchase. This metric is only available when you use the upsell directive.
  • Subscriptions Ended – The total number of trial subscriptions that were canceled or paid subscriptions that expired. If a customer cancels a paid subscription, the subscription remains active until it expires at the end of the customer's billing period.

Frequently asked questions

Does a skill need to be live before I can see its metrics?
No. Many metrics, including operational metrics, are available for skills in both the development stage and live stage.
Do the dashboards show real-time data? How long does it take for the data on the Analytics page to update?
For the retention metric, the data is refreshed weekly. The data won't update until a week's worth of data is available.

For the enablements metric, the data is delayed by as much as one day. The data is updated as it becomes available.

For operational metrics, the dashboards show data collected from as recently as five minutes prior.

For other metrics, the data can be delayed by as long as two hours.

Can I see metrics for all of my skills in one place?
No, not at this time.
Can I access metrics data by using the Skill Management API any other programmatic interface?
At this time, you cannot use an API or other programmatic interface to access operational metrics.
Can I export the metrics data?
Yes, you can export infographics (charts, grids, and other visualizations) as PNG or JPEG images. You can also download the raw data in CSV format.
What is a unique customer?
A unique customer is a customer who launched a skill using a unique Amazon account. Unique customers are determined by user accounts, not devices. If a customer launches your skill on multiple devices that are all registered to the same user account, this is counted as one unique customer.
What is a user enablement?
User enablements are the unique user accounts that enabled your skill, either by voice, the Alexa app, or the Alexa Skill Store website. For some types of skills, users must perform account linking to enable the skill. For more information, see Skill metrics.
Why is the number of unique customers and user enablements different?
Some users might enable your skill, but not launch it. Only users who launch a skill are counted in the number of unique customers. This can help explain a difference between the number of enablements and the number of unique customers.
Why does the number of unique customers change when I change how the data is aggregated, e.g. hourly, daily, or weekly?
The number of unique customers changes because the meaning of unique changes depending on how you aggregate the data. For example, consider the following scenario in which several customers use the same skill in the same day:
  • Customer A uses the skill at 01:00.
  • Customers B and C both use the skill at 11:00.
  • Customer B uses the skill again at 15:00.

When you aggregate the data by hour, you see one unique customer at 1:00, two unique customers at 11:00, and one unique customer at 15:00.

When you aggregate the data by day, you see a total of three unique customers.

Adding together the number of unique customers per hour does not necessarily give you the number of unique customers per day, because it doesn't account for repeat customers. The metrics that you see on the Analytics page account for repeat customers, which can help explain why you see differences when you aggregate the data differently.

The Summary section of the Analytics page shows the total number of unique customers for the entire date range that you select.

Can I see the operational metrics for my skill for all the regions in which my skill is published?
You can see operational metrics across regions if you have the same Skill ID across the regions. Use the Region drop-down list to pick a region that you want to see metrics for.
Can I see the total metrics for all of a skill's locales or languages in one place?
Yes. In the language drop-down list in the upper left, choose All to see combined metrics for all of your skill's language models.
How can I see my customer retention rate?
The cohort chart in the Retention section of the Analytics page shows the number of returning users and the percentage of retention increase or decrease over time.
How far back in time can I go to view the operational metrics?
Operational metrics are available from June 27th, 2019. You can view data for up to 90 days prior, but for no earlier than June 27th, 2019.
Why am I not seeing the metrics for my smart home v2 skill?
You can view operational metrics for smart home v3 skills only. Upgrade your skill to v3 to access operational metrics.
How can I provide feedback or report issues?
Email us at alexa-smarthome-ops-dashboard-feedback@amazon.com. Alternatively, click the Send Feedback link at the bottom of each of the operational metrics pages. This link opens your email client with the URL already populated. In your feedback, enter the description for the issue you are reporting.

The developer console: