Run the Music Validation Tool

This page contains step-by-step instructions to prepare for running the Music Validation Tool (MVT) for the Alexa Voice Service (AVS) for device manufacturers who are implementing support for Amazon Music.

Pre-requisites

Before running the MVT, complete the following prerequisites:

  1. Provision your developer account to gain access to the MVT:

    1. Log in to your Amazon Developer account on developer.amazon.com and navigate to the Music Certification Validation tool:
    2. From the Amazon Developer dashboard, go to Amazon Alexa > Alexa Voice Service > Products.
    3. Click the device that you are testing.

    4. For the selected device, click the Test Tools tab to view the MVT.

      The first time that you access the MVT, you will be prompted to provision your developer account to gain access to the tool:

      Provision Account

    5. Click the Provision Account button and wait about 10 minutes for your account to be provisioned so that you can access the MVT.

      If you ever choose to de-provision your account, click the Deprovision Account button for any provisioned account to revoke access to the tool. If you de-provision your account by mistake, you can re-provision it again at any time.

  2. After provisioning your account, download and review the certification checklist for each MSP that you plan to have your device support:

Steps to use the tool

Use the same Amazon developer account to run your certification tests that you'll use to create the testing report via the MVT.

To run the MVT:

  1. Follow the certification checklists as you run your tests. Follow the checklists in the correct order and to the specified timestamps to prevent your tests from failing.
  2. After provisioning your Amazon Developer Account, as described in Prerequisites, log in to your and navigate to the Music Validation Tool:
    1. From the Amazon Developer dashboard, go to Amazon Alexa > Alexa Voice Service > Products.
    2. Click the device that you're testing.
    3. For the selected device, click the Test Tools link to access the MVT.
    MVT Test Tools link
  3. For the MSP that you're planning to certify for the test run, click Enter Results to open a Performance Validation form.
MVT Validation Form
  1. On the Performance Validation form, enter the required information in the following fields:
    • Device Serial Number (DSN): Find the DSN by logging in to alexa.amazon.com with your developer account, and going to Settings > Devices, then selecting the device that you're testing. Locate the Serial Number under the About section.
    Device Serial Number
    • Start Time: The time that the test started execution in MM/DD/YYYY HH:MM:SS AM or MM/DD/YYYY HH:MM:SS PM format.
    • End Time: The time that the test completed execution in MM/DD/YYYY HH:MM:SS AM or MM/DD/YYYY HH:MM:SS PM format.

  2. Click Submit to generate the report.

    MVT displays a "generating results" message. When the MVT finishes, the Result for that MSP changes on the MVT dashboard from Not Submitted to PASSED or FAILED.

    MVT Results

  3. To drill down into the results report, click the date stamp for the individual test run.

    The validation results report opens as a PDF in a new browser tab.

    MVT Results Report

Interpret the test results report

View the test results report to see how your device performed for a given MSP.

The test results report has four sections:

  • Summary
  • Utterance Validation
  • Coverage Validation
  • API Validation

Summary

The Summary section shows the validation status for each component of certification testing:

  • Utterance Validation
  • Coverage Validation
  • API Validation
MVT Report Summary Section

Validation status has four possible values:

  • PASSED: Passed the specified certification rule.
  • FAILED: Failed the specified certification rule. Certification is blocked until a new test run passes this rule.
  • WARN: The API validation failed on a non-blocking API rule.
  • UNVERIFIED: The rule did not run due to failures in previous rules.

Utterance Validator details

The Utterance Validator verifies that all submitted utterances played successfully:

MVT Report Utterance Section

Coverage Validator details

The Coverage Validator verifies that the workflow of the test successfully ran for each test run for a given MSP:

MVT Report Coverage Section

API Validator details

The API Validator validates the API implementation for a device using the logs for each music event:

MVT Report API Section
Was this page helpful?