Before you publish your skill to the Alexa Skills Store or submit it for certification, it is recommended that you test it multiple times using the below tools. Testing your skills at different stages provides you with the expected and actual behavior of the skill. This helps you determine if the skill responses are relevant to the customer requests, if the customer facing details are clear and informative, and in the case of any issues found during testing, how you can debug and resolve proactively.
Currently, the below options are available for all Alexa Skill types. Let’s go through them in detail for the following types of skills: 1) Custom , 2) Flash Briefing, 3) Smart home skills.
You can test your custom interaction model with the Utterance Profiler after you successfully save and build your skill model. You do not need to configure an endpoint for testing the skill with Utterance Profiler. However, ensure the following configurations are met before testing the development version of your skill:
If your custom skill contains an AWS Lambda ARN or HTTPS endpoint, make sure that the default region field is filled. For an HTTPS endpoint, it is important that the SSL certificate type is correctly indicated, or you can also use a self signed certificate which is available only for testing an endpoint.
Once the skill is built and the interaction model is defined, you can choose the “Evaluate Model” option to let the system test and validate the utterances under the Utterance Profiler tab.
For skills using account linking: If your custom skill uses the account linking feature, please ensure that it is configured correctly. You can test intents that do not require authentication, however, to avoid skill rejection during the certification process, you must test all intents that return a LinkAccountCard. This ensures that all intents with account linking are working as expected, and in the case of any issues found, you can proactively debug it.
Flash briefing skills are created using a pre-built model for which you need to mention and save all the below requirements of at least one feed to proceed through the skill testing:
Once you have filled in all the details, login to alexa.amazon.com using your developer account credentials. Then add your skill to the flash briefing section of the Alexa Web App or Alexa Mobile App (More> Configurations> Select News section under Alexa preferences).
Here you can say “Alexa, what's my Flash Briefing?” and see if the skill is giving an appropriate response.
Alternatively, you can select Edit from the drop-down of the skill, go to Test tab, and then to Skill testing enabled in: and select Development. Then you can try the utterance mentioned and above, and the skill should respond as expected if there is no error. Now, your skill should be ready to submit for the certification process.
To test and debug your smart home skills, you can follow the below steps. In developer console, go to:
For more information, you can refer to the technical document Test and Debug Your Smart Home Skill. You also need an account configured for your device cloud and discoverable devices for that account.
The Test page includes a simulator that lets you test your skill without a device. When you are ready to test the skill, navigate to the Test page.
If you haven't enabled testing for this skill, locate the Test is disabled for this skill option in the upper left hand corner with the drop-down selection set to Off. From the drop-down list, select either Development or Live as your skill testing stage.
If you have already enabled testing, from the Skill testing is enabled in: list, select either Development or Live as your skill testing stage, or select Off to disable testing.
You can only select one option here, meaning that your skill can only be enabled/tested in one stage at any time. For example, enabling your skill for testing in the Live stage correspondingly disables your Development version for testing, and your live skill continues to be available in the developer console, SMAPI, ASK CLI and your devices that are signed in to your developer account. As part of this enablement in the developer console, the page will redirect to the live stage URL and will reset all session and context information. If you have any information you want to preserve, be sure to save it before proceeding. This activity generates a new User ID and can be used to simulate a first-time user experience. If your live skill is configured with a live lambda version, this stage of enablement uses that live version.
You can use the Test page to test most functionality in a skill, including multi-turn interactions, progressive responses (with limitations), and entity resolution. The page provides three tabs on the left for different types of testing.
In nutshell, Alexa offers multiple options for testing both new and current skills in development version. Below are some of the few recommended options to test ‘In-Development’ version of your skill:
Ensure that your Alexa skill meets the minimum requirements before with the testing it with any of the tool mentioned earlier in the blog.