How it works
ATS provides pre-defined templates, or you can create custom test plans. To build a test, you describe what you want to test as natural-language utterances and ATS creates a test plan. For example, to test a light bulb with color control, you might add the utterance, When you run the test plan, ATS sends voice commands to your device through Alexa and validates the device response and state change reports. After the test completes, you receive a detailed test report with pass and fail results and error descriptions for any failures.Supported templates
ATS provides pre-defined templates for the following Alexa interfaces:- BrightnessController
- ColorController
- ColorTemperatureController
- PowerController
- ThermostatController
When to use ATS
You can use the testing service throughout the development lifecycle to perform the following tasks:- Test during development – Validate your smart home add-on or Matter integration as you build.
- Debug device integration issues – Identify and resolve device integration problems.
- Prepare for certification – Validate device behavior before you submit your product for Works with Alexa (WWA) certification.
- Create regression tests – Build reusable test plans to verify that updates don’t break existing functionality.
Prerequisites
Before you start, make sure that you have the following items:- An Amazon developer account.
- An Alexa-enabled device, such as an Amazon Echo. Make sure that you sign in to the Echo device with the same credentials as your Amazon developer account.
- At least one test device connected to your developer account. Make sure your device is discoverable and responds to Alexa commands.
- The device under test and Echo device registered to the same account and available in the Alexa app.
-
For add-on-enabled devices, you must meet the following prerequisites:
- Your smart home add-on must be available in the developer console and you must configure the minimum configuration for a smart home add-on.
- Deploy your add-on code in an AWS Lambda function to provide communication between Alexa and your device.
- Enable your add-on in the Alexa app. Make sure that you sign in to the Alexa app with the same credentials as your Alexa developer account.
- Configure account linking and successfully link your device account with your Alexa account.
-
For Matter-enabled devices, you must meet the following prerequisites:
- Commission your device on the same Alexa fabric as your Echo device.
- Have your device local ID available.
Get started
To get started testing your device, create a test plan and run tests against your device.- Create a test plan – Choose from a pre-built template, customize a template, or build a custom test plan. For step-by-step instructions, see Create Test Plans.
- Run the test plan – Select your test plan, choose your devices, and run the test. For step-by-step instructions, see Run Test Plans.
