February 02, 2018Jeff Blankenburg
We recently published a new skill for Alexa developers called Dev Tips, which is designed to connect you with the news, tips, and resources you need to build your best skill—all via voice. As part of our initial research and content creation, we scoured the discussions on Alexa developer forums, office hours, and in-person interactions with Alexa developers to figure out what kinds of questions most developers are asking.
We came up with about 100 different answers ranging from "When are office hours?" to "Help me understand entity resolution." We acknowledged, however, that we would never be able to create a complete set of answers to all of the questions that developers might have—but we could try. To do this, we would need to be able to monitor all of the requests that our users were making. When we discovered a question that didn't have an answer, we would write the content for it, and add it to the skill during our weekly release.
Each week, we identify 10 to 20 new utterances that we hadn't anticipated, and actively work to create the necessary content to answer these questions with future releases. Here we share how you can continuously improve your own skills with custom slots using Dev Tips as an example.
In Dev Tips, we lean heavily on entity resolution to determine whether we have an answer to a question, or whether we have a miss. Every time our custom slot is used, we log that user's slot value to our database, and mark it as a miss if we received the ER_SUCCESS_NOMATCH code. This gives us a rolling list of what is important to our users, and an active worklist of items that should be added to the skill. Creating and adding fresh content to your skill is one of our seven qualities of standout skills, and we can’t recommend this practice enough.
Initially, we were scouring our database every day, scrambling to write the new content and re-publishing our skill. This proved to be too aggressive of a schedule, so we shifted to a weekly review. In this review we look at the list of missed slot values, and decide what kind of action to take. Here's a look at this week's entries by proposed actions:
Updates to Be Made Next Week
As you can see, even when we have written answers to many questions, there are always new ones popping up, or users asking questions in a way we hadn't anticipated. Our goal is to give a contextual answer each time, so we try to accommodate nearly everything that users ask of the skill.
Once we have identified our work list, we generate all of the information that is necessary to answer a user's questions.
As you might imagine, there's a decent amount of work required to write a new answer for this skill because we are trying to use every feature of each device. In some cases, we can reuse an image or a background, but for the most part, for each of these items need to be written or created, uploaded to our database, and tested on devices with and without screens to verify that everything works properly. Here's our checklist of the assets we create for one new answer in the Dev Tips skill.
Required For Launch
Optional Assets for Echo Show, Echo Spot, and Cards
For the week following our review, our small team writes the content, creates the images, uploads everything to their appropriate locations, and tests the skill on their devices. The following week, that new content will be submitted for certification and added to the existing live skill's experience.
We’ve been following this process to maintain the Dev Tips skill since November 2017 and engagement has been trending steadily upward—total sessions, unique users, and even our average sessions per user have continued to increase since December. With a minimal investment in time, we have created and are continually growing and improving our skill every week. We hope that some of our experiences are relatable to you and your skills, and show you just how easy it can be to build a skill that is popular with your users.
Check out these additional Alexa developer resources to learn more:
Every month, developers can earn money for eligible skills that drive some of the highest customer engagement. Developers can increase their level of skill engagement and potentially earn more by improving their skill, building more skills, and making their skills available in in the US, UK and Germany. Learn more about our rewards program and start building today.