Following up on the latest in a series of webinars covering Amazon devices, game services, and mobile applications, here’s a list of questions we collected during and after our presentation on the Amazon AB Testing API.
Q: AB test requires internet connection at every launch so even i switch to 100% for say thanksgiving.. it will not applicable to user if he is not connected to internet.. Is there any way to make it concrete... A: If you query the server for a variant each time you use the app, the user will get the default value (“ABTest Default”) from this line:
If that default were set to “Thanksgiving”, you could be sure that you would get this value even if offline.
If you have a different, undesired value as default, you will need to wait until the user launches the app while online to effect the change. Even then, when offline, the user will see Default again. To make sure this doesn’t happen, you can save the value once it’s been set. Then you can check to see if there is a connection before resetting the value from the server, and use the stored value if there is no connection. This way, the value can always be “Thanksgiving” (or whatever variant you select), even when the user is offline.
Q: if we r using a|b testing in our google play apps, does it need the amazon appstore app installed (for drm validation) in the device or just adding the insights jar file in our google play app will do? A: Amazon Appstore does not need to be installed for A|B Testing to work. Just adding the Insights jar file will work.
Q: when i was a|b testing, i noticed delays in getting the variables in my app as well as viewing the results in the portal... why is there a delay? what is stopping from real-time measurements on the portal? A: The call to the Insights service updates asynchronously, and results are not posted to the server real-time. It is reasonable to see some delay before the results appear in the portal. When offline, the service batches all collected data and saves it until the customer’s device connects with our service.
Don’t miss out on our next webinar event:
Tips & Tricks: How To Test, Submit, and Earn Revenue with Your HTML5 Mobile Web Apps on November 7th, 2013 @ 10:00 AM