APL Video (APL 1.1 to 1.3)

(This is not the most recent version of APL. Use the Other Versions option to see the documentation for the most recent version of APL)

The Video component displays a video player that can display a single video or a series a videos. The embedded video player does not have any controls. Instead, the Video component provides the events and commands necessary to build the controls for controlling the video player. Refer to the PlayMedia and ControlMedia commands for how to drive the video player.

Skills that use the Video component must provide a way to pause the video content by voice and by the use of an on-screen button.

• Sample video
• Playback intents
• Manage voice input after playing a video
• Devices that do not support video
• Properties
  • audioTrack
  • autoPlay
  • scale
  • source
• Handlers
  • onEnd
  • onPause
  • onPlay
  • onTimeUpdate
  • onTrackUpdate

Sample video

{
  "type": "Video",
  "source": URL,
  "autoplay": true
}

Playback intents

You must implement built-in intents to support voice-based playback control.

Manage voice input after playing a video

If you want your skill to play a video and then accept voice input, use the onEnd event handler to invoke a SendEvent command. Your skill should handle the subsequent UserEvent request. Send a response with shouldEndSession set to false to accept voice input. Your response should include appropriate outputSpeech and reprompt objects to ask your Alexa customer for input.

Devices that do not support video

Note that some devices with screens do not support video playback. On a device that does not support video, the Video component remains on the screen, but displays no content so users will see a blank area on the screen. Provide an alternative experience for devices that don't support video.

The disallowVideo property in the data-binding context returns true when the device does not support video. You can use this property in the conditional logic in your APL document.

Alternatively, you can check for video support in your skill code. Check the context.Viewport.video property in the request sent to your skill.

Properties

The Video component has the following properties in addition to the base component properties. See the meaning of the columns.

The default height and width properties are each set at 100dp.

The media that is played is a single file. Live content is not supported.

The height and width of the Video component default to 100dp if not specified.

Do not set autoplay to true and also set shouldEndSession to false in an effort to keep the session open for voice input. This causes the microphone to open while the video is playing. See Manage voice input after playing a video.

When the Video component is the target of an event, event.target reports the following values:

"event": {
  "target": {
    "currentTime": Integer, // Current playback position in the current track, expressed in milliseconds
    "disabled": Boolean,    // True if the component is disabled
    "id": ID,               // ID of the component
    "uid": UID,             // Runtime-generated unique ID of the component
    "height": Number,       // Height of the component, in dp (includes the padding)
    "opacity": Number,      // Opacity of the component [0-1]
    "paused": Boolean,      // True if the video is in a paused state
    "source": String,       // URL of the currently playing or queued track
    "trackIndex": Integer,  // Index of the current track
    "width": Number         // Width of the component, in dp (includes the padding)
  }
}

audioTrack

The audioTrack property assigns the media content to foreground or background audio, or mutes it entirely (none). Foreground audio interleaves with speech commands and sound effects. Background audio plays behind speech commands and sound effects. Only one audio source may be foreground or background at a time.

With audioTrack set to foreground, the PlayMedia command does not "finish" until the all media tracks have finished. Thus, a simple command sequence can run that interleaves media content and speech, as shown in this example.

"onPress": [
  {
    "type": "PlayMedia",
    "componentId": "myVideoPlayer",
    "source": URL,
    "audioTrack": "foreground"
  },
  {
    "type": "SpeakItem",
    "description": "This will run after the media finishes playing",
    "componentId": "myAnswerBox"
  }
]

When a PlayMedia command has audioTrack set to background or none, the audio "finishes" immediately, and does not wait for the media content to end. Background media does not respond to touching the screen. For example, in the following sequence the SendEvent command fires immediately and does not wait for the media to finish playing.

"onPress": [
  {
    "type": "PlayMedia",
    "componentId": "myVideoPlayer",
    "source": URL,
    "audioTrack": "background"
  },
  {
    "type": "SendEvent",
    "description": "This will run immediately",
    "arguments": ["Media has started, but hasn't stopped yet"]
  }
]

autoPlay

If set to true, the video automatically starts playing as soon as it is loaded. If false, the video must be explicitly told to start. Defaults to false.

scale

Scales the video within the container.

source

Specifies the video clip or sequence of video clips to play. The source property may be either a plain URL (string) or an array of source data.

If more than a single video is provided, the player plays each video in turn. The source property of the Video component and the url property of each source follow the rules of "array-ification". For the url property, a plain string can be accepted as a single URL, as well as an object with a url property. Thus, all of the following are valid ways to set the source property:

"source": URL
"source": [ URL ]
"source": { "url": URL }
"source": [ { "url": URL } ]
"source": [ URL1, { "url": URL2 } ]

The most general way of specifying the media sources is to fully expand the definition:

"source": [
  {
    "description": "The first video clip to play",
    "offset": 150,   // Skip the first 150 milliseconds
    "url": URL1,
  },
  {
    "description": "The second video clip to play",
    "url": URL2,
    "repeatCount": -1    // Repeat forever
  },
  {
    "description": "This video clip will only be reached by a command",
    "url": URL3
  }
]

The following minimal definition is equivalent to the previous definition:

"source": [
  {
    "offset": 150,   // Skip the first 150 milliseconds
    "url": URL1,
  },
  {
    "url": URL2,
    "repeatCount": -1    // Repeat forever
  },
  URL3
]

When source is a data array, it has the following structure:

duration

Duration of time to play, in milliseconds. Leave not set to play the full video. When set to a duration shorter than the actual media clip, this stops the playback after playing for the specified time. No extra playing time is added if the specified duration is longer than the actual media clip. If duration is zero or smaller, the media clip is skipped and not played.

url (urls)

The URL of the source of the media. Must be https URLs. Determine which formats are supported by checking the video property of the Viewport.

repeatCount

The number of times to repeat playing this media. Defaults to 0, which means to play once through and stop. If set to -1, the video will repeat forever.

offset

The offset from the start of the media where it should start playing, expressed in milliseconds. Defaults to 0, which means that play begins at the start of the media. A video with a positive repeatCount value will restart playing the media at the same offset each time.

Handlers

The following handlers are invoked as described.

onEnd

The onEnd handler is invoked when the last video in the video sequence finishes repeating and finishes playing. The onEnd handler can be invoked multiple times. For example, a video might play through to the end and stop, then receive a seek command to rewind to an earlier point, then receive a play command, and then play through to the end and stop.

The event generated has this form:

"event": {
  "source": {
    "type": "Video",
    "handler": "End",
    "id": ID,          // ID of the video component
    "uid": UID,        // Runtime-generated unique ID of the component
    "value": null      // No value reported
  },
  "trackIndex": Integer,    // Will be equal to trackCount – 1.
  "trackCount": Integer,
  "currentTime": Integer,   // Will be equal to or greater than duration
  "duration": Integer,
  "paused": true,
  "ended": true
}

onPause

The onPause handler is invoked when the video playback intentionally switches from playing to paused. This may occur as a result of the video player reaching the end of the last video, a command being issued to the video player that stops playback, or by an interruption in synchronous video playback. The onPause handler is not invoked if the video player has to pause playback to download video content.

The event generated has this form:

"event": {
  "source": {
    "type": "Video",
    "handler": "Pause",
    "id": ID,          // ID of the video component
    "uid": UID,        // Runtime-generated unique ID of the component
    "value": null      // No value reported
  },
  "trackIndex": Integer,
  "trackCount": Integer,
  "currentTime": Integer,
  "duration": Integer,
  "paused": true,
  "ended": BOOLEAN
}

onPlay

The onPlay handler is invoked each time when the video playback switches from paused to playing. This may occur in a video with autoplay set to true, from a PlayMedia command, or from a play command.

The event generated has this form:

"event": {
  "source": {
    "type": "Video",
    "handler": "Play",
    "id": ID,          // ID of the video component
    "uid": UID,        // Runtime-generated unique ID of the component
    "value": null      // No value reported
  },
  "trackIndex": Integer,
  "trackCount": Integer,
  "currentTime": Integer,
  "duration": Integer,
  "paused": false,
  "ended": BOOLEAN
}

onTimeUpdate

The onTimeUpdate handler is invoked when the playback position of the current video changes. The handler is invoked on a "best effort" basis; there is no guaranteed frequency of invocation.

The event generated has the form:

{
  "event": {
    "source": {
      "type": "Video",
      "handler": "TimeUpdate",
      "id": "ID of the video component",
      "uid": "Runtime-generated unique ID of the component",
      "value": "Equal to the currentTime field below"
    },
    "trackIndex": Integer,
    "trackCount": Integer,
    "currentTime": Integer,
    "duration": Integer,
    "paused": BOOLEAN,
    "seekable": BOOLEAN,
    "ended": BOOLEAN
  }
}

The onTimeUpdate handler always runs in fast mode.

onTrackUpdate

The onTrackHandler handler is invoked when the active video track changes. This can happen during normal video sequence playback as the player advances to the next video track or as a result of a command issued against the player.

The event generated has this form:

"event": {
  "source": {
    "type": "Video",
    "handler": "TrackUpdate",
    "id": ID,              // ID of the video component
    "uid": UID,            // Runtime-generated unique ID of the component
    "value": trackIndex    // Equal to the trackIndex field below
  },
  "trackIndex": Integer,
  "trackCount": Integer,
  "currentTime": Integer,
  "duration": Integer,
  "paused": BOOLEAN,
  "ended": BOOLEAN
}

Last updated: Jun 18, 2024