アプリのKPIの測定

import { useReportFullyDrawn } from '@amazon-devices/kepler-performance-api';
import React, { useCallback, useEffect, useState } from 'react';
import { useKeplerAppStateManager } from '@amazon-devices/react-native-kepler';
...
...
export const App = () => {
  const reportFullyDrawnCallback = useReportFullyDrawn();
  const KeplerAppStateManager = useKeplerAppStateManager();
  const [appState, setAppState] = useState(KeplerAppStateManager.getCurrentState());

  // useEffectフックを使用して、クール起動後の初回レンダリングが完了した後に
  // 描画が完了したことを報告します。

  // アプリで追加の非同期処理を実行していて、
  // その処理が完了するまで描画完了にならない場合は、
  // 処理の完了状態を依存配列に渡し、フック内で
  // 状態を確認します。
  useEffect(() => {
    reportFullyDrawnCallback();
  }, [reportFullyDrawnCallback]);

  // ウォーム起動後の最初の描画で描画完了マーカーを発行します。
  const handleAppStateChange = useCallback((stateChange: any) => {
    if (

	 appState.match(/^(inactive|background)$/) &&
	 stateChange === 'active'
	) {
	  reportFullyDrawnCallback();
	}
	if (stateChange.match(/^(inactive|background|active|unknown)$/)) {
	  setAppState(stateChange)
	}
  }, [appState, reportFullyDrawnCallback]);
	 
  useEffect(() => {
    const changeSubscription = KeplerAppStateManager.addAppStateListener(
	  'change',
	  handleAppStateChange,
    );
    return () => {
	  changeSubscription.remove();
	}
  }, [handleAppStateChange]);
  ...
  ...
  return (
    <View style={styles.container}>
      ...
      ...
    </View>
  );
};

vega exec perf doctor [--app-name]

# 単一のデバイス
vega exec perf doctor --app-name=com.amazondeveloper.keplervideoapp.main

Firmware: Stable build (<device-user> OS 1.1 (TV Mainline/1387)).
✅ Network: Connected
✅ Free disk space: 43.31 GB available.
✅ Appium: Installed (version 2.2.2)
✅ Appium driver for Vega: Installed - kepler@3.18.0 [installed (linked from /Users/.../AppiumVegaDriver)]
✅ com.amazondeveloper.keplervideoapp.main is installed.

Collecting CPU (4 cores) and Memory data...
❌ Max User CPU usage at 241.20%.Check for unwanted processes.
❌ Max System CPU usage at 222.80%.Check for unwanted processes.
✅ Average User CPU usage at 166.16%
✅ Average System CPU usage at 101.84%
✅ Min memory available at 30.80%
✅ Average memory available at 32.16%

! Device: Not ready for performance testing.Please review lines with X (error) and ! (warnings) symbols.

# 複数のデバイス
vega exec perf doctor --app-name=com.amazondeveloper.keplervideoapp.main --device-serial-number=G000XX1234567890

vega exec perf kpi-visualizer --app-name=[app-name]

--iteration [number]

--kpi [kpi name]

kpi-visualizer --help

vega exec perf kpi-visualizer --help

    NAME:

    KPI Visualizer Tool

    DESCRIPTION:

    Measures key performance metrics like app launch times, memory usage, and UI responsiveness to optimize your app's user experience.

    SYNOPSIS:

    vega exec perf kpi-visualizer [parameters]

    Use 'vega exec perf command --help' to retrieve information for a specific command.

    PARAMETERS:

    --iterations ITERATIONS
          Sets the number of times to run the test. This overrides .conf setting.
    --record-cpu-profiling
          Enables CPU profile recording during test execution.
    --sourcemap-file-path SOURCEMAP_FILE_PATH
          Specifies the path to the source map file.
    --grpc-port port
          Specifies the port number for the gRPC server.
    --certification
          Runs tests in certification mode using 30 iterations and 90th percentile aggregation.
    --expected-video-fps EXPECTED_VIDEO_FPS
          Specifies the target FPS for the app under test.
    --kpi KPI
          (Optional) Specifies the performance metric to measure.

          Supported scenarios:
          1. cool-start-latency -  Measures app launch latency from cool start. Includes both TTFF and TTFD by default.
          2. ui-fluidity - Measures smoothness of UI interactions.
          3. warm-start-latency - Measures first frame display latency when resuming an app from background to foreground.
          4. foreground-memory -  Measures app memory usage while in foreground state.
          5. background-memory -  Measures app memory usage while in background state.
          6. video-fluidity - Measures smoothness of video playback. Requires a test scenario (--test-scenario) that initiates video playback.

    --test-scenario TEST_SCENARIO
          Specifies the Python script that defines the UI test scenario. Use the generate-test-template command to create a test scenario template.

    --monitor-processes MONITOR_PROCESSES [MONITOR_PROCESSES ...]
          Specifies additional services to monitor during testing.

          Example:
          --monitor-processes webview.renderer_service

    --ignore-trace-loss
          Skips trace data loss verification during test.

    --help
          Shows this help message.

    --version, -v
          Shows current version of this perf tool.
    %

Performance Analyzer KPI Report

Firmware version: Device OS <バージョン> (VegaMainlineTvIntegration/XXXX), serial number: XXXXXXXXXXXXXXXX
Date: 01/09/2025, test: app-background, iterations requested: 3, iterations completed: 3, duration: 15 seconds

Memory Statistics
                            | n   | min    | mean    | max    | stdev  | ci (+/-)
App Resident Memory (kB)    | 104 | 131044 | 132139.0| 133136 | 865.2  | 140.8 √

--ignore-trace-loss <true/false>