Skip to main content

Client SDK Python API Reference

This page provides a comprehensive reference for the Aria Client SDK Python API, which enables control and data streaming from Aria devices.

Utility Functions​

set_log_level(level: Level) -> None​

Set the SDK log verbosity level.

Parameters:

  • level (Level): The desired log level

Example:

import aria.sdk_gen2 as sdk_gen2
from aria.sdk import Level

sdk_gen2.set_log_level(Level.INFO)

Core Classes​

DeviceClient​

The DeviceClient class manages connections to Aria devices and handles device discovery.

Constructor​

DeviceClient()

Creates a new DeviceClient instance.

Methods​

authenticate(target: DeviceTarget = DeviceTarget()) -> str​

Authenticate with the device using credentials.

Parameters:

  • target (DeviceTarget, optional): Target device to authenticate with. Defaults to an empty DeviceTarget (auto-detect).

Returns: Certificate hash pushed to the device (str)

Raises: RuntimeError if authentication fails

connect(target: DeviceTarget = DeviceTarget()) -> Device​

Establish a connection to an Aria device.

Parameters:

  • target (DeviceTarget, optional): Target device to connect to. Defaults to an empty DeviceTarget (auto-detect).

Returns: Device object representing the connected device

Raises: RuntimeError if connection fails

is_connected(device: Device) -> bool​

Check if a device is currently connected.

Parameters:

  • device (Device): The device to check connection status for

Returns: bool - True if connected, False otherwise

usb_network_devices() -> List[DeviceTarget]​

Get a list of devices available via USB network connection.

Returns: List of DeviceTarget objects

Raises: RuntimeError if unable to query devices

usb_devices() -> List[Any]​

Get a list of USB devices.

Returns: List of USB device objects

active_connections() -> List[Device]​

Get a list of all currently active device connections.

Returns: List of Device objects

disconnect(device: Device) -> None​

Disconnect from a specific device.

Parameters:

  • device (Device): The device to disconnect from
disconnect_all() -> None​

Disconnect from all connected devices.

set_recording_manager_tls(enable_tls: bool) -> None​

Enable or disable TLS for the recording manager.

Parameters:

  • enable_tls (bool): Whether to enable TLS
set_client_config(config: DeviceClientConfig) -> None​

Configure the device client settings.

Parameters:

  • config (DeviceClientConfig): Configuration object for the client

Device​

The Device class represents a connected Aria device and provides methods to control it.

Methods​

connection_id() -> str​

Get the unique connection identifier for this device.

Returns: String connection ID

status() -> DeviceStatus​

Get current device status.

Returns: DeviceStatus object

Raises: RuntimeError if unable to retrieve device status

serial() -> str​

Get the device serial number.

Returns: String serial number

Raises: RuntimeError if unable to retrieve serial number

Streaming Methods​

start_streaming()​

Start streaming data from the device.

Returns: None

Raises: RuntimeError if unable to start streaming

stop_streaming()​

Stop streaming data from the device.

Returns: None

Raises: RuntimeError if unable to stop streaming

is_streaming() -> bool​

Check if the device is currently streaming.

Returns: bool - True if streaming, False otherwise

get_streaming_info() -> StreamingInfo​

Get information about the current streaming session.

Returns: StreamingInfo object

set_streaming_config(streaming_config: HttpStreamingConfig) -> None​

Configure streaming settings.

Parameters:

  • streaming_config (HttpStreamingConfig): Streaming configuration object
install_streaming_certs(streaming_certificates: Optional[StreamingCertsPem] = None)​

Install streaming certificates on the device. If no certificates are provided, default certificates are installed.

Parameters:

  • streaming_certificates (StreamingCertsPem, optional): Custom certificates in PEM format. Defaults to None (uses default certs).

Returns: None

Raises: RuntimeError if certificate installation fails

uninstall_streaming_certs()​

Remove streaming certificates from the device.

Returns: None

Raises: RuntimeError if certificate removal fails

Recording Methods​

set_recording_config(recording_config: RecordingConfig) -> None​

Configure recording settings.

Parameters:

  • recording_config (RecordingConfig): Recording configuration object
start_recording() -> str​

Start recording on the device.

Returns: UUID of the recording (str)

Raises: RuntimeError if unable to start recording

stop_recording()​

Stop the current recording.

Returns: None

Raises: RuntimeError if unable to stop recording

is_recording() -> bool​

Check if the device is currently recording.

Returns: bool - True if recording, False otherwise

get_recording_state() -> RecordingState​

Get the current recording state of the device.

Returns: RecordingState object with recording details

get_device_session_state() -> DeviceSessionState​

Get the combined recording and streaming session state.

Returns: DeviceSessionState object

list_recordings() -> List[RecordingInfo]​

Get a list of all recordings on the device.

Returns: List of RecordingInfo objects

Raises: RuntimeError if unable to list recordings

recording_info(uuid: str) -> RecordingInfo​

Get detailed information about a specific recording.

Parameters:

  • uuid (str): Recording UUID

Returns: RecordingInfo object

Raises: RuntimeError if recording not found or unable to retrieve info

delete_recording(uuid: str)​

Delete a specific recording from the device.

Parameters:

  • uuid (str): Recording UUID to delete

Returns: None

Raises: RuntimeError if unable to delete recording

download_recording(uuid: str, output_path: str = "")​

Download a specific recording from the device.

Parameters:

  • uuid (str): Recording UUID to download
  • output_path (str, optional): Local path to save the recording. Defaults to current directory.

Returns: None

Raises: RuntimeError if download fails

download_all_recordings(output_path: str = "")​

Download all recordings from the device.

Parameters:

  • output_path (str, optional): Local directory to save recordings. Defaults to current directory.

Returns: None

Raises: RuntimeError if download fails

delete_all_recordings()​

Delete all recordings from the device.

Returns: None

Raises: RuntimeError if unable to delete recordings

download_thumbnail(uuid: str, output_path: str = "")​

Download a thumbnail for a specific recording.

Parameters:

  • uuid (str): Recording UUID
  • output_path (str, optional): Local path to save the thumbnail. Defaults to current directory.

Returns: None

download_all_thumbnails(uuid: str, output_dir: str = "")​

Download all thumbnails for a specific recording.

Parameters:

  • uuid (str): Recording UUID
  • output_dir (str, optional): Local directory to save thumbnails. Defaults to current directory.

Returns: None

set_file_conflict_action(action: FileConflictAction) -> None​

Set the action to take when a file conflict occurs during download.

Parameters:

  • action (FileConflictAction): The conflict resolution action
device_profiles() -> Dict[str, DataFlowProfileList]​

Get the device's recording profiles.

Returns: Dictionary mapping profile category names to DataFlowProfileList objects

Text-to-Speech Methods​

render_tts(text: str)​

Render text-to-speech on the device.

Parameters:

  • text (str): Text to convert to speech

Returns: None

Raises: RuntimeError if TTS rendering fails

stop_tts()​

Stop current text-to-speech playback.

Returns: None

Raises: RuntimeError if unable to stop TTS

StreamDataInterface​

The StreamDataInterface class handles receiving and processing streaming data from the device.

Constructor​

StreamDataInterface(enable_image_decoding: bool, enable_raw_stream: bool)

Parameters:

  • enable_image_decoding (bool): Enable automatic image decoding
  • enable_raw_stream (bool): Enable raw stream data access

Methods​

record_to_vrs(vrs_path: str) -> None​

Save streaming data to a VRS file.

Parameters:

  • vrs_path (str): Path where VRS file from received streaming data will be saved
clear_callbacks() -> None​

Remove all registered callbacks.

Callback Registration Methods​

The following methods register callbacks for different data types:

register_raw_message_callback(callback: Callable)​

Register callback for raw messages before they are decoded.

Parameters:

  • callback (Callable): Function called for each raw message
register_imu_callback(callback: Callable)​

Register callback for IMU (Inertial Measurement Unit) data.

Parameters:

  • callback (Callable): Function callback(motion_data: projectaria_tools.core.sensor_data.MotionData, sensor_label: str) called for each IMU sample
register_imu_batch_callback(callback: Callable)​

Register callback for batched IMU data.

Parameters:

  • callback (Callable): Function callback(motion_data_batch: List[projectaria_tools.core.sensor_data.MotionData], sensor_label: str) called for IMU batches
register_eye_gaze_callback(callback: Callable)​

Register callback for eye gaze tracking data.

Parameters:

  • callback (Callable): Function callback(eye_gaze_data: projectaria_tools.core.mps.EyeGaze) called for eye gaze samples
register_hand_pose_callback(callback: Callable)​

Register callback for hand pose tracking data.

Parameters:

  • callback (Callable): Function callback(hand_pose_data: projectaria_tools.core.mps.hand_tracking) called for hand pose samples
register_audio_callback(callback: Callable)​

Register callback for audio data.

Parameters:

  • callback (Callable): Function callback(audio_data: projectaria_tools.core.sensor_data.AudioData, audio_record: projectaria_tools.core.sensor_data.AudioDataRecord, num_channels: int) called for audio samples
register_rgb_callback(callback: Callable)​

Register callback for RGB camera data.

Parameters:

  • callback (Callable): Function callback(image_data: projectaria_tools.core.sensor_data.ImageData, image_record: projectaria_tools.core.sensor_data.ImageDataRecord) called for RGB images
register_slam_callback(callback: Callable)​

Register callback for SLAM camera data.

Parameters:

  • callback (Callable): Function callback(image_data: projectaria_tools.core.sensor_data.ImageData, image_record: projectaria_tools.core.sensor_data.ImageDataRecord) called for SLAM images
register_et_callback(callback: Callable)​

Register callback for eye tracking camera data.

Parameters:

  • callback (Callable): Function callback(image_data: projectaria_tools.core.sensor_data.ImageData, image_record: projectaria_tools.core.sensor_data.ImageDataRecord) called for ET images
register_barometer_callback(callback: Callable)​

Register callback for barometer data.

Parameters:

  • callback (Callable): Function callback(barometer_data: projectaria_tools.core.sensor_data.BarometerData) called for barometer samples
register_magnetometer_callback(callback: Callable)​

Register callback for magnetometer data.

Parameters:

  • callback (Callable): Function callback(motion_data: projectaria_tools.core.sensor_data.MotionData, sensor_label: str) called for magnetometer samples
register_gps_callback(callback: Callable)​

Register callback for GPS/GNSS data.

Parameters:

  • callback (Callable): Function called for GPS samples
register_phone_location_callback(callback: Callable)​

Register callback for companion phone location data.

Parameters:

  • callback (Callable): Function called for phone location samples
register_ppg_callback(callback: Callable)​

Register callback for PPG (photoplethysmogram) data.

Parameters:

  • callback (Callable): Function called for PPG samples
register_bluetooth_beacon_callback(callback: Callable)​

Register callback for Bluetooth beacon data.

Parameters:

  • callback (Callable): Function called for Bluetooth beacon scans
register_wifi_beacon_callback(callback: Callable)​

Register callback for WiFi beacon data.

Parameters:

  • callback (Callable): Function called for WiFi beacon scans
register_vio_callback(callback: Callable)​

Register callback for Visual-Inertial Odometry (VIO) data.

Parameters:

  • callback (Callable): Function callback(frontend_output: projectaria_tools.core.sensor_data.FrontendOutput) called for VIO updates
register_vio_high_frequency_callback(callback: Callable)​

Register callback for high-frequency VIO data.

Parameters:

  • callback (Callable): Function callback(vio_data: projectaria_tools.core.mps.OpenLoopTrajectoryPose) called for high-frequency VIO updates
register_device_calib_callback(callback: Callable)​

Register callback for device calibration updates.

Parameters:

  • callback (Callable): Function callback(device_calibration: projectaria_tools.core.calibration.DeviceCalibration) called when calibration is received
Queue Size Configuration Methods​

The following methods configure queue sizes for different data streams:

set_rgb_queue_size(size: int) -> None​

Set the queue size for RGB image data.

Parameters:

  • size (int): Queue size
set_slam_queue_size(size: int) -> None​

Set the queue size for SLAM image data.

Parameters:

  • size (int): Queue size
set_et_queue_size(size: int) -> None​

Set the queue size for eye tracking image data.

Parameters:

  • size (int): Queue size
set_imu_queue_size(size: int) -> None​

Set the queue size for IMU data.

Parameters:

  • size (int): Queue size
set_imu_batch_queue_size(size: int) -> None​

Set the queue size for batched IMU data.

Parameters:

  • size (int): Queue size
set_vio_high_freq_queue_size(size: int) -> None​

Set the queue size for high-frequency VIO data.

Parameters:

  • size (int): Queue size
set_vio_high_freq_batch_queue_size(size: int) -> None​

Set the queue size for batched high-frequency VIO data.

Parameters:

  • size (int): Queue size
set_eye_gaze_queue_size(size: int) -> None​

Set the queue size for eye gaze data.

Parameters:

  • size (int): Queue size
set_hand_pose_queue_size(size: int) -> None​

Set the queue size for hand pose data.

Parameters:

  • size (int): Queue size
set_vio_queue_size(size: int) -> None​

Set the queue size for VIO data.

Parameters:

  • size (int): Queue size
Queue Size Getter Methods​

The following methods retrieve queue sizes for different data streams:

get_rgb_queue_size() -> int​

Get the queue size for RGB image data.

Returns: Queue size (int)

get_slam_queue_size() -> int​

Get the queue size for SLAM image data.

Returns: Queue size (int)

get_imu_queue_size() -> int​

Get the queue size for IMU data.

Returns: Queue size (int)

get_imu_batch_queue_size() -> int​

Get the queue size for batched IMU data.

Returns: Queue size (int)

get_et_queue_size() -> int​

Get the queue size for eye tracking image data.

Returns: Queue size (int)

get_vio_queue_size() -> int​

Get the queue size for VIO data.

Returns: Queue size (int)

get_vio_high_freq_queue_size() -> int​

Get the queue size for high-frequency VIO data.

Returns: Queue size (int)

get_vio_high_freq_batch_queue_size() -> int​

Get the queue size for batched high-frequency VIO data.

Returns: Queue size (int)

get_eye_gaze_queue_size() -> int​

Get the queue size for eye gaze data.

Returns: Queue size (int)

get_hand_pose_queue_size() -> int​

Get the queue size for hand pose data.

Returns: Queue size (int)

Configuration Classes​

DeviceClientConfig​

Configuration for the device client.

Attributes:

  • reconnection_attempts (int): Number of reconnection attempts
  • enable_device_monitoring (bool): Enable automatic device monitoring

DeviceTarget​

Identifies a specific device by IP address and/or serial number.

Constructor:

DeviceTarget(ip: str = "", serial: str = "")

Parameters:

  • ip (str, optional): Device IP address. Defaults to "".
  • serial (str, optional): Device serial number. Defaults to "".

Attributes:

  • ip (str): Device IP address
  • serial (str): Device serial number

Methods:

  • empty() -> bool: Returns True if both ip and serial are empty

HttpStreamingConfig​

Configuration for HTTP-based streaming.

Attributes:

  • profile_name (str): Name of the streaming profile to use
  • profile_json (str): Custom streaming profile in JSON format
  • streaming_cert_name (str): Name of the streaming certificate
  • streaming_interface (StreamingInterface): Network interface to use for streaming
  • security_options (StreamingSecurityOptions): Security settings for streaming
  • advanced_config (HttpStreamerConfig): Advanced streaming configuration
  • batch_period_ms (int): Batch period in milliseconds
  • keep_streaming_on_disconnection (bool): Continue streaming if disconnected

RecordingConfig​

Configuration for on-device recording.

Attributes:

  • profile_name (str): Name of the recording profile to use
  • custom_profile (str): Custom recording profile in JSON format
  • recording_name (str): Name for the recording
  • recording_type (RecordingType): Type of recording

StreamingCertsPem​

Streaming certificates in PEM format.

Attributes:

  • root_ca_cert (str): Root CA certificate in PEM format
  • publisher_cert (str): Publisher certificate in PEM format
  • publisher_key (str): Publisher private key in PEM format
  • key_password (str): Password for the private key
  • cert_name (str): Name for this certificate set

HttpStreamerConfig​

Advanced HTTP streamer configuration.

Attributes:

  • endpoint (Endpoint): Streaming endpoint configuration

Endpoint​

HTTP endpoint configuration.

Attributes:

  • url (str): Endpoint URL
  • verify_server_certificates (bool): Whether to verify server certificates
  • auth (SslAuthentication): SSL authentication credentials

Data Classes​

RecordingInfo​

Information about a recording on the device.

Attributes:

  • name (str): Recording name
  • size (int): Recording size in bytes
  • metadata (str): Recording metadata

RecordingState​

Current recording state of a device.

Attributes:

  • is_recording (bool): Whether the device is currently recording
  • recording_name (Optional[str]): Name of the current recording
  • start_time_ms (Optional[int]): Recording start time in milliseconds
  • profile_name (Optional[str]): Name of the recording profile in use

StreamingInfo​

Current streaming state of a device.

Attributes:

  • is_streaming (bool): Whether the device is currently streaming
  • start_time_ms (Optional[int]): Streaming start time in milliseconds
  • profile_name (Optional[str]): Name of the streaming profile in use
  • streaming_interface (Optional[str]): Network interface being used

DeviceSessionState​

Combined recording and streaming session state.

Attributes:

  • recording (RecordingState): Current recording state
  • streaming (StreamingInfo): Current streaming state

RecordingProfile​

A named recording profile available on the device.

Attributes:

  • name (str): Profile name
  • description (str): Profile description

DataFlowProfileList​

A collection of recording profiles with a hash identifier.

Attributes:

  • hash (str): Hash identifying this profile list version
  • profiles (List[RecordingProfile]): List of available recording profiles

DeviceStatus​

Comprehensive device status information.

Attributes:

  • battery_level (int): Battery level percentage
  • charger_connected (bool): Whether a charger is connected
  • charging (bool): Whether the device is actively charging
  • wifi_enabled (bool): Whether WiFi is enabled
  • wifi_configured (bool): Whether WiFi is configured
  • wifi_connected (bool): Whether WiFi is connected
  • wifi_ip_address (str): WiFi IP address
  • wifi_device_name (str): WiFi device name
  • wifi_ssid (str): Connected WiFi SSID
  • logged_in (bool): Whether a user is logged in
  • developer_mode (bool): Whether developer mode is enabled
  • thermal_mitigation_triggered (bool): Whether thermal mitigation is active
  • skin_temp_celsius (float): Device skin temperature in Celsius
  • default_recording_profile (str): Name of the default recording profile
  • is_recording_allowed (bool): Whether recording is currently allowed
  • device_mode (str): Current device mode

TimeSyncRef​

Reference for time synchronization between host and device.

Constructor​

TimeSyncRef()

Methods​

is_connected() -> bool​

Check if time synchronization is connected.

Returns: bool - True if connected

is_valid() -> bool​

Check if time synchronization data is valid.

Returns: bool - True if valid

remote_timestamp_ns_from_local(local_ns: int) -> int​

Convert a local timestamp to remote device timestamp.

Parameters:

  • local_ns (int): Local timestamp in nanoseconds

Returns: Remote timestamp in nanoseconds (int)

compute_latency_ms(capture_timestamp_ns: int) -> float​

Compute the latency between capture and reception.

Parameters:

  • capture_timestamp_ns (int): Capture timestamp in nanoseconds

Returns: Latency in milliseconds (float)

HTTP Server Classes​

AriaGen2HttpServer​

HTTP server for receiving streaming data from devices.

Constructor​

AriaGen2HttpServer(config: HttpServerConfig, handler: Any, time_sync_ref: Optional[TimeSyncRef] = None)

Parameters:

  • config (HttpServerConfig): Server configuration
  • handler (Any): Stream data handler (e.g., a StreamDataInterface instance)
  • time_sync_ref (TimeSyncRef, optional): Time synchronization reference for latency measurement. Defaults to None.

Methods​

stop() -> None​

Stop the HTTP server.

join() -> None​

Wait for the server to finish.

HttpServerConfig​

Configuration for the HTTP server.

Attributes:

  • address (str): Server bind address
  • port (int): Server port
  • use_ssl (bool): Enable SSL/TLS
  • mdns_hostname (str): mDNS hostname for discovery
  • certificate (Certificate): Server SSL certificate
  • ca_root (str): CA root certificate
  • threads (int): Number of server threads
  • idle_timeout_sec (int): Idle timeout in seconds

Certificate​

Server SSL certificate configuration.

Attributes:

  • cert (str): Certificate in PEM format
  • key (str): Private key in PEM format
  • key_password (str): Password for the private key

Enumerations​

StreamingInterface​

Available network interfaces for streaming.

Values:

  • WIFI_STA - WiFi Station mode
  • USB_RNDIS - USB RNDIS (Windows)
  • USB_NCM - USB NCM (Linux/Mac)
  • WIFI_SAP - WiFi Soft Access Point mode

RecordingType​

Types of recordings.

Values:

  • RECORDING_TYPE_REAL - Real recording
  • RECORDING_TYPE_TEST - Test recording
  • RECORDING_TYPE_PROTOTYPE - Prototype recording

FileConflictAction​

Actions to take when a file conflict occurs during download.

Values:

  • UNDEFINED - No action defined
  • KEEP_BOTH - Keep both files
  • REPLACE - Replace the existing file
  • STOP - Stop the download

Message Types​

MessageType​

The MessageType class provides constants and utility functions for working with message type identifiers.

Message Type Constants​

Message IDs are organized by category:

Camera Frames (0x8010-0x8012):

  • SLAM_CAMERA_FRAME (0x8010) - SLAM camera image data
  • ET_CAMERA_FRAME (0x8011) - Eye tracking camera image data
  • POV_CAMERA_FRAME (0x8012) - RGB/POV camera image data

Sensor Events (0x8020-0x8028):

  • IMU_EVENT (0x8020) - IMU (accelerometer/gyroscope) data
  • BARO_EVENT (0x8021) - Barometer data
  • MAG_EVENT (0x8022) - Magnetometer data
  • TEMP_EVENT (0x8023) - Temperature sensor data
  • PPG_EVENT (0x8024) - Photoplethysmogram (heart rate) data
  • GNSS_EVENT (0x8025) - GPS/GNSS location data
  • TIME_DOMAIN_MAPPING_EVENT (0x8026) - Time domain mapping data (sub-GHz radio at the wire layer)
  • ALS_EVENT (0x8027) - Ambient light sensor data
  • GNSS_VISIBLE_SATELLITES_EVENT (0x8028) - Visible GPS satellites

Machine Perception (0x8030-0x8033):

  • MP_ET_RESULT (0x8030) - Eye gaze tracking result
  • MP_HT_RESULT (0x8031) - Hand tracking result
  • MP_VIO_RESULT (0x8032) - Visual-Inertial Odometry result
  • MP_VIO_HIGH_FREQUENCY_POSE (0x8033) - High-frequency VIO pose updates

Data and Utilities (0x8000-0x800A):

  • ERROR (0x8000) - Error message
  • AUDIO_REC_DATA (0x8001) - Audio recording data
  • WIFI_BEACONS (0x8005) - WiFi beacon scan results
  • BLE_BEACONS (0x8006) - Bluetooth beacon scan results
  • PHONE_LOCATION_DATA (0x8007) - Companion phone location
  • BATTERY_STATUS_DATA (0x8008) - Device battery status
  • ASR_DATA (0x8009) - Automatic speech recognition data
  • FACTORY_CALIBRATION (0x800A) - Factory calibration data

Status Messages (0x8100-0x8105):

  • ACRO_INFO (0x8100) - ACRO system information
  • OK (0x8105) - Success/acknowledgment message

Methods​

to_string(message_id: int) -> str​

Convert a message ID to its string name.

Parameters:

  • message_id (int): Numeric message ID (e.g., 0x8010)

Returns: String name of the message type (e.g., "SLAM_CAMERA_FRAME")

Example:

import aria.sdk_gen2 as sdk_gen2

name = sdk_gen2.MessageType.to_string(0x8010)
print(name)  # "SLAM_CAMERA_FRAME"

# Using constant
name = sdk_gen2.MessageType.to_string(sdk_gen2.MessageType.IMU_EVENT)
print(name)  # "IMU_EVENT"
from_string(name: str) -> Optional[int]​

Convert a message type name to its numeric ID.

Parameters:

  • name (str): String name of the message type (e.g., "SLAM_CAMERA_FRAME")

Returns: Numeric message ID (int) if found, None otherwise

Example:

import aria.sdk_gen2 as sdk_gen2

msg_id = sdk_gen2.MessageType.from_string("SLAM_CAMERA_FRAME")
print(hex(msg_id))  # "0x8010"

# Unknown type returns None
unknown = sdk_gen2.MessageType.from_string("INVALID_TYPE")
print(unknown)  # None

SharedMessage​

Low-level message data structure.

Attributes:

  • id (int, read-only): Message ID
  • payload (IBuffer, read-only): Message payload

Methods:

  • size() -> int: Get message size in bytes
  • timestamp() -> int: Get message timestamp in nanoseconds
  • arrival_timestamp_ns() -> int: Get arrival timestamp in nanoseconds (returns -1 if not set)

Constructor:

SharedMessage(id: int, payload: list[int], timestampNs: int = 0)

Parameters:

  • id (int): Message type ID
  • payload (list[int]): Message payload data as a list of byte values (0-255)
  • timestampNs (int, optional): Timestamp in nanoseconds. Defaults to 0.

Example:

import aria.sdk_gen2 as sdk_gen2

# Create a message
msg = sdk_gen2.SharedMessage(
    id=sdk_gen2.MessageType.IMU_EVENT,
    payload=[0x00, 0x01, 0x02, 0x03],
    timestampNs=1234567890
)

print(f"Message ID: {hex(msg.id)}")
print(f"Payload size: {msg.size()}")
print(f"Timestamp: {msg.timestamp()} ns")

IBuffer​

Buffer interface for binary data.

Methods:

  • data() -> bytes: Get buffer data as bytes
  • as_memoryview() -> Optional[memoryview]: Get buffer as Python memoryview (returns None if buffer is empty or null)

Example:

# Access payload data
if message.payload is not None:
    # Get as memoryview for zero-copy access
    mem_view = message.payload.as_memoryview()
    if mem_view is not None:
        print(f"Payload size: {len(mem_view)} bytes")

Data Converter​

OssDataConverter​

The OssDataConverter class converts raw FlatBuffer messages to typed Python data structures. This is essential for processing sensor data from SharedMessage payloads.

Constructor​

OssDataConverter(enable_image_decoding: bool = True, decoder_class = None)

Parameters:

  • enable_image_decoding (bool, optional): Enable automatic image decoding. Defaults to True.
  • decoder_class (optional): Custom decoder class (not currently supported). Defaults to None.

Example:

import aria.oss_data_converter as data_converter

# Create converter with image decoding enabled
converter = data_converter.OssDataConverter(enable_image_decoding=True)

Configuration Methods​

set_calibration(calibration_json: str) -> None​

Set device calibration from JSON string. Required for converting VIO, eye gaze, and hand tracking data.

Parameters:

  • calibration_json (str): Device calibration in JSON format

Example:

# Set calibration (required for VIO/eye gaze/hand tracking)
converter.set_calibration(calibration_json_string)
set_python_image_decoding(enable: bool) -> None​

Enable or disable Python-based image decoding.

Parameters:

  • enable (bool): True to enable Python decoding, False otherwise
get_python_image_decoding() -> bool​

Get current Python image decoding status.

Returns: bool - True if Python decoding is enabled

Image Conversion Methods​

to_image_data_and_record(shared_message: SharedMessage) -> Tuple[ImageData, ImageDataRecord]​

Convert camera frame message to image data and metadata.

Parameters:

  • shared_message (SharedMessage): Message with image payload

Returns: Tuple of (ImageData, ImageDataRecord) or (None, None) if conversion fails

Supported Message Types:

  • SLAM_CAMERA_FRAME - SLAM camera images
  • ET_CAMERA_FRAME - Eye tracking camera images
  • POV_CAMERA_FRAME - RGB camera images

Example:

if message.id == sdk_gen2.MessageType.SLAM_CAMERA_FRAME:
    image_data, image_record = converter.to_image_data_and_record(message)
    if image_data is not None:
        print(f"Image size: {image_data.get_width()}x{image_data.get_height()}")
        print(f"Timestamp: {image_record.capture_timestamp_ns} ns")
        print(f"Camera ID: {image_record.camera_id}")

Sensor Conversion Methods​

to_imu(shared_message: SharedMessage) -> List[MotionData]​

Convert IMU event message to motion data list.

Parameters:

  • shared_message (SharedMessage): Message with IMU payload

Returns: List of MotionData objects or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.IMU_EVENT:
    imu_data_list = converter.to_imu(message)
    if imu_data_list:
        for imu_data in imu_data_list:
            print(f"Accel: {imu_data.accel_msec2} m/s²")
            print(f"Gyro: {imu_data.gyro_radsec} rad/s")
to_magnetometer(shared_message: SharedMessage) -> List[MotionData]​

Convert magnetometer event message to motion data list.

Parameters:

  • shared_message (SharedMessage): Message with magnetometer payload

Returns: List of MotionData objects or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.MAG_EVENT:
    mag_data_list = converter.to_magnetometer(message)
    if mag_data_list:
        mag_data = mag_data_list[0]
        print(f"Magnetic field: {mag_data.mag_tesla} T")
to_barometer(shared_message: SharedMessage) -> BarometerData​

Convert barometer event message to barometer data.

Parameters:

  • shared_message (SharedMessage): Message with barometer payload

Returns: BarometerData object or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.BARO_EVENT:
    baro_data = converter.to_barometer(message)
    if baro_data:
        print(f"Pressure: {baro_data.pressure} Pa")
        print(f"Temperature: {baro_data.temperature} °C")
to_audio(shared_message: SharedMessage) -> Tuple[AudioData, AudioDataRecord]​

Convert audio message to audio data and record.

Parameters:

  • shared_message (SharedMessage): Message with audio payload

Returns: Tuple of (AudioData, AudioDataRecord) or (None, None) if conversion fails

Example:

if message.id == sdk_gen2.MessageType.AUDIO_REC_DATA:
    audio_data, audio_record = converter.to_audio(message)
    if audio_data:
        print(f"Audio samples: {len(audio_data.data)}")
        print(f"Sample rate: {audio_record.sample_rate} Hz")

Location Conversion Methods​

to_gnss(shared_message: SharedMessage) -> GpsData​

Convert GNSS event message to GPS data.

Parameters:

  • shared_message (SharedMessage): Message with GNSS payload

Returns: GpsData object or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.GNSS_EVENT:
    gnss_data = converter.to_gnss(message)
    if gnss_data:
        print(f"Location: {gnss_data.latitude}°, {gnss_data.longitude}°")
        print(f"Altitude: {gnss_data.altitude} m")
        print(f"Accuracy: {gnss_data.accuracy} m")
to_phone_location(shared_message: SharedMessage) -> GpsData​

Convert phone location message to GPS data.

Parameters:

  • shared_message (SharedMessage): Message with phone location payload

Returns: GpsData object or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.PHONE_LOCATION_DATA:
    phone_loc = converter.to_phone_location(message)
    if phone_loc:
        print(f"Phone location: {phone_loc.latitude}°, {phone_loc.longitude}°")

Machine Perception Conversion Methods​

to_eye_gaze(shared_message: SharedMessage) -> EyeGaze​

Convert eye gaze result message to eye gaze data. Requires calibration to be set.

Parameters:

  • shared_message (SharedMessage): Message with eye gaze payload

Returns: EyeGaze object or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.MP_ET_RESULT:
    eye_gaze = converter.to_eye_gaze(message)
    if eye_gaze:
        print(f"Gaze: yaw={eye_gaze.yaw} rad, pitch={eye_gaze.pitch} rad")
        print(f"Depth: {eye_gaze.depth} m")
to_hand_pose(shared_message: SharedMessage) -> HandTrackingResult​

Convert hand tracking result message to hand pose data. Requires calibration to be set.

Parameters:

  • shared_message (SharedMessage): Message with hand tracking payload

Returns: HandTrackingResult object or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.MP_HT_RESULT:
    hand_pose = converter.to_hand_pose(message)
    if hand_pose:
        if hand_pose.left_hand:
            print("Left hand detected")
        if hand_pose.right_hand:
            print("Right hand detected")
to_vio_result(shared_message: SharedMessage) -> FrontendOutput​

Convert VIO result message to VIO data. Requires calibration to be set.

Parameters:

  • shared_message (SharedMessage): Message with VIO payload

Returns: FrontendOutput object or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.MP_VIO_RESULT:
    vio_data = converter.to_vio_result(message)
    if vio_data:
        pose = vio_data.transform_odometry_bodyimu
        print(f"Position: {pose.translation()}")
        print(f"Rotation: {pose.rotation().log()}")
to_vio_high_freq_pose(shared_message: SharedMessage) -> List[OpenLoopTrajectoryPose]​

Convert high-frequency VIO pose message to pose list. Requires calibration to be set.

Parameters:

  • shared_message (SharedMessage): Message with high-frequency VIO payload

Returns: List of OpenLoopTrajectoryPose objects or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.MP_VIO_HIGH_FREQUENCY_POSE:
    vio_poses = converter.to_vio_high_freq_pose(message)
    if vio_poses:
        for pose in vio_poses:
            translation = pose.transform_odometry_device.translation()
            print(f"Position: {translation}")

Wireless Beacon Conversion Methods​

to_bluetooth_beacon(shared_message: SharedMessage) -> List[BluetoothBeaconData]​

Convert Bluetooth beacon message to beacon data list.

Parameters:

  • shared_message (SharedMessage): Message with Bluetooth beacon payload

Returns: List of BluetoothBeaconData objects or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.BLE_BEACONS:
    ble_beacons = converter.to_bluetooth_beacon(message)
    if ble_beacons:
        for beacon in ble_beacons:
            print(f"ID: {beacon.unique_id}, RSSI: {beacon.rssi} dBm")
to_wifi_beacon(shared_message: SharedMessage) -> List[WifiBeaconData]​

Convert WiFi beacon message to beacon data list.

Parameters:

  • shared_message (SharedMessage): Message with WiFi beacon payload

Returns: List of WifiBeaconData objects or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.WIFI_BEACONS:
    wifi_beacons = converter.to_wifi_beacon(message)
    if wifi_beacons:
        for beacon in wifi_beacons:
            print(f"SSID: {beacon.ssid}, RSSI: {beacon.rssi} dBm")

Other Sensor Conversion Methods​

to_ppg(shared_message: SharedMessage) -> PpgData​

Convert PPG (photoplethysmogram) event message to PPG data.

Parameters:

  • shared_message (SharedMessage): Message with PPG payload

Returns: PpgData object or None if conversion fails

Example:

if message.id == sdk_gen2.MessageType.PPG_EVENT:
    ppg_data = converter.to_ppg(message)
    if ppg_data:
        print(f"PPG value: {ppg_data.value}")