Project Aria Research Kit Release Notes
These SW Release notes are for the Aria Research Kit (ARK), and are for Meta SW that supports Academic Research Partners using Project Aria glasses. To find out how to become a research partner, go to projectaria.com.
Our Open Source Project Aria Tools SW Release notes are posted to Project Aria Tools GitHub repository, using Tags > Releases.
Announcing Aria Research Kit v1.14 with 21 Landmark Hand Tracking in MPS
We are pleased to announce the release of Aria Research Kit v1.14 which now makes fully articulated 21 landmark hand joint positions available with Machine Perception Services Hand Tracking output as a new CSV file called hand_tracking_results.csv. Researchers can utilize this long-awaited feature to produce detailed 3D hand pose annotations useful for robotics research, contextual AI, and anywhere else that hand signals may be important.
In addition to 21 landmarks output, we output a six-degree-of-freedom transform at the wrist location to allow for transformation of the landmarks from the hand frame to the device frame, and normal vectors computed at both the wrist and palm landmarks. The transform and normals form a consistent system and the normals also match the normals we’ve computed on previous versions of wrist and palm output.
We encourage hand tracking users to transition to this new output format, where we will be investing in any future maintenance and bug fixing. We will also continue to provide wrist_and_palm_poses output, which can be loaded with prior versions of projectaria_tools, but will not invest in bug fixes or feature additions for this legacy format.
-
Here's a Notebook and Sample Code (Python & C++) demonstrating how to load and use the landmarks.
-
See Documentation on data format definitions.
Reminder for Aria Desktop App Deprecation: As mentioned in previous release notes, the Aria Desktop App will be fully deprecated on May 30th, 2025, at which point requests to MPS will not be possible and documentation for the tool will be removed. Please migrate over to Aria Studio if you haven’t already.
Update your Software to Access These Improvements
Aria Companion App
Aria Mobile Companion App App v215 is now available for installation. Visit to the ARK SW Downloads and Updates to download the latest version for Android. For iOS, select Update in the TestFlight app.
Project Aria Tools
The latest projectaria-tools 1.6.0 contains tooling necessary to load and visualize 21 landmark hand tracking output. See documentation for download instructions.
Aria Studio v1.1.0
The latest version of Aria Studi, v1.1.0 is required to submit requests to the MPS service for hand tracking annotations with 21 landmark output. See documentation for instructions on how to install Aria Studio. Note that starting with this version, we no longer support Mac Intel with a one-click installer and Mac Intel users must use pip for Aria Studio installation.
Questions, comments, concerns?
If you encounter any bugs or issues, please contact our support team through one of the following channels:
- Post in the Project Aria Discord
- Post to Workplace
- Email us directly at AriaOps@meta.com
Announcement: Aria Research Kit v1.13 is now available
We are excited to announce Aria Research Kit v1.13, featuring color correction and devignetting on videos recorded with the Aria RGB camera and a new ability for Aria to operate as a Wi-Fi hotspot for streaming, eliminating dependency on external networks. Download the latest versions of the Aria Mobile Companion App, the Aria Client SDK, and Project Aria Tools to access these improvements today.
Color correction and devignetting for the Aria RGB camera
You may have noticed blueish color distortion in Aria RGB recordings. We’ve now fixed these with consistent gamma curves and standard color temperatures in ARK v1.13. With this update, Aria devices now produce images with more consistent colors, calibrated to a standard color temperature of 5000K. Additionally, a new devignetting API is available in Project Aria Tools to further enhance image quality and accuracy.
Wi-Fi hotspot streaming
A new Wi-Fi hotspot streaming feature allows users to set up a dedicated hotspot using the Aria device, enabling direct and stable streaming without relying on external network infrastructure. Users can enable this feature through the Aria Client SDK or directly within the Aria Companion App.
Update your software to access these improvements
Aria Companion App
Aria Mobile Companion App App v210 is now available for download. Visit ARK SW Downloads and Updates to download the latest version for Android. For iOS, select Update in the TestFlight app.
Project Aria latest OS
Project Aria OS build 4975080.310.70 (released April 1, 2025) contains the changes necessary for RGB color correction and devignetting. Update to this build or newer using the Aria Companion App.
Aria Client SDK
The Aria Client SDK now supports streaming in hotspot mode, diagnostic logging collections for users, support for Python 3.12, RGB color correction, and more. See the ARK download documentation for download instructions.
Project Aria Tools
The latest projectaria-tools 1.5.8 contains the tooling necessary to support RGB camera color correction and devignetting. See the data utilities overview for download instructions.
Questions, comments, concerns?
If you encounter any bugs or issues, please contact our support team through one of the following channels:
- Post in the Project Aria Discord
- Post to Workplace
- Email us directly at AriaOps@meta.com
Aria Research Kit v1.12
We are excited to announce updates to the Aria Research Kit with v1.12. Download the latest versions and access new features for Aria Studio, Project Aria Tools, and the Companion App.
Mobile Companion App
Aria Mobile Companion App v200 is now available for download. Visit ARK SW Downloads and Updates to download the latest version for Android. For iOS, select Update in the TestFlight app.
Bug fixes
Version 200 includes minor bug fixes and refinements to the existing functionality and user experience.
Latest Project Aria OS
Version 200 maintains the latest Project Aria OS build: 4971771.1550.70 from October 3, 2024.
Aria Studio
Aria Studio v1.0.3 includes minor bug fixes and refinements. It is now available via one-click installation and pip-install from PyPi in Mac ARM, Mac Intel, Windows, and Linux.
Project Aria Tools
We are excited to announce Project Aria Tools v1.5.7! Download or update your installation of Project Aria Tools to get access to the latest updates.
See our GitHub release notes to review all Project Aria Tools updates.
New Advanced Image Utility: Image devignetting
Devignetting is a digital image processing technique used to correct uneven lighting in images, particularly those captured by cameras with wide-angle lenses or those that have inherent optical vignetting. Vignetting refers to the gradual decrease in brightness toward the edges of an image, often resulting in a darker periphery and a brighter center.
We now provide official guidance on how to apply devignetting with Python and C++. See the notebook and documentation for more information.
Questions, comments, concerns?
If you encounter any bugs or issues, please contact our support team through one of the following channels:
- Post in the Project Aria Discord
- Post to Workplace
- Email us directly at AriaOps@meta.com
Aria Companion App v195 now Available!
December 13, 2024
Aria Mobile App v195 is now available for download. For Android, visit the ARK SW Downloads and Updates page and download the latest version. For iOS, select Update in the TestFlight app. Please update the app to access the following features and bug fixes:
New & Updated Features
-
A new updates tab dedicated to feature announcements and program updates is now available in-app
-
Our eye tracking calibration feature is now fully compatible with iPhone 16
Bug Fixes
Some bug fixes to improve the overall usage.
Project Aria Latest OS
The latest Project Aria OS build 4971771.1550.70 (October 3, 2024).
Aria Studio - Please Update to v1.0.2 for Bug Fixes
After our v1.0.0/1.0.1 release of Aria Studio on Monday Dec 9th, we identified a bug for users who downloaded Aria Studio with the Windows 1-click installer that caused MPS jobs to fail.
The team worked quickly to resolve the bug, and the fix is now available as part of a new release: Aria Studio 1.0.2. Please update to the latest version (1.0.2) at your earliest convenience.
Questions, Comments, or Feedback?
If you encounter any problems with Project Aria software, please contact our support team through one of the following channels:
-
Post to Project Aria Tools issues on GitHub - preferred
-
Post to Academic Partners Feedback and Support workplace group - discussion, feedback or user support
-
Post to Project Aria Discord - best for discussion, feedback or user support
-
Email us directly at AriaOps@meta.com
Announcing Aria Research Kit v1.11!
December 9, 2024
Aria Studio v1.0.1: Now on Windows, plus some other nice features
Aria Studio is a modern desktop application with a browser-based UI that helps you manage recordings from your Aria glasses, access Machine Perception Services, and visualize egocentric data. We released a beta version of Aria Studio at CVPR this year with support for Mac and Linux. Today, we are releasing Aria Studio v1.0.1, which extends our OS support to include Windows. Aria Studio is now available as a downloadable 1-click installer package in addition to the previously available pip install method. Another new feature includes the ability to submit feedback to the Aria team directly in the application and a section where the Aria team will publish news program updates and important information in the home tab.
Updates for the MPS CLI and the Mobile Companion App
This release also brings the Aria Machine Perception Services Command Line Interface (MPS CLI) to Windows. Download or update your installation of Project Aria Tools on your Windows machine to use the MPS CLI to submit your recordings to Aria Machine Perception Services. Coming soon, we will release v195 of the Aria Companion App on mobile, featuring a new section on the home tab where you can stay up-to-date with the latest news and updates from the Aria team.
Deprecation Plan for Aria Desktop App
For those still using the Aria Desktop App: Today, we are announcing a deprecation plan for the Aria Desktop App. We are no longer onboarding new users to the Desktop App and will shut off the ability to request MPS from the Desktop App on May 30th, 2025. Now with support for Windows, Aria Studio fully replaces the functionality of the Desktop App. Please switch over to Aria Studio as soon as possible and reach out to ariaops@meta.com if you have any questions about the transition.
Feedback and Support
If you encounter any problems using ARK v1.11, please contact us. There are several ways for getting user support.
-
Post to Academic Partners Feedback and Support workplace group
-
Post to Project Aria Discord
-
Email AriaOps@meta.com
You can always request a meeting through our ops team if you need more in-depth discussions requiring higher bandwidth.
Aria Mobile App v185 is now available
October 25, 2024
Dear Academic Partners,
The Aria Mobile App v185 is now available. Go to the Downloads page to get the latest version for Android. For iOS, select Update in the TestFlight app. Please Update the app to access the following features and bug fixes.
BUG FIXES
Various bug fixes to improve the overall usage.
PROJECT ARIA LATEST OS
The latest Project Aria OS build 4970205.890.70 (June 28, 2024).
QUESTIONS, CONCERNS, FEEDBACK?
If you encounter any problems using Project Aria support, please contact us. There are several ways for getting user support.
We encourage you to post issues to GitHub, so that they can be tracked.
If you are a Research Partner with access to the Aria Research Kit there are several other support options available, although GitHub is ideal for bug reports and feature requests.
- Post to Academic Partners Feedback and Support workplace group - discussion, feedback or user support
- Post to Project Aria Discord - best for discussion, feedback or user support
- Email AriaOps@meta.com - for feedback or user support
Announcing Aria Research Kit v1.10
October 9, 2024
We're announcing the release of Aria Research Kit v1.10. This release adds versioning to all of the Machine Perception Services and includes a major update to make the SLAM service more accurate for downstream tasks that utilize 3D results projected into the RGB camera frame. We are also making it much easier for you to visualize, edit, and prepare your Aria recordings for downstream use such as dataset preparation and model training with PyTorch.
MPS Versioning
Starting now, we are introducing the concept of versioning to machine perception services. When we make changes to our SLAM, hand tracking, or eye tracking services, you will have information about which version of the service was utilized for your result computation. This will be available directly at the very end of the summary.json file. Versions will have a major, minor, and bugfix number (e.g. SLAM v1.1.0). We will keep our MPS Service Versions page updated as we roll out new versions so that you are aware of the changes we make.
RGB Online Calibration
Aria excels at enabling computer vision from a 3D perspective. Our SLAM Machine Perception Service provides Aria trajectory and a semi-dense point cloud output that allow computations in a 3D reference frame. Tasks like object detection can be performed in 3D and then be re-projected back into the 2D RGB images. Available as of v1.1.0, we’ve implemented extremely accurate RGB online calibration for all of your downstream tasks that utilize 3D results reprojected into the RGB camera frame. Read the MPS Output Calibration page for more details on how to make use of online calibration.
New Tools for Working with VRS
We know that it takes manual work to prepare Aria recordings for downstream use, so we’ve released some new tools to make things easier. We now provide a lightweight VRS Player App that allows you to easily play the visual and audio sensor streams of a recording from a file menu or by using a simple command. We’ve also released a VRS Command Line Tool that enables easy inspection and editing of VRS files. For example, you can time crop a recording to eliminate an unwanted segment or remove sensor streams that you no longer need in your final dataset after processing through Machine Perception Services. Install both the lightweight VRS Player and the VRS Command Line Tool with the VRS Tools Installer.
Aria Training and Evaluation Toolkit
Preparing Aria recordings for training in PyTorch just got easier with Aria Training and Evaluation Kit (ATEK). ATEK offers an efficient solution to convert VRS files to PyTorch compatible formats, simplifying integration and use within deep learning projects. We’ve also pre-processed two popular Aria datasets with ATEK for direct usage in a data store. And lastly, we’ve created standardized evaluation libraries for 3D object detection and surface reconstruction. Read an in-depth blog post on ATEK for more information and see the ATEK GitHub page to install ATEK today.
Project Aria Now on Huggingface
Finally, we introduce the Project Aria Huggingface Space, which allows researchers to track their model performance, helping measure, compare, and accelerate AI and ML research within the open community. AI models and datasets, released in the Project Aria Hugging Face space, will be supported by ATEK. Where possible, AI models trained using Project Aria data will also be available with full weights and scripts, making it easy for researchers to discover and benchmark existing models against their own methods.
Aria Studio Updates
We've also made some updates to Aria Studio. We now display a version number and have a mechanism for surfacing updates and other key information that we want to communicate to our users. Today, Aria Studio is installed via pip install, and in doing so you'll automatically get these new features. If you haven't yet tried it, please install Aria Studio today.
Any Questions?
If you have any questions regarding this new functionality in Aria Research Kit v1.10 or any issues accessing any of the features, please reach out to our support team at AriaOps@meta.com.
Aria Mobile App v180 is now available
September 17, 2024
Dear Academic Partners,
The Aria Mobile App v180 for Android is now available. Go to the Downloads page to get the latest version for Android. For iOS, select Update in the TestFlight app. Please update the app.
BUG FIXES
Various bug fixes to improve the overall usage.
PROJECT ARIA LATEST OS
The latest Project Aria OS build 4970205.890.70 (June 28, 2024).
QUESTIONS, CONCERNS, FEEDBACK?
Contact Aria User Support by posting here in Academic Partners Feedback and Support workplace group or emailing AriaOps@meta.com.
Additional resources are available at Project Aria Github.
Announcing Aria Research Kit v1.9
We're announcing a new release of Aria Research Kit v1.9, now including Live Preview in the Aria Companion App and updates to our Wrist and Palm tracking MPS output. Read below for more details!
Use our new feature, Live Preview, to visualize the RGB camera, SLAM camera, and eye tracking camera sensor streams directly in the Aria Companion App on your mobile device. Live Preview gives you a tighter feedback loop to ensure that you are recording the right data for your research activities.
With Live Preview, your glasses operate as a Wi-Fi hotspot, streaming the sensor data directly without the need for an external router.
How to Use Live Preview
- Update your Companion App to v175 (software download page)
- Update your glasses to the latest OS version using OTA updates.
- In the Dashboard tab, look for and tap the Live Preview button.
Wrist and Palm Tracking Updates in MPS
We’ve made some exciting updates to our wrist and palm tracking capabilities in our machine perception services (MPS). Starting now, all jobs launched will utilize these new features.
What’s New?
- We’ve tuned our hand tracking algorithm to improve recall for common computer vision research use cases.
- We are including normal vectors to the wrist and palm landmark output so that you can better understand the orientation of hands in your sequences (see documentation and a notebook to visualize sample data)
- We provide a demonstration of how to project popular third-party hand tracking models onto our wrist and palm landmark output for tasks that require higher-fidelity hand tracking output (see Jupyter notebook).
What Do I Need to Update to Access It?
- Follow instructions in our Wiki to re-install Aria Studio. This will update all necessary dependencies for you.
- If you’re only using our CLI directly instead of Aria Studio, you can just update to Projectaria_tools 1.5.6 using
pip install projectaria_tools --upgrade
. This will be handled automatically if you update or re-install Aria Studio.
Any Questions?
If you have any issues accessing or using Live Preview or our new hand tracking functionality, please reach out to our support team at AriaOps@meta.com.
Mobile Companion App v170 and Time Synchronized Recordings Between Multiple Project Aria Devices now available
Dear Academic Partners,
Mobile Companion app V170 and Aria OS 4970205.890.70 are now available. With the release of Aria OS 4970205.890.70, you can now create time synchronized recordings between multiple devices via the Client SDK.
- Recent documentation improvements include:
- Renamed The Project Aria Tools documentation site has been renamed to reflect its broader scope, it’s now called Project Aria Docs. The Data Utilities section has been renamed to Project Aria Tools.
- Updated Intro page and About ARK
- New Project Aria FAQ
Aria Client SDK (TICSync support and general improvements)
Users can now use the Aria Client SDK to capture time-synchronized data between multiple Project Aria glasses (and potentially other devices) on the one Wi-Fi network via TICSync. Using the Aria hotspot feature, one pair of glasses (server) acts as a Wi-Fi access point that forms a network between all glasses. Time requests from all other glasses go to the server/leader device, creating a synchronized time reference.
- How to Create Time Synchronized Recordings with Multiple Aria Glasses
- TICSync Code Snippet
- TICSync Technical Details
To use TICSync you’ll need to:
- Update to the Aria glasses OS 4970205.750.70, June 28 release
- Project Aria glasses OS should automatically update when plugged into power and connected to Wi-Fi. Go to How to Update Your Aria Glasses’ OS if you want to manually update your glasses.
- Update to Aria Client SDK V1.1
In addition:
- The Aria Client SDK is now supported on Python 3.12
- Wi-Fi connections to Aria glasses have been made more reliable by enabling sticky connection
Known Issues
- The Client SDK is a software developer kit. While we have created code samples to enable a range of features, we have not created fully fledged applications. We encourage people to make this code their own, and to use the code samples as a starting point.
Bug Fixes
- Information in error messages has been improved
- Reliability of multiple Project Aria devices connected over USB has been improved
Mobile Companion app
The Aria Mobile App v170 is now available. Follow the in-app prompt or go to the Downloads page to get the latest version for Android. For iOS, select Update in the TestFlight app. Please update the app to access the latest bug fixes and finalized retheming of all app pages.
PROJECT ARIA LATEST OS
The latest Project Aria OS build 4970205.890.70 (June 28, 2024).
Project Aria glasses OS should automatically update when plugged into power and connected to Wi-Fi. Go to How to Update Your Aria Glasses’ OS if you want to manually update your glasses.
QUESTIONS, CONCERNS, FEEDBACK?
If you encounter any problems using Project Aria support, please contact us. There are several ways for getting user support.
We encourage you to post issues to GitHub, so that they can be tracked.
If you are a Research Partner with access to the Aria Research Kit there are several other support options available, although GitHub is ideal for bug reports and feature requests.
- Post to Academic Partners Feedback and Support workplace group - discussion, feedback or user support
- Post to Project Aria Discord - best for discussion, feedback or user support
- Email AriaOps@meta.com - for feedback or user support
Announcing Aria Research Kit v1.8 - Aria Studio (in beta today), TICSync (coming soon), improved vrs2mp4 conversion (available today)
Dear Academic Partners: We’re excited to introduce Aria Research Kit V1.8, featuring Aria Studio (in beta today) and TICSync (coming soon). Aria Studio is a brand new browser-based application for managing your devices, recordings, and MPS jobs available today for Mac and Linux via pip install. TICSync will enable multiple Aria devices to be easily time synchronized and will be made available via pip install towards the end of June along with the next device OS update. We've also released improvements in the VRS_to_MP4 converter in Project Aria Tools to solve for audio and video synchronization issues.
Aria Studio (BETA)
- Aria Studio is a new browser-based application we are releasing in beta for managing devices, recordings, and machine perception services jobs, designed for cross-platform support, easy update installation, stability, and a smooth user flow for MPS job submission.
- Aria Studio offers an easy way to visualize both your recordings transferred to your machine and processed MPS results.
- Aria Studio is based on the existing MPS CLI tool and everything possible in the MPS CLI tool will also be possible via Aria Studio.
- Aria Studio is currently available on certain distributions of x64 Linux and Mac.
- Go to the Aria Studio documentation page for installation details.
Aria TICSync Support
- Aria TICSync allows you to run millisecond-scale-accurate time-synchronized recordings for multi-view computer vision applications.
- You can start time-synchronized recordings for multiple Aria devices via simple CLI commands with devices connected to a host machine
- You can disconnect the Aria devices from the host machine and enable WiFi-based synchronization with one Aria device operating as a hotspot.
- Aria TICSync functionality will be included with Aria SDK v1.1.0 available towards the end of June. Keep an eye out for another post when the installer is ready.
- A Jupyter Notebook is available today with example code for how to work with and visualize time synchronized recordings for your learning and experimentation.
- Go to the TICSync documentation page for details.
Project Aria Tools VRS to MP4 improvements
- We've improved timing accuracy during export for audio and video syncing.
- We updated the translator to include frame timestamps in the metadata.
- Go to Project Aria Tools 1.5.2 release notes for details.
Feedback and Support
If you encounter any problems using ARK v1.8, please contact us. There are several ways for getting user support.
- Post to Academic Partners Feedback and Support workplace group
- Post to Project Aria Discord
- Email AriaOps@meta.com
- You can always request a meeting through our ops team if you need more in-depth discussions requiring higher bandwidth.
Aria Mobile App v165 is now available
Dear Academic Partners,
The Aria Mobile App v165 is now available. Go to the Downloads page to get the latest version for Android. For iOS, select Update in the TestFlight app. Please update the app to access the following features and bug fixes.
Project Aria recently released Project Aria Eye Tracking, an open source inference code for the Pre March 2024 Eye Gaze Model used by MPS. This model:
- Provides the ability to generate eye gaze data using the old model, if that is more suited to your research use case or if you’re not able to request MPS
- This code can be used on downloaded data or when streaming data using the Aria Client SDK
BUG FIXES
Various bug fixes to improve the overall usage.
PROJECT ARIA LATEST OS
The latest Project Aria OS build 4968951.840.70 (April 25th, 2024).
QUESTIONS, CONCERNS, FEEDBACK?
Go to our Support page for ways to get in touch.
Announcing: New Custom Recording Profile Capabilities
We’re pleased to announce that Aria Mobile Companion app v160 contains the ability to configure individual sensors when creating custom recordings using the Mobile Companion app.
How to access the update
You’ll be prompted to update the app when you open it, and you can also manually download it.
You’ll need Aria OS version 4968999.0.70 (April 25th, 2024) or later to be able to set custom recording profiles.
Custom Recording Profile
To keep the new Custom Recording Profile feature approachable, and to reduce our testing matrix, we are launching this feature with a limited set of parameters. If people find the feature useful, we are open to unblocking research needs by providing the ability to include additional parameters. Please use one of our support channels to make feature requests.
To start a recording with a custom recording profile:
- In the Aria app Dashboard, select New Recording Session
- Select Recording Profile
- The first recording profile in the list will be Custom Profile
- You may need to scroll up to see this option
- Select the Custom Profile
- Select Edit parameters
- Adjust sensor settings
- Certain combinations, such as RGB Cameras at 2880 x 2880 at 15 or more fps will trigger warnings as they cause elevated thermal loads and reduced battery life
- Tap More info on the Recording Profiles Tab to see more details, such as auto exposure
Bug Fixes
- An issue where the More info link on the top right of the Recording Profiles page was difficult to see has been resolved.
Known issues
- Custom Recordings is a new feature! If you encounter data quality issues, please help us track down the issue by emailing the repro steps (including sensor configuration) to AriaOps@meta.com.
QUESTIONS, CONCERNS, FEEDBACK?
Go to our Support page for ways to get in touch.
Announcing New MPS, Recording Profiles, and Updates to the Companion Apps
March 21 2024
Dear Academic Partners,
This release includes new Machine Perception Services (MPS) capabilities, Wrist and Palm Tracking data and a revised Eye Gaze model that provides depth estimations, as well as four new recording profiles, and an Automatic Speech Recognition speech to text code sample.
How to access the new features
- MPS
- NEW SERVICE: Hand Tracking
- Request Hand Tracking via the MPS CLI or Desktop app to get Wrist and Palm Tracking data!
- UPDATED SERVICE: The new Eye Gaze model includes depth estimations
- Backwards compatibility with Project Aria Tools will be maintained for data generated using the old model
- Use the MPS CLI to do bulk requests on existing data
- Raw uploaded data will now be stored for 30 days for MPS processing and reprocessing
- NEW SERVICE: Hand Tracking
- Desktop app v38 [MacOS and Windows]
- Download the latest version of the app for the ability to request Hand Tracking MPS via Desktop app, and to get bug fixes
- Project Aria Tools v1.5
- New code sample that generates speech to text outputs from VRS files
- Install via Pip to be able to request Hand Tracking data using the MPS CLI
- Aria glasses OS 4968297.250.70
- Update to the latest OS for four new recording profiles and essential bug fixes
- Please make sure your glasses have been updated in the last two months
- Aria Mobile Companion App v155
- Download the latest version of the app to enjoy the updated look and bug fixes
- Documentation
- the latest documentation updates including:
- New MPS Troubleshooting page.
- New Collaborative Tools Page, did you know you can use Aria data with Nerfstudio? We’ve collaborated with Nerfstudio to enable Gaussian Splatting with their tools.
- Updated MPS Google Colab tutorials.
- the latest documentation updates including:
MPS Updates
Once you upload data using the MPS CLI, it will be stored for 30 days for additional processing/reprocessing, instead of 24 hours.
New Hand Tracking MPS, Wrist and Palm Tracking
For this new service, we use Aria's SLAM camera images to estimate the hand movements of the wearer. The wrist and palm poses are given in the device frame in meters. These outputs are automatically generated when doing the default MPS CLI request (or request hand_tracking mode) and are listed as Hand Tracking in the Desktop App.
Install Project Aria Tools vs 1.5 using Pip or install Desktop App v38 to be able to request this new service.
Update to Eye Gaze outputs - depth estimations
We have introduced a new model for computing eye gaze, which produces left and right eye gaze directions along with the depth at which these gaze directions intersect.
This new model’s output schema adds to general_eye_gaze.csv
and personalized_eye_gaze.csv
in a way that ensures backward compatibility with Project Aria Tools.
- Eye Gaze Data Formats page - schema has been updated
- Eye Gaze Code Snippets - new page
Known Issues
- The new Eye Gaze model does not generate
yaw_rads_cpf
outputs- This value can be computed using helper functions and is automatically read when parsed with our data utilities.
Bug Fixes
Minor bug fixes
Desktop Companion App v38
Download v38 on Windows or MacOS to request Hand Tracking MPS and to get bug fixes.
MPS requests using the Desktop app have been slightly restructured, you no longer need to request Point Cloud data as an additional service. The request options are:
- SLAM (6DoF Trajectory, Semi-Dense Point Cloud, Online Sensor Calibration)
- Eye Gaze (General, plus personalized if the VRS file contains In-Session Eye Gaze Calibration)
- Hand Tracking (Wrist and Palm Tracking)
The Streaming button in the dashboard has been renamed to Preview, to better reflect the capability provided by the Desktop app. Use the Client SDK with CLI to stream data.
Desktop app logs are now stored in ~/.aria/logs/aria_desktop_app_{date}_{time}.log
- Please note, the streaming preview available through the Desktop app is optimized for Profile 12.
Known Issues
- If you encounter the file too small error when requesting MPS, it may be because the Desktop app is in a bad state. Restarting the app should resolve this issue
- Selecting Cancel does not work when downloading MPS is in progress
- [MacOS] When the app is launched with logging enabled, the Aria icon might not appear in the taskbar, but functions should not be impacted
- [Windows] The Aria icon does not render correctly when pinned to the taskbar
Bug Fixes
- If starting recording/streaming fails the UI will now refresh
- Issue where you can’t request MPS unless you interact with tick boxes has been resolved
- Issue where the Desktop app did not quit completely on MacOS has been resolved
Project Aria Tools v1.5
Project Aria Tools provides open tooling for anyone wanting to work with Aria data. For this release it enables users to request Hand Tracking data using the MPS CLI and provides a new ASR Python code sample.
Update Project Aria Tools:
- Python users: Update projectaria_tools Python package
- Install via Pip to be able to request Hand Tracking data using the MPS CLI
- C++ users: Update projectaria_tools git repository
Go to https://github.com/facebookresearch/projectaria_tools/releases/tag/1.5.3 for the full release log.
Speech to Text Code Sample (Python)
This new ASR Python code sample shows how to use Faster Whisper to run Whisper Speech Recognition on an Aria audio stream. The ASR outputs are time aligned with Aria Device Time.
Go to the Automated Speech Recognition Readme for how to get started.
Aria Glasses OS
The latest Project Aria OS build 4968297.250.70 was released on March 11, 2024.
New recording profiles
We’ve released the following experimental recording profiles. If you use a new profile, we’d love to hear about how it works for you.
Recording Profile 26: Minimal sensors, low RGB frame rate for extended recording times. The aim is 5+ recording hours while having RGB camera data at a low frame rate (unlike Recording Profile 20, which has IMU, but no RGB data).
Recording Profile 27: Designed for streaming over USB.
**Recording Profile 28: **Very high Eye Tracking camera frame rate.
Recording Profile 29: Low RGB frame rate, JPEG with decimation. This recording profile is the same as Profile 26, however 9 out of every 10 JPEG frames are skipped (decimation/sub-sampling). This is our first recording profile that uses decimation. The data from the RGB data stream is saved at a rate that archives a frame rate of 0.1FPS. The aim of this profile is to be able to record for 15+ hours.
Update to the latest version of the OS to access these profiles. Your glasses’ OS should automatically update when connected to Wi-Fi and power. Go to Updating OS to manually trigger an update.
You can see more details about recording profiles in the Mobile Companion app:
- Open the Mobile Companion App and select New Recording Session
- Select the existing recording profile (or Choose Profile if you have not set a default recording profile)
- Tap More Info in the top right corner
- The More info link may be difficult to see, this will be fixed in a future version of the Mobile Companion app
Or go to Recording Profiles documentation in Project Aria Tools.
Known Issues
- The new recording profiles are experimental and may be tuned further in the future.
Bug Fixes
- Make sure your glasses’ OS is less than 2 months old, to make sure you have a fix for an issue that may cause sluggish behavior in your Aria glasses, difficulties updating the OS, streaming data and reduced upload times.
- Updating OS includes troubleshooting steps if you have difficulties updating the OS.
Mobile Companion App v155
Please keep in mind, you can’t initiate recordings through the Mobile app if your glasses’ OS is more than 2 months old. Please make sure you update your glasses’ OS.
Updated look and feel of the Mobile app
The Mobile Companion app has a fresh new look! As part of this:
- The Settings tab has been renamed Profile
- Device Settings can be opened by tapping the glasses icon under Paired Glasses

Known Issues
- The More info link on the top right of the Recording Profiles page may be difficult to see.
Bug Fixes
Minor bug fixes
QUESTIONS, CONCERNS, FEEDBACK?
Go to our Support page for ways to get in touch.
Announcing Project Aria MPS CLI Availability and New MPS Feature
February 28 2024
Dear Academic Partners,
We are pleased to announce Project Aria MPS CLI and new MPS capability multi-trajectory map alignment! As part of our ongoing commitment to empowering researchers, the Aria MPS CLI allows you to submit jobs to Machine Perception Services programmatically. This will hopefully bring a new level of efficiency and flexibility to your workflow.
⭐️Key features for MPS CLI
- Request the following MPS services
- Single and multi-sequence SLAM
- SLAM Open/Closed loop trajectories
- Semi-Dense point clouds and observations
- Online sensor calibration
- Eye gaze
- General
- Personalized
- Single and multi-sequence SLAM
- Recording Upload
- VrsHealthCheck runs automatically before uploading. Upload is skipped if there is a failure.
- Unfinished uploads can be resumed for up to 24 hrs
- Processing
- Improved efficiency from concurrent processing and upload of multiple recordings
- Automatic download of outputs for immediate access
- Enables re-processing of data within a set time-frame without the need for re-upload
- Workflow integration Support
- Run MPS CLI as part of a script of other workflow to run MPS on recordings via automation
How to get started with CLI
To experience the power of Aria MPS CLI, go to the Project Aria MPS CLI page for how to use it.
Videos of this feature are available in the Project Aria Academic Partner Announcements, Feedback & Support workplace group
⭐️MPS: MULTI-SLAM/MULTI-SEQUENCE MAP ALIGNMENT
This addition brings the ability to generate SLAM output in a common frame of reference and support for multi-sequence SLAM outputs in a common frame of reference. Please go to Multi-SLAM page for more information about the feature and go to the MPS CLI page for how to access it.
⭐️Feedback and Support
If you encounter any problems using Aria MPS CLI, there are several ways to get user support:
- Post to Project Aria Academic Partner Announcements, Feedback & Support workplace group
- Post to Project Aria Discord
- Email AriaOps@meta.com and you can always request a meeting through this email if you need higher bandwidth discussion.
- Additional resources are available at Project Aria Github.
Aria Mobile App v150 is now available
February 6 2024
Dear Academic Partners,
The Aria Mobile App v150 is now available. Go to the Downloads page to get the latest version for Android. For iOS, select Update in the TestFlight app. Please update the app.
BUG FIXES
Various bug fixes to improve the overall usage.
PROJECT ARIA LATEST OS
The latest Project Aria OS build **4967277.730.70 **was released on 01/25/2024.