Skip to content

Latest commit

Β 

History

History
35 lines (30 loc) Β· 1.44 KB

File metadata and controls

35 lines (30 loc) Β· 1.44 KB
sidebar_position 1
title Data Pipeline
description Robot-to-cloud data capture, recording configuration, and Arc agent setup for the Physical AI Toolchain
author Microsoft Robotics-AI Team
ms.date 2026-03-14
ms.topic overview
keywords
data pipeline
recording
capture
arc agent
edge recording
ros2 bag

Robot-to-cloud data capture pipeline for recording, compressing, and uploading robotic training episodes. This section covers recording configuration, edge device setup, and data flow from ROS 2 nodes to Azure storage.

πŸ“– Guides

Guide Description
Chunking and Compression Configuration Configure bag chunking thresholds and zstd compression for ROS 2 edge recording on Jetson devices

πŸ—οΈ Architecture

data-pipeline/
β”œβ”€β”€ capture/
β”‚   β”œβ”€β”€ config/          # Recording configuration and schema
β”‚   β”œβ”€β”€ models/          # Pydantic config models
β”‚   └── tests/           # Config model tests
β”œβ”€β”€ setup/               # Arc agent setup scripts
└── specifications/      # Domain specifications