Managing multimodal data is an intricate process that encompasses the collection, consolidation, and interpretation of diverse data to ensure a comprehensive understanding of a robot.
Foxglove is a centralized platform that seamlessly visualizes, analyzes, and manages data from diverse sources and frameworks such as URDF, ROS 1 and 2, Protobuf, MCAP, etc; understanding the spatial relationships and taking care of serialization, transport, out-of-order ingestion, indexing, and caching for robotic data engineers so they don’t have to.
MCAP (pronounced "em-cap") is an open source container file format for multimodal log data. It supports multiple channels of timestamped pre-serialized data, and is ideal for use in pub/sub or robotics applications.
Foxglove is the creator and maintainer of the MCAP open source project. Import MCAP (.mcap) data files directly into Foxglove for in-depth analysis and visualizations. Convert other data formats like ROS 2, Protobuf, JSON, and more – into the MCAP file format.
Unified Robot Description Format (.urdf) is an xml format representing a robot model that can be visualized in 3D.
URDF robot models are automatically loaded into Foxglove’s 3D panel to help robotic developers understand how their robots move through the real world; allowing them to position and orientation or transform messages to position the robot's joints for easy troubleshooting.
A bag or ROS bag (.bag) is a file format in ROS for storing ROS message data.
Visualize live or pre-recorded bag files by simply dragging and dropping the files directly into one of the many Foxglove panels that have built-in support for displaying native ROS messages – like 3D markers, images and logs.
Protobuf is an open-source cross-platform data format used to serialize structured data.
Foxglove supports a variety of encoding formats including Protobuf by enabling loading local or remote MCAP files containing custom data (e.g.: Protobuf, JSON, FlatBuffers), or by connecting directly to live custom data via a Foxglove WebSocket connection.