MediaPipe provides cross-platform libraries, tools, and a framework for building and deploying on-device machine learning pipelines. Input data is processed locally on the device without being sent to external servers, though coding is required and performance metrics are sent to Google requiring user consent.
Project overview
The framework processes input data on-device across multiple platforms and supports customizable models for local execution.
Project type
Model Runtime · Infrastructure
Deployment
Refer to project documentation
License
Apache-2.0
Best for
Developers, AI engineers, and researchers who need to build and deploy cross-platform on-device ML pipelines.
Key capabilities
Cross-platform APIs and libraries for deploying machine learning solutions in applications.
Tool to customize pre-trained models with custom data for solutions.
Tool to visualize, evaluate, and benchmark solutions in a browser.
Low-level component for building efficient on-device ML pipelines using packets, graphs, and calculators.
Pre-trained, ready-to-run models for use with each solution.
Limitations and risks
Ended support for certain MediaPipe Legacy Solutions as of March 1, 2023.
APIs send metrics about performance and utilization to Google, which requires user consent.
Getting started
Setup is of medium difficulty because it requires setting up a development environment and integrating libraries via code. Users should set up their development environment for Python, Web, or Android, integrate the APIs and libraries, and process on-device inference.
Evidence and sources
README: Delight your customers with innovative machine learning features.
README: MediaPipe Solutions provides a suite of libraries and tools for you to quickly apply artificial intelligence (AI) and machine learning (ML) techniques in your applications.
README: MediaPipe Framework is the low-level component used to build efficient on-device machine learning pipelines, similar to the premade MediaPipe Solutions.
README: When you use MediaPipe Tasks, processing of the input data (e.g. images, video, text) takes place on device, and MediaPipe does not send that input data to Google servers. As a re…