google-ai-edge/LiteRT
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
C++ · ★ 1,912 · Fork 236 · 在 GitHub 查看
在手机上浏览源码、订阅每日 AI 趋势日报与项目架构深度解读:获取 CopoHub 客户端(iOS & HarmonyOS)→
GitHub Trending 上榜记录
google-ai-edge/LiteRT 已在 GitHub Trending 每日榜单上榜 3 天,最高排名第 10,首次上榜 2026-03-12,最近一次上榜 2026-03-14。
| 日期 | 排名 | Star | 当日增长 |
|---|---|---|---|
| 2026-03-14 | #16 | 1,912 | +211 |
| 2026-03-13 | #16 | 1,843 | +208 |
| 2026-03-12 | #10 | 1,637 | +6 |
同期上榜的项目
- volcengine/OpenViking – Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.
- microsoft/BitNet – Official inference framework for 1-bit LLMs
- anthropics/claude-plugins-official – Official, Anthropic-managed directory of high quality Claude Code Plugins.
- dimensionalOS/dimos – Dimensional is the agentic operating system for physical space. Vibecode humanoids, quadrupeds, drones, and other hardware platforms in natural language and build multi-agent systems that work seamlessly with physical input (cameras, lidar, actuators).
- p-e-w/heretic – Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more
- langflow-ai/openrag – OpenRAG is a comprehensive, single package Retrieval-Augmented Generation platform built on Langflow, Docling, and Opensearch.
google-ai-edge/LiteRT 项目深度剖析与商业评估报告
google-ai-edge/LiteRT 项目深度剖析与商业评估报告
报告日期:2026-08-22 分析对象:LiteRT(TensorFlow Lite 继任者) 仓库状态:3.3k Stars / 428 Forks / 2,591 Open Issues / Apache-2.0 技术栈:C++ 核心,多语言绑定(Kotlin/Swift/JS/Python)
---
1. 核心定位与商业落地价值
1.1 解决的根本痛点
LiteRT 解决的是边缘设备上高性能 ML/GenAI 部署的碎片化难题。其前身 TensorFlow Lite 存在三大结构性缺陷:
Delegate 机制过度复杂:开发者需手动选择 GPU/NPU delegate,且各厂商(Qualcomm、MediaTek、Google Tensor)的 NPU SDK 接口割裂,导致"一次编写、处处调试"的噩梦。 LLM 支持缺失:TFLite 的算子集与内存管理模型无法高效承载 Transformer 架构,导致端侧 LLM 部署必须依赖外部方案(如 llama.cpp)。 异步执行与 I/O 瓶颈:传统 Interpreter::Invoke() 为同步阻塞调用,无法利用多队列硬件并行能力,且输入输出张量拷贝开销显著。
LiteRT V2 通过 Compiled Model API 实现了"自动化加速器选择"与"真正的异步执行",将开发者从底层硬件适配中解放出来,这是对 TFLite 开发体验的范式级重构。
在 README 中展示上榜徽章
[](https://github.fq6825.top/repo/google-ai-edge/LiteRT)