Alibaba

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Probably the fastest coroutine lib in the world!

The semantic layer that makes enterprise data understandable to AI agents — model entities and relations once, query through SPL/MCP/REST, and connect telemetry, services, and business objects in one object graph.

An easy-to-use framework for large scale recommendation algorithms.

ANOLISA (Agentic Nexus Operating Layer & Interface System Architecture)

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.

Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.

An evaluation and evolution tool for Agent Skills.