LongCat-2.0正式发布不足一月，美团基础模型负责人裴鹏将离职

Meituan open-sourced its trillion-parameter large-scale model LongCat-2.0, and simultaneously released the inference code for domestically developed Chinese card processors.

According to Beating's monitoring, Meituan has officially open-sourced its trillion-parameter large-scale model, LongCat-2.0, with a total of 1.6T parameters and an average activation of approximately 48B, designed specifically for real-world agentic coding tasks. Architecturally, it innovatively introduces LongCat sparse attention and N-gram embedding. The former reduces fragmented memory access through flow-aware indexing and hierarchical indexing, accelerating training and inference with millions of contexts; the latter, while achieving nearly 97% sparsity in MoE, invests 135B parameters into the embedding layer, balancing parameter gains and structural stability. Post-training employs multi-teacher online distillation, categorizing experts into Agent, Inference, and Interaction types, seamlessly integrating them on a domestic computing power cluster through the MOPD architecture. As the industry's first trillion-parameter model to complete inference on a 50,000-card domestic computing power cluster, LongCat-2.0 validates the mature capability of domestic chips to handle complex large-scale model tasks. To address the multiple limitations of domestically produced Chinese chips in terms of memory, bandwidth, and interconnects, Meituan has made breakthroughs in three areas: model, chip adaptation, and deployment. At the model level, ScMoE leverages the core control capabilities of domestically produced chips to achieve physical core-level parallelism for Dense and MoE branches, combined with KV-cache partitioning to alleviate the pressure on ultra-long context memory. At the chip adaptation level, Super Kernel reduces operator startup overhead, and Weight Prefetch hides I/O latency, maximizing hardware utilization under constrained conditions. At the deployment level, PD separation is adopted to balance TTFT and TPOT, along with asynchronous Expert-Parallel load balancing to solve load unevenness under high EP (efficiency level). This open-source release simultaneously provides multiple precision versions, including BF16, FP8, and INT8, and fully opens up inference results optimized for domestic computing power, aiming to enable existing domestically produced cards and even older cards to smoothly deploy trillion-model inference services. --------------------------------- Click the original link below to join the Beating · Lark AI news channel and monitor global AI hot topics and news 24/7.