GRepoWatch
Daily at 07:00 UTC+8Subscribe中文

REPOWATCH / EXPLORE

Find your next
open-source tool.

Search the full Trending archive by name, purpose, tag or language.

428open-source projectsAcross the full Trending archive

SEARCH RESULTS

Models & inference43

Clear filters ↺
BerriAI☆ 60,631

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Python·Recorded 2026-10-10
tile-ai☆ 8,086

tilelang

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

Python·Recorded 2026-10-02
NVIDIA☆ 4,904

Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

Python·Recorded 2026-09-27
Showing 13–24 of 43
← Previous2 / 4Next →