Pinned Loading

1. Florence2SAM2_Labelanything Florence2SAM2_Labelanything Public

   Florence2 + SAM2 label by prompt

   Jupyter Notebook 8

2. GroqDiscordAssistant GroqDiscordAssistant Public

   A Discord bot that integrates with Groq's LLM API to provide AI-powered question answering and assistance. Users can interact with different AI models through mentions or commands, maintaining conv…

   Python 21 5

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.5k 24.5k

4. NVIDIA/Model-Optimizer NVIDIA/Model-Optimizer Public

   A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downs…

   Python 5.6k 802

5. QwenLM/qwen-code QwenLM/qwen-code Public

   An open-source AI coding agent that lives in your terminal.

   TypeScript 29.1k 3.3k

6. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 15k 2.9k