AgentList
HomeProjectsArticlesAbout
Explore Projects
HomeProjectsArticlesAbout
Explore Projects
Home / Projects / mistral.rs

mistral.rs

Active
GitHub Rust MIT

Description

Fast, flexible LLM inference engine built in Rust — supports multiple model architectures and quantization schemes for high-performance local LLM deployment.

Tags

rust llm tools framework

Categories

⚡ Agent Tools
Visit GitHub

Project Metrics

Stars 7.0k
Forks 579
Watchers 7.0k
Issues 345
Created February 26, 2024
Last commit April 15, 2026

Deployment

Local

Related Projects

ToolOrchestra

706 · Python
Active

An end-to-end RL training framework by NVIDIA for orchestrating tools and agentic workflows. Optimizes multi-step agent decision-making and tool-use policies.

agentframeworktools +2

KTransformers

17.0k · Python
Active

A flexible framework for experiencing heterogeneous LLM inference and fine-tuning optimizations — run large language models efficiently on consumer hardware with kernel-level optimizations.

pythonllmtools +1

DeepReasoning

5.4k · Rust
Stale

A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's chain-of-thought reasoning traces with Anthropic Claude models.

rustllmapi +1

Vision Agents

7.7k · Python
Active

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider, using Stream's edge network for ultra-low latency realtime interactions.

voiceagentpython +3
AgentList

Curated directory of open-source AI agent projects

Quick Links

  • Project List
  • Featured Articles
  • Browse Categories

Contact

  • About
  • Privacy Policy
  • Contact Us

© 2026 AgentList. All rights reserved.

Made with for the open source community