Unsloth

Active
GitHub Python Apache-2.0

Description

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, and gpt-oss locally, providing model fine-tuning and deployment capabilities for agent developers.

Key Features

  • High-efficiency fine-tuning engine - Custom Triton kernels for 2x faster training with 70% less VRAM, no accuracy loss
  • Multi-modal training - Supports fine-tuning text, vision, TTS, and embedding models
  • Reinforcement learning (RL) - GRPO, FP8 and other RL methods with 80% less VRAM usage
  • Unsloth Studio Web UI - Graphical interface to search, download, run, and export GGUF/safetensors models
  • Data Recipes - Auto-create training datasets from PDF, CSV, DOCX files with visual-node editing workflow
  • Broad model compatibility - 500+ models supported, direct collaboration with Qwen3, Llama 4, Gemma, gpt-oss teams on bug fixes

Use Cases

💡 Fine-tune open-source LLMs locally for domain-specific tasks like customer service, code generation, or document understanding
💡 Align model behavior through reinforcement learning to improve agent tool-calling and reasoning capabilities
💡 Build local LLM inference services with API endpoints for integration into Claude Code or Codex toolchains
💡 Auto-generate training data from business documents to rapidly build domain-specific models

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (72.6k stars)
  • Permissive open-source license (Apache-2.0)
  • Established track record (2 years in production)

Quick Start

# Install Unsloth Studio on macOS / Linux
curl -fsSL https://unsloth.ai/install.sh | sh

# Launch the Web UI (default port 8888)
unsloth studio -p 8888

# Or use the Python core version
pip install unsloth --torch-backend=auto

Related Projects

Tongyi DeepResearch

19.8k · Python
Stale B

Open-source deep research agent from Alibaba Tongyi Lab, using multi-stage iterative information retrieval and reasoning to conduct deep analysis, synthesis, and summarization of complex topics with web search and document analysis.

pythonagentllm +3
  • · 30.5B total parameter agentic LLM with only 3.3B activated per token (MoE architecture)
  • · Fully automated synthetic data generation pipeline for agentic pre-training, SFT, and RL
  • · Large-scale continual pre-training on diverse agentic interaction data

mistral.rs

7.6k · Rust
Active A

Fast, flexible LLM inference engine built in Rust — supports multiple model architectures and quantization schemes for high-performance local LLM deployment.

rustllmtools +1
  • · Zero-Config Model Loading — auto-detect architecture, quantization format, and chat template from any Hugging Face model
  • · True Multimodality — text, vision, video, audio input, speech generation, image generation, and embeddings in one engine
  • · Smart Quantization — UQFF prebuilt quantizations and ISQ with automatic best-format selection at each level

Vision Agents

8.1k · Python
Active A+

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider, using Stream's edge network for ultra-low latency realtime interactions.

voiceagentpython +3
  • · Real-time video AI with YOLO, Roboflow integration combined with Gemini/OpenAI for live visual understanding
  • · Ultra-low latency audio/video under 30ms via Stream's edge network with 500ms join time
  • · Native SDK methods from OpenAI, Gemini, and Claude for always-latest LLM capabilities

MiroThinker

8.4k · Python
Normal A

A deep research agent framework optimized for complex research and prediction tasks, with MiroThinker-1.7 and MiroThinker-H1 models achieving 74.0 and 88.2 on BrowseComp benchmark, supporting multi-step reasoning and information retrieval.

pythonagentllm +3
  • · Deep research agent framework optimized for complex research and prediction tasks
  • · MiroThinker-1.7 achieves 74.0 on BrowseComp, H1 model reaches 88.2
  • · Supports 256K context window and up to 300 tool calls per task

Related Articles