Easy Dataset

Stale
GitHub JavaScript NOASSERTION

Description

easy-dataset is a tool to quickly build datasets for LLM fine-tuning and agent training, with auto-labeling, sampling and export to mainstream formats.

Key Features

  • One-click generation — input raw text and get QA / SFT datasets
  • LLM labeling — high-quality labels via mainstream LLMs
  • Multi-format export — Alpaca, ShareGPT, JSONL, Parquet and more
  • Visual review — UI for manual QA and edits
  • Difficulty stratification — auto-layers by difficulty for curriculum training
  • Extensible — plug in custom prompts and filter rules

Use Cases

💡 Quickly producing datasets for domain-specific LLM fine-tuning
💡 Preparing multi-step training samples for agent tasks
💡 Cutting labeling effort with the visual QA UI
💡 Turning existing documents into training datasets in one click

Strengths & Limitations

Strengths

  • High community interest (14.9k stars)
  • Responsive to issues, low backlog

⚠️ Limitations

  • No clear open-source license

Quick Start

npm install -g @easy-dataset/cli
dataset init my-data
dataset generate --input ./docs --format alpaca

Related Projects

WrenAI

17.5k · Python
Active A

Open-source text-to-SQL and text-to-chart GenBI agent with a semantic layer. Ask your database questions in natural language and get accurate SQL, charts, and BI insights. Supports 12+ data sources and any LLM.

llmtypescriptagent +2
  • · Open context layer providing business semantics, examples, and governance for AI agents
  • · Agent-driven design with CLI-embedded workflow guides loaded on demand
  • · Modeling Definition Language (MDL) for models, relationships, cubes, metrics, and RLAC/CLAC

LangExtract

38.5k · Python
Active A+

A Python library by Google for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization, designed for data annotation and knowledge extraction workflows.

data-processingllmpython +2
  • · Precise source grounding — Every extraction maps to exact source text location with visual highlighting for traceability and verification
  • · Controlled structured outputs — Few-shot example enforced output schema, leveraging Gemini controlled generation for robust results
  • · Long document optimization — Text chunking, parallel processing, and multi-pass strategy to overcome needle-in-a-haystack challenges

AI Engineering Hub

37.3k · Jupyter Notebook
Active A+

In-depth tutorials on LLMs, RAGs and real-world AI agent applications. Rich notebook examples for learning AI engineering practices.

ragagentllm +1
  • · 93+ production-ready projects — Covering OCR, RAG, agents, voice, multimodal, and more
  • · Three difficulty tiers — Beginner (22), intermediate (48), advanced (23) projects for progressive learning
  • · LLM hands-on tutorials — Local deployment and applications with DeepSeek, Llama, Gemma, Qwen models