Magnitude

Stale
GitHub TypeScript Apache-2.0

Description

An open-source, vision-first browser agent that drives web automation through visual understanding, supporting complex web interaction tasks for QA testing and workflow automation.

Key Features

  • Vision-first architecture: visually grounded LLM specifies pixel coordinates for true DOM-independent generalization
  • Navigate: sees and understands any interface to plan out actions
  • Interact: executes precise actions using mouse and keyboard control
  • Extract: intelligently extracts structured data matching custom Zod schemas
  • Verify: built-in test runner with powerful visual assertions for QA

Use Cases

💡 Web application end-to-end testing with visual assertions
💡 Cross-application integration without APIs by automating browser workflows
💡 Structured data extraction from complex web pages
💡 Building custom browser agents for repetitive web tasks
💡 CI/CD pipeline integration for visual regression testing

Quick Start

Run 'npx create-magnitude-app' to scaffold a new project with an example script. For existing projects, install via 'npm i --save-dev magnitude-test && npx magnitude init'. Requires a visually grounded model like Claude Sonnet 4 or Qwen-2.5VL 72B.

Related Projects