Cradle
StaleDescription
The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.
Key Features
- General Computer Control (GCC) framework using screenshots and keyboard/mouse actions
- Supports games: RDR2, Stardew Valley, Cities: Skylines, Dealer's Life 2
- Supports software: Chrome, Outlook, Capcut, Meitu, Feishu and more
- Extensible skill system with atomic and composite skills per environment
- Self-reflection and action planning for autonomous task execution
- Minimal requirements with standardized general environment
Use Cases
💡 Autonomous gameplay in RDR2, Stardew Valley and other PC games
💡 Automate complex software workflows via UI screenshots and actions
💡 Research foundation model capabilities for computer control tasks
💡 Build custom agents for new games and software by defining environment configs
💡 Evaluate and benchmark LLMs on long-horizon computer control tasks
Categories
Quick Start
1. Clone: git clone https://github.com/BAAI-Agents/Cradle.git && cd Cradle
2. Create conda env: conda create --name cradle-dev python=3.10 && conda activate cradle-dev
3. Install deps: pip install -r requirements.txt
4. Install OCR: python -m spacy download en_core_web_lg
5. Create .env with OA_OPENAI_KEY or AZ_OPENAI_KEY
6. Run: python runner.py with the desired game/software config