computer-using-agent

Here are 9 public repositories matching this topic...

Language: All

Filter by language

All 9 Python 5 JavaScript 1 Rust 1 TypeScript 1

a-real-ai / pywinassistant

The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user-interfaces (GUIs) by using only natural language. Uses Visualization-of-Thought and Chain-of-Thought reasoning to elicit spatial reasoning and perception, emulates, plans and simulates synthetic HID interactions.

ui ux artificial-general-intelligence ui-ux graphical-user-interface cua artificial-intelligence-algorithms vot cot artificial-narrow-intelligence computer-using-agent

Updated Feb 13, 2025
Python

OS-Agent-Survey / OS-Agent-Survey

Star 345

This is the repo for the paper "OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use" (ACL 2025 Oral).

agent gui survey operator web-agent browser-agent llms phone-use mllms computer-use gui-agent os-agent os-agent-survey computing-devices computer-using-agent computer-using

Updated Aug 16, 2025

OS-Copilot / ScienceBoard

Star 105

Code, benchmark and environment for "ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows"

science agents computer-using-agent computer-use-agent

Updated Aug 28, 2025
Python

reidbarber / webmarker

Star 44

Mark web pages for use with vision-language models

som prompt gemini operator cua claude playwright prompt-engineering llms vision-language-model gpt4v qwen-vl gpt4o set-of-mark computer-use computer-using-agent

Updated May 18, 2025
TypeScript

Clad3815 / open-computer-use

Star 10

AI-powered assistant that controls a Windows environment through docker, allowing automated interaction with the desktop interface. Control your computer with natural language.

operator computer-use computer-using-agent chatgpt-operator