Gui Agent Mobile

🌐Community
by ugorange · vlatest · Repository

Automates mobile app interactions via GUI emulation, enabling task completion on Android devices without coding.

Install on your platform

We auto-selected Claude Code based on this skill’s supported platforms.

1

Run in terminal (recommended)

terminal
claude mcp add gui-agent-mobile npx -- -y @trustedskills/gui-agent-mobile
2

Or manually add to ~/.claude/settings.json

~/.claude/settings.json
{
  "mcpServers": {
    "gui-agent-mobile": {
      "command": "npx",
      "args": [
        "-y",
        "@trustedskills/gui-agent-mobile"
      ]
    }
  }
}

Requires Claude Code (claude CLI). Run claude --version to verify your install.

About This Skill

What it does

The gui-agent-mobile skill enables AI agents to interact with mobile device interfaces. It allows agents to control apps, navigate screens, and perform actions on a connected mobile phone or tablet. This provides an interface for the agent to execute tasks that require direct interaction with a mobile application environment.

When to use it

  • Automated Mobile Testing: Use the skill to automate testing procedures for mobile applications by simulating user interactions.
  • Remote Device Management: Allow agents to remotely manage and control devices, such as setting up new phones or troubleshooting issues.
  • Accessibility Assistance: Enable AI agents to assist users with disabilities by controlling their mobile devices based on voice commands or other input methods.
  • Data Extraction from Mobile Apps: Extract specific data from mobile applications that are difficult to access through traditional APIs.

Key capabilities

  • Mobile device control
  • App navigation
  • Screen interaction
  • Action execution within apps

Example prompts

  • "Open the camera app and take a picture."
  • "Navigate to the settings screen and turn on Bluetooth."
  • "Send a message to [contact name] saying 'I'm running late.'"
  • "Find the nearest coffee shop using Google Maps."

Tips & gotchas

Requires a connected mobile device that is properly configured for remote access. The agent’s ability to interact with apps depends on the app’s design and accessibility features.

Tags

🛡️

TrustedSkills Verification

Unlike other registries that point to live repositories, TrustedSkills pins every skill to a verified commit hash. This protects you from malicious updates — what you install today is exactly what was reviewed and verified.

Security Audits

Gen Agent Trust HubPass
SocketPass
SnykPass

Details

Version
vlatest
License
Author
ugorange
Installs
2

🌐 Community

Passed automated security scans.