You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Every tool is callable by your AI agent through MCP. Tools accept selectors (text, resource ID, content description) so your agent never needs to hardcode pixel coordinates.
ποΈ Observe β See what's on screen
Tool
Description
Typical Latency
screenshot
Capture screen as JPEG (full or thumbnail quality)
~60ms
get_ui_tree
Full UI hierarchy with element IDs, text, bounds
18-33ms
find_elements
Search for elements by text, ID, or content description
<10ms
get_screen_context
Screenshot + simplified UI tree in one call
~70ms
get_device_info
Manufacturer, model, Android version, screen size
<5ms
get_notifications
Read notification titles, text, and actions
<10ms
get_recent_toasts
Capture toast messages shown on screen
<5ms
π Act β Touch, type, and interact
Tool
Description
Typical Latency
tap
Tap by selector or coordinates
~2ms
long_press
Long press (default 1000ms hold)
~1000ms
double_tap
Double tap gesture
~150ms
swipe
Swipe between two points with duration control
~2ms
pinch
Pinch zoom (scale >1.0 = in, <1.0 = out)
~300ms
drag
Drag from point A to point B
~500ms
input_text
Type text into a field
~1.4ms
press_key
Press system keys (back, home, enter, etc.)
<5ms
set_clipboard
Set clipboard content
<10ms
π± Manage β Control apps and device
Tool
Description
Typical Latency
launch_app
Launch app by package name
<100ms
close_app
Close app (graceful or force-stop via ADB)
~200ms
open_url
Open URL in default browser
<100ms
global_action
System actions: back, home, recents, notifications
<10ms
list_apps
List installed apps (all or by filter)
~200ms
β³ Wait β Synchronize with the UI
Tool
Description
Typical Latency
wait_for_element
Wait until element appears (with timeout)
up to 5s
wait_for_gone
Wait until element disappears
up to 5s
wait_for_idle
Wait until UI stabilizes (no changes for 300ms)
up to 5s
scroll_to_element
Scroll through lists until element is found
up to 30s
π§ͺ Test β Validate and debug
Tool
Description
Typical Latency
screenshot_diff
Compare screenshots for visual regression
~100ms
accessibility_audit
Audit screen for a11y issues (touch targets, labels)