Skip to content

FindNode

Fresh

FindNode is Sigma RT's shell program that identifies UI elements through query-based interaction rather than coordinates. It integrates with Android Accessibility services to enable intelligent automation across devices with different resolutions.

Key Advantages

  • No coordinate dependency — queries target UI elements by properties (text, ID, class)
  • Cross-resolution — same queries work on any screen size
  • Multi-device — run the same automation across different phone models

Core Components

ComponentPurpose
Query LanguageJSON-based syntax to locate UI elements
SelectorCore matching technology
Object ModeMulti-device synchronization
UI ExplorerVisual tool for building queries
AAISScripting language built on FindNode
REST/JS APIProgrammatic access to FindNode

How It Works

Instead of clicking coordinates:

javascript
// Old way (coordinate-based)
device.click(540, 960);

// FindNode way (object-based)
device.sendAai({ query: "T:OK", action: "click" });

The query T:OK finds the element with text "OK" regardless of its position on screen.

Three Essential Tools

  1. UI Explorer — Main pane > Scripts > Tools > UI Explorer. Inspect UI element properties and test queries visually
  2. Terminal — Main pane > Scripts > Terminal. Interactive testing with sendAai() command
  3. JavaScript (Rhino) — Combine queries and terminal tests into reusable scripts

SigmaTestApp

A dedicated test app is available to experiment with FindNode:

  • Launch from Total Control menu
  • Auto-installs on connected devices if not present
  • Contains sample UI elements for query testing

Sections

Unofficial documentation. Source: sigma-rt.com