Natural-language computer control

Control your computer with natural language.

Tell your computer what you want to do.
JTWingman turns it into mouse and keyboard actions.

Watch demo macOS waitlist
Interactive demo

The automatic demonstration opens Google Chrome, goes to lichess.org, starts a game against the computer at strength six as White, plays e4, and quits Google Chrome.

Ask JTWingman

Watch JTWingman open Chrome and play e4 on Lichess.

01 / Actions

Your voice becomes the mouse and keyboard.

JTWingman turns everyday spoken requests into mouse and keyboard interactions.

Click

Scroll

Type

Keyboard shortcut

02 / Workflow

One request.
Three clear stages.

  1. 1

    Say what you want

  2. 2

    Understand the interface

  3. 3

    Carry out the action

03 / Difference

Intent, not
command syntax.

Command-based voice control and JTWingman compared across three scenarios
Command-based voice control JTWingman

Notes
Command-based voice control
  1. 1Show numbers
  2. 2Click 33
Notes ＋ New note 33
Today
New Note Just now   No additional text
JTWingman
  1. Create a new note for me.
Notes ＋ New note
Today
New Note Just now   No additional text

Chess
Command-based voice control
  1. 1Show grid
  2. 217
  3. 3Click 24
  4. 4Show grid
  5. 517
  6. 6Click 9
JTWingman
  1. Pawn to e4.

Code
Command-based voice control
  1. 1import numpy as np
  2. 2New line
  3. 3New line
  4. 4…
JTWingman
  1. Write a NumPy function here that returns the average of a list.

04 / Control

Clear access.
Visible control.

JTWingman makes required access visible, reports what it is doing, and asks for explicit approval before any unsafe action.

Safety

JTWingman will not execute unsafe actions without explicit approval.

Approval required

Screen access

Allows JTWingman to understand what is visible on screen.

Permission

Interface access

Allows JTWingman to interact with visible controls.

Permission
States
  • Idle
  • Working
  • Done
  • Error

Try JTWingman early.

JTWingman is being tested with a small group of early users.

Join the macOS waitlist