Skip to content

DEMOS.md

Latest commit

 

History

History
192 lines (142 loc) · 10.5 KB

DEMOS.md

File metadata and controls

192 lines (142 loc) · 10.5 KB
Raw

Demo videos

This page lists the recorded demo videos, read-only prompts you can try yourself, a checklist for recording new videos, and the steps for adding one to the README.

Recorded videos

These are linked from the README's Demo videos table. The files are stored on PhoneUse's video storage at https://pub-b1e2c1245ef644aa89f7c5da08db4154.r2.dev/, not in this repository.

Video What PhoneUse does Size Personal details blurred
Overview The 50-second launch video 1.9 MB Yes
TikTok Browses the TikTok feed 2.03 MB Yes
Instagram Watches Instagram Reels 8.07 MB Yes
Telegram Sends a “good morning” message 619.23 KB Yes
Google Maps Finds a Starbucks and shares it 1.71 MB Yes
GEICO Sets up a renters insurance quote 1.37 MB Yes
Reddit Browses Reddit and leaves a comment 2.53 MB Yes
Amazon Reviews a Diet Coke order 1.85 MB Yes
DoorDash Places an order and texts an update 1.64 MB Yes

Some of these send a message, post a comment or place an order. Those are real actions on a real phone.

Names, contacts, addresses, recent searches, payment details, account names, calendar events and home-screen widgets are blurred in every video. Each video was checked at two frames a second, and frame by frame wherever a blur starts or ends. Check any new video against the checklist the same way before you upload it.

Prompts to try yourself

These prompts only look things up or read the screen. None of them sends, buys, deletes or changes anything, so they are a safe first test of your setup. They are also good scripts for more videos.

Status: none of these prompts has been tried on a physical iPhone for this launch yet. Update the Status column after you try one.

# Prompt What it shows Length Status
1 Describe the screen Reading the screen 15–20 s Not tried yet
2 Do a calculation Tapping buttons in an app 15–25 s Not tried yet
3 Search the web Typing, tapping and reading 30–45 s Not tried yet
4 Look up a place Searching inside an app 20–30 s Not tried yet
5 Browse the App Store Reading a list, and not installing 20–30 s Not tried yet
6 Read the world clock Moving between tabs in an app 15–25 s Not tried yet
7 Stop a task halfway The Stop task button 15–25 s Not tried yet
8 Drive the phone from your AI agent MCP 30–45 s Not tried yet

Before you record: checklist

The phone

  • Use a test iPhone with no personal data: no personal Apple Account name, contacts, photos, messages, email or saved passwords.
  • Turn on Do Not Disturb on the iPhone and the Mac, so no notifications appear.
  • Give the phone a plain name such as "Demo iPhone". The name shows in the phone menu on the PhoneUse page.
  • For the Maps demo, turn off Location Services for Maps, or only record somewhere you are happy to show. Maps shows where the phone is.

The Mac

  • Record only the browser window, not the whole screen.
  • Close other tabs and windows, and hide bookmarks.
  • Do not show Terminal, Xcode's device list, the platform/.state folder or the API docs page. They can show device IDs or the API key.
  • Start recording after the PhoneUse page has loaded. The address the launcher opens briefly holds the key; the page removes it right away.
  • For the MCP demo, hide or blur the tool results in your MCP client. They include the phone's device ID.

After recording

  • Watch every frame before uploading, and pause on fast parts. Look for device IDs (serial number, UDID, IMEI), notifications, contacts, names, email addresses, phone numbers, locations and the API key.
  • Trim the clip to under a minute; the prompt table gives a length for each script.
  • Save it as .mp4 (H.264), which plays in every browser. Keep the file small so it starts quickly.
  • If the task fails or does something unexpected, do not use that take. Record again, or skip the demo and open an issue.

How to record

Recommended: record the Mac's screen. It shows the prompt, the live phone screen and the answer together.

  1. Follow the README quickstart until the badge next to Your iPhone says Ready.
  2. Press Shift-Command-5, choose Record Selected Portion, and frame the PhoneUse browser window.
  3. Type the prompt, press Enter, wait for the answer, then stop the recording.

Optional close-up: record the iPhone itself with Control Center → Screen Recording. iPhone recordings include the status bar, so check it for notifications.

How to add a video

Do not commit video files. scripts/check-public-tree.py fails on .mp4, .jpg and .jpeg files, on any binary file and on any file over 2 MB. The videos live in PhoneUse's Cloudflare R2 bucket instead, and the README links to them.

  1. Upload the .mp4 to the R2 bucket. Use a file name without spaces, such as 18-search-the-web.mp4. (Spaces work too, but each one must be written as %20 in the link.)

  2. Copy its public link. It starts with the bucket's https://pub-b1e2c1245ef644aa89f7c5da08db4154.r2.dev/ address.

  3. Open the link in a private browser window. It must play without signing in. If the browser downloads the file instead of playing it, set the file's content type to video/mp4 in R2.

  4. Add a row to the Demo videos table in README.md:

    | **App name** | What PhoneUse does. | [▶ Watch](https://pub-b1e2c1245ef644aa89f7c5da08db4154.r2.dev/18-search-the-web.mp4) |

  5. Add the same video to the Recorded videos table above.

GitHub does not play videos from other sites inside the README. Its pages only play videos stored on GitHub, so clicking ▶ Watch opens the video on its own page.

Every upload is public. Anyone with the link can watch it, so check the video before you upload it.

Autoplay clips at the top of the README

The three clips at the top of the README are short GIFs. GitHub shows a GIF as a picture, so it plays by itself and loops; clicking it opens the full video.

Each GIF shows only the phone, is about 10 seconds long, 240 pixels wide and under 1 MB. Pick a stretch with no personal details: no names, addresses, recent searches, payment details, contacts or notifications. Then make the GIF with FFmpeg, changing the start (-ss), length (-t) and speed (PTS/1.2):

ffmpeg -ss 11 -t 11 -i "input.mp4" \
  -vf "crop=440:880:1230:130,setpts=PTS/1.2,fps=12,scale=240:-1:flags=lanczos,split[a][b];[a]palettegen=max_colors=128:stats_mode=diff[p];[b][p]paletteuse=dither=bayer:bayer_scale=4:diff_mode=rectangle" \
  -loop 0 readme-clip.gif

The crop box fits videos exported from PhoneUse Demo Studio (1920 × 1080, phone on the right). Watch the finished GIF frame by frame, upload it to the R2 bucket next to the videos, and add it to the table at the top of README.md.

Demo scripts

1. Describe the screen

  • Before you start: open Safari on the phone to an empty start page.
  • Prompt:

    Open Safari and describe the current screen. Do not submit anything.

  • Viewers should see: Safari in front and a short, accurate description of the screen in the chat.

2. Do a calculation

  • Before you start: close Calculator.
  • Prompt:

    Open Calculator and work out 128 × 46. Tell me the answer.

  • Viewers should see: the keys being tapped on the live screen, and the answer 5,888.
  • Use another take if: it taps the wrong keys or the answer is wrong.

3. Search the web

  • Before you start: open Safari to an empty start page.
  • Prompt:

    Open Safari, search for "easy hikes near San Francisco", and summarize the top three results. Do not sign in or fill in any forms.

  • Viewers should see: the search typed into Safari, results loading, and a three-item summary in the chat.
  • Use another take if: a sign-in or cookie prompt appears. Do not accept anything on the phone.

4. Look up a place

  • Before you start: see the Maps item in the checklist.
  • Prompt:

    Open Maps, search for "Golden Gate Bridge", and tell me its address. Do not start directions.

  • Viewers should see: Maps searching, the bridge on the map, and the address in the chat.
  • Use another take if: it starts directions.

5. Browse the App Store

  • Before you start: the App Store shows the signed-in account's picture. Use a test Apple Account.
  • Prompt:

    Open the App Store, search for "habit tracker", and list the top three apps with their ratings. Do not tap Get or install anything.

  • Viewers should see: the search results and three app names with ratings in the chat.
  • Stop at once if: it moves toward Get. Click Stop task and do not use that take.

6. Read the world clock

  • Before you start: by hand, add three or four cities to World Clock, such as London, Tokyo and New York.
  • Prompt:

    Open Clock, go to World Clock, and tell me which cities are listed and the time in each. Do not add or delete anything.

  • Viewers should see: the World Clock tab opening, and each city with its time in the chat.

7. Stop a task halfway

  • Before you start: open Safari to an empty start page.
  • Prompt:

    Open Safari, search for "iPhone tips", and read me the title of every result on the first page.

  • During the task: after two or three steps, click the Stop task button next to the message box.
  • Viewers should see: the phone stop moving and the chat show the task as stopped. Steps the phone already took are not undone, so say that in the caption.

8. Drive the phone from your AI agent (MCP)

  • Before you start: connect your MCP client to platform/start-mcp.sh as described in INTEGRATIONS.md. Put the client window and the PhoneUse page side by side so viewers can see the phone respond.
  • Prompt (in your MCP client):

    List my phones, take a screenshot of the first one, and tell me what is on the screen.

  • Viewers should see: the agent find the phone, take a screenshot, and describe it.
  • Before publishing: blur or hide the tool results. They include the phone's device ID.