TypoFixr - Test Plan (TDD) This document defines acceptance criteria for all MVP features. Each test should pass before the feature is considered complete.
1.1 Selected Text Priority
ID
Test Case
Input
Expected Output
TC-1.1.1
Selected text is used when available
User selects "hello wrold" in a text field, presses shortcut
Only "hello wrold" is sent to API
TC-1.1.2
Selection works across apps
Select text in Safari, Notes, Slack, Mail
Text captured correctly in each
TC-1.1.3
Partial selection in long document
Select 3 words in a 10,000 word doc
Only selected 3 words sent
1.2 Full Field Capture (No Selection)
ID
Test Case
Input
Expected Output
TC-1.2.1
Short text field captured fully
Type "thansk" in empty Slack input, no selection
Full text "thansk" sent
TC-1.2.2
Character limit respected
Type 6000 chars, no selection (limit=5000)
Alert shown asking to select less text
TC-1.2.3
Empty field handled
Press shortcut on empty field
Show "No text to fix" notification
ID
Test Case
Input
Expected Output
TC-1.3.1
Current paragraph detected
Cursor in middle of paragraph, no selection
Current paragraph sent
TC-1.3.2
Paragraph boundary = newline
Text has 3 paragraphs, cursor in 2nd
Only 2nd paragraph sent
2. Text Replacement Tests
ID
Test Case
Input
Expected Output
TC-2.1.1
Simple typo fix
"teh"
Replaced with "the" in place
TC-2.1.2
Multiple typos
"teh qucik brwon fox"
"the quick brown fox"
TC-2.1.3
Grammar fix
"i goes to store"
"I go to the store" (or similar)
TC-2.1.4
Punctuation fix
"hello world how are you"
"Hello world, how are you?"
ID
Test Case
Input
Expected Output
TC-2.2.1
Casual tone preserved
"yo whats up dude"
"Yo, what's up dude?" (not formal)
TC-2.2.2
Abbreviations kept
"msg me asap pls"
"Msg me ASAP pls" (not expanded)
TC-2.2.3
Intentional caps preserved
"THIS IS IMPORTANT"
Stays caps if intentional
TC-2.2.4
Emoji preserved
"thanks 😊"
"Thanks 😊"
2.3 Formatting Preservation
ID
Test Case
Input
Expected Output
TC-2.3.1
Line breaks preserved
"line1\nline2\nline3"
Line breaks maintained
TC-2.3.2
Indentation preserved
" indented text"
Indentation maintained
TC-2.3.3
Lists preserved
"- item1\n- item2"
List format maintained
ID
Test Case
Input
Expected Output
TC-3.1.1
Undo via ⌘Z
Fix text, press ⌘Z
Original text restored
TC-3.1.2
Undo works across apps
Fix text in Notes, Mail, Slack, press ⌘Z
Original restored in each
ID
Test Case
Input
Expected Output
TC-3.2.1
History stores corrections
Make 3 corrections
All 3 appear in menu dropdown
TC-3.2.3
History limit respected
Make 15 corrections
Only last 10 stored
TC-3.2.4
History persists across sessions
Make corrections, quit, relaunch
History still visible
3.3 System Undo Compatibility
ID
Test Case
Input
Expected Output
TC-3.3.1
Cmd+Z works in Notes
Fix text in Notes, press Cmd+Z
Original restored
TC-3.3.2
Cmd+Z works in Slack
Fix text in Slack, press Cmd+Z
Original restored
4. Keyboard Shortcut Tests
ID
Test Case
Input
Expected Output
TC-4.1.1
Default works
Press Cmd+Shift+D with text focused
Correction triggered
TC-4.1.2
Works in any app
Test in Safari, Notes, Slack, Mail, VS Code
Works in all
TC-4.1.3
No conflict with system
Press default shortcut
No system action triggered
ID
Test Case
Input
Expected Output
TC-4.2.1
Can change shortcut
Set to Cmd+Shift+F in settings
New shortcut works
TC-4.2.2
Old shortcut disabled
After changing, press old shortcut
Nothing happens
TC-4.2.3
Invalid shortcut rejected
Try to set Cmd+C
Error: "This shortcut is reserved"
TC-4.2.4
Shortcut persists
Change shortcut, quit, relaunch
Custom shortcut still active
5. Menu Bar UI Tests
ID
Test Case
Input
Expected Output
TC-5.1.1
Idle state
App running, no activity
Static icon displayed
TC-5.1.2
Loading state
Trigger correction
Spinner/animation shown
TC-5.1.3
Error state
API fails
Error indicator on icon
TC-5.1.4
Permission warning
No accessibility permission
Warning badge on icon
5.2 Dropdown Menu
ID
Test Case
Input
Expected Output
TC-5.2.1
Menu opens
Click menu bar icon
Dropdown appears
TC-5.2.2
History displayed
Have 3 corrections
All 3 shown with original → fixed
TC-5.2.3
History truncated
Correction with 200 chars
Shown truncated with "..."
TC-5.2.4
Settings accessible
Click "Settings"
Settings window opens
TC-5.2.5
Quit works
Click "Quit"
App terminates
ID
Test Case
Input
Expected Output
TC-5.3.1
Shortcut field works
Click and press new shortcut
Shortcut captured and saved
TC-5.3.2
Settings persist
Change settings, quit, relaunch
Settings retained
6. AI Integration Tests (Groq)
ID
Test Case
Input
Expected Output
TC-6.1.1
Successful request
Valid text, API available
Corrected text returned
TC-6.1.2
API key missing
No API key configured
Clear error message
TC-6.1.3
API timeout
Simulate 35s delay
Timeout after 30s, error shown
TC-6.1.4
Rate limit hit
Trigger rate limit
Friendly error, retry suggestion
ID
Test Case
Input
Expected Output
TC-6.2.1
Short text fast
"teh" (3 chars)
Response < 500ms
TC-6.2.2
Medium text acceptable
200 chars
Response < 1000ms
TC-6.2.3
Large text acceptable
2000 chars
Response < 3000ms
ID
Test Case
Input
Expected Output
TC-6.3.1
French
"je suis contant de te voir"
"Je suis content de te voir"
TC-6.3.2
Spanish
"holla como estas"
"Hola, ¿cómo estás?"
TC-6.3.3
German
"ich gehe nach hause"
Properly corrected German
TC-6.3.4
Mixed language
"Hey, ça va bien?"
Both languages preserved
6.4 Deterministic and Contextual Disambiguation
ID
Test Case
Input
Expected Output
TC-6.4.1
Identical input is stable across retries
Run same input 20x in a row
Output text is identical each run
TC-6.4.2
Core note/not ambiguity regression
"The si the foithb ntot"
Corrected text contains "note" (not "not")
TC-6.4.3
Deterministic decode config is present
Inspect request body in unit test
temperature=0, top_p=1, n=1
TC-6.4.4
Contextual prompt contract is present
Inspect system prompt in unit test
Prompt includes contextual disambiguation rules and examples
6.5 Ambiguous Phrase Regression Set (Manual) Run each phrase at least 5 times and record pass/fail consistency.
ID
Input Phrase
Expected Check
TC-6.5.1
"The si the foithb ntot"
Output contains "fourth note"
TC-6.5.2
"This is teh fith ntot"
Output contains "fifth note"
TC-6.5.3
"I left a ntot on your desk"
Output contains "note"
TC-6.5.4
"Pleas raed teh ntot befor class"
Output contains "read the note before class"
TC-6.5.5
"write a quik ntot for me"
Output contains "quick note"
TC-6.5.6
"I made a shrot ntot"
Output contains "short note"
TC-6.5.7
"I cnat find teh file"
Output contains "can't find the file"
TC-6.5.8
"we shoudl meet tmrw"
Output contains "should meet tomorrow"
TC-6.5.9
"he siad he woudl come"
Output contains "said he would come"
TC-6.5.10
"send teh meting ntos soon"
Output contains "meeting notes"
ID
Test Case
Input
Expected Output
TC-6.6.1
Short text not chunked
"teh quick fox" (< 300 chars)
Single API call, no chunking
TC-6.6.2
Long multi-sentence text chunked
300+ chars with 3 sentences
Split into sentence-level chunks, corrected in parallel
TC-6.6.3
Adjacent short sentences merged
Two 50-char sentences
Merged into single chunk (<= 280 chars combined)
TC-6.6.4
Oversized sentence split at clause
300+ char single sentence with ,
Split at clause boundary near midpoint
TC-6.6.5
Recursive clause splitting
600+ char sentence with multiple clauses
All sub-chunks <= 280 chars
TC-6.6.6
URL healing merge
Sentence with URL containing ?
URL not split across chunks
TC-6.6.7
Reassembly preserves gaps
Chunked text with varying whitespace
Original whitespace between sentences preserved
TC-6.6.8
Single long sentence no delimiters
400+ chars, no clause delimiters
Falls back to single-call with medium reasoning
6.7 Multi-line List Detection
ID
Test Case
Input
Expected Output
TC-6.7.1
Bullet list detected
"- item1\n- item2\n- item3"
Each item corrected independently without prefix
TC-6.7.2
Numbered list detected
"1. item1\n2. item2"
Each item corrected independently without prefix
TC-6.7.3
Mixed types not detected
"- item1\n1. item2"
Falls through to normal correction
TC-6.7.4
Single item not detected
"- only one item"
Falls through to normal correction
TC-6.7.5
Prefixes and gaps preserved
"- item1\n\n- item2"
Original prefixes and blank lines restored
6.8 Boundary Quote Restoration
ID
Test Case
Input
Expected Output
TC-6.8.1
Leading double quote restored
"hello wrold""hello world" — leading " preserved
TC-6.8.2
Guillemets restored
«bonjour»Boundary guillemets preserved
TC-6.8.3
Single quotes excluded
'don't worry'No false restoration (apostrophe overlap)
ID
Test Case
Input
Expected Output
TC-6.9.1
Notes multi-line list preserved
Notes bullet list with \t•\t prefixes
List structure preserved, items corrected individually
TC-6.9.2
Notes text skips bullet stripping
Multi-line Notes text
normalizeCapturedTextForCorrection skips prefix stripping so parseMultiLineList handles it
ID
Test Case
Input
Expected Output
TC-7.1.1
Log created on correction
Make one correction
Row added with device_id, timestamp, tokens
TC-7.1.2
Device ID consistent
Multiple corrections
Same device_id for all
TC-7.1.3
Token count accurate
Fix "hello world"
Reasonable token count logged
TC-7.1.4
Failed requests logged
API failure
Row added with success=false
ID
Test Case
Input
Expected Output
TC-7.2.1
History saved
Make correction
Row in correction_history table
TC-7.2.2
Original and fixed stored
Fix "teh" → "the"
Both values in row
TC-7.2.3
Revert flag updated
Revert a correction
reverted=true in row
ID
Test Case
Input
Expected Output
TC-7.3.1
DB created on first launch
Fresh install
Database file exists
TC-7.3.2
DB survives app restart
Add data, quit, relaunch
Data still present
TC-7.3.3
DB handles concurrent writes
Rapid corrections
No corruption or errors
8. Accessibility Permission Tests
ID
Test Case
Input
Expected Output
TC-8.1.1
Permission prompt on launch
First launch, no permission
Onboarding window shown
TC-8.1.2
Deep link works
Click "Open System Preferences"
Correct pane opens
TC-8.1.3
Permission detected
Grant permission
App detects and shows success
TC-8.1.4
Graceful without permission
Deny permission, try shortcut
Helpful error, link to settings
ID
Test Case
Input
Expected Output
TC-8.2.1
Message clarity
Read onboarding text
Clear that it's user-triggered only
TC-8.2.2
No storage mentioned
Read onboarding text
Clear that no text is stored
ID
Test Case
Input
Expected Output
TC-9.1.1
API down
Disconnect network, trigger
"Couldn't connect" notification, text preserved
TC-9.1.2
Read-only field
Focus read-only field, trigger
"This text field is read-only" notification
TC-9.1.3
Unsupported app
App without accessibility support
"This app isn't supported" notification
TC-9.1.4
Empty response from API
API returns empty string
Original text preserved, error logged
ID
Test Case
Input
Expected Output
TC-9.2.1
Very short text
"a"
Processed without error
TC-9.2.2
Exactly at limit
5000 chars
Processed without alert
TC-9.2.3
Just over limit
5001 chars
Alert shown asking to select less text
TC-9.2.4
Special characters
"hello @user #tag $100"
Special chars preserved
TC-9.2.5
Unicode/emoji
"café ☕ naïve"
Unicode preserved correctly
10. App Compatibility Tests
ID
Test Case
App
Expected Result
TC-10.1.1
Notes
Apple Notes
Full functionality
TC-10.1.2
Mail
Apple Mail
Full functionality
TC-10.1.3
Messages
iMessage
Full functionality
TC-10.1.4
TextEdit
TextEdit
Full functionality
ID
Test Case
App
Expected Result
TC-10.2.1
Slack
Slack desktop
Full functionality
TC-10.2.2
VS Code
Visual Studio Code
Full functionality
TC-10.2.3
Chrome
Google Chrome text fields
Full functionality
TC-10.2.4
Safari
Safari text fields
Full functionality
TC-10.2.5
Notion
Notion desktop
Test and document behavior
TC-10.2.6
Google Docs
Chrome/Safari
Test and document behavior
Known Limitations to Document Automated vs Manual Tests Automated (Unit/Integration Tests)
TC-2.x (Text replacement logic - mock API)
TC-6.2.x (Response timing)
TC-6.4.3, TC-6.4.4 (deterministic decode and prompt contract)
TC-6.6.x (Sentence chunking logic)
TC-6.7.x (Multi-line list detection)
TC-6.8.x (Boundary quote restoration)
TC-7.x (Database operations)
TC-1.1.x, TC-1.2.x (Cross-app text capture)
TC-4.x (Global keyboard shortcuts)
TC-5.x (UI visual verification)
TC-6.4.1, TC-6.4.2, TC-6.5.x (determinism and ambiguity regression)
TC-8.x (System permission flow)
TC-10.x (App compatibility)