feat: scene intelligence — AI crash scene analyzer with Gemini Vision by Abirami-2743 · Pull Request #103 · NITISH-R-G/RoadSOS

Abirami-2743 · 2026-05-16T12:40:28Z

Description

Adds Scene Intelligence screen for responders to capture and analyze crash scenes using AI.

Capture photo via camera or gallery
Gemini Vision AI analyzes scene and returns structured assessment
Shows severity level (CRITICAL/HIGH/MODERATE/LOW)
Lists vehicles involved, visible injuries, immediate risks
Recommends step-by-step responder actions
One-tap call buttons for 108/101/100
Graceful offline fallback with standard rescue procedure

Type of change

New feature (non-breaking change which adds functionality)

How Has This Been Tested?

Manual Smoke Test (on physical device)

Checklist

My code follows the style guidelines of this project
I have performed a self-review of my own code
My changes generate no new warnings

Phase 3 - Edge AI Integration: - Complete AiTriageService with llamadart FFI model loading and <|think|> prompting - Model path discovery (scans documents dir for .gguf files) - Graceful degraded mode when no model present (keyword-based fallback) - LocationService with GPS + dead-reckoning 60s history cache Emergency Orchestrator (new): - Full SOS pipeline: GPS lock → AI triage → DB write → connectivity cascade - 10-second audible countdown for false-positive cancellation - SOSState lifecycle: idle → countdown → gps → triage → dispatch → active → resolved - Connectivity cascade: Supabase cloud → SMS 112 → BLE mesh broadcast Production UI: - Animated pulsing SOS button with radial gradient and glow - SOSCountdownWidget with animated ring painter - TriageResultCard with severity badge, service chips, first-aid guidance - StatusIndicatorBar (GPS/AI/Sync status chips) - Full dashboard with 5 lifecycle views (idle/countdown/processing/active/resolved) - Live event log with timestamps Bug fixes: - Fixed misplaced import in main.dart (was inside class scope) - Fixed main.dart import ordering - Added dark theme as default with Google Blue seed color Team: CODESTREAK | Hackathon: Gemma 4 Good

…p integration

…unded AI

- Added AUDIT_REPORT.md containing deep forensic review of architecture. - Secured Supabase/PowerSync credentials by moving to .env. - Implemented anonymous auth fallback for PowerSync to enable offline sync. - Added extensive codebase warnings (Mesh, Crash, Triage) reflecting audit findings. Co-authored-by: NITISH-R-G <225521762+NITISH-R-G@users.noreply.github.com>

…0179640712131 Security Audit & Initial Architectural Fixes

…and documented

…tant Service

…plainable AI

…Disclosure (AES), Vital Scan (Gemma Pulse), Offline Mesh Chat, and Hardened SOS Recovery. Refactored CI/CD pipeline.

This workflow file sets up CodeQL analysis for the repository, specifying triggers for pushes and pull requests on the main branch, as well as a scheduled analysis. It includes a matrix for different programming languages and build modes.

Removed the .env file from the assets section.

Made-with: Cursor

Use SOSPhase for blood-red theme; document family-track in supabase README; borderSubtle getter; run family link before activity log for accurate channel snapshot. Made-with: Cursor

Cursor/family tracking live links

* fix(deps): resolve pubspec constraints Made-with: Cursor * audit: replace simulated features with real/honest flows Made-with: Cursor * chore: remove unused ai agent orchestrator Made-with: Cursor * audit-fixes: remove placeholders, add Safe Walk check-in Make SOS status wording honest (on-device log), add Safe Walk check-in notification/actions, improve offline map download controls, and gate Nearby SOS opt-in when Firebase isn’t configured. Made-with: Cursor * fix: remove simulated UI and make dispatch/config honest Rewire First Aid to real offline corpus lookup, remove misleading SOS overlay status, wire mesh settings to a real screen, and make crash/SMS/map links configurable via env. Made-with: Cursor * fix: unblock web release build Co-authored-by: NITISH-R-G <NITISH-R-G@users.noreply.github.com> * fix: make SOS/triage/mesh flows honest and safer - Parallelize SOS dispatch channels and rename local incident logging - Clarify SMS relay/device results as request acceptance (not delivery proof) - Move Gemini triage + assistant prompts to Supabase Edge Functions - Add tier-2 local triage model and upgrade mesh encryption to AES-GCM - Remove simulated responder dashboard content; use real SOS + mesh signals - Store medical profile in secure storage; soften misleading ETA placeholder Made-with: Cursor --------- Co-authored-by: Cursor Agent <cursoragent@cursor.com> Co-authored-by: NITISH-R-G <NITISH-R-G@users.noreply.github.com>

Fixes #22. Made-with: Cursor

Made-with: Cursor Co-authored-by: Nitish R G <NITISH-R-G@users.noreply.github.com>

Made-with: Cursor

- Stop bundling secrets as assets; bootstrap config via dart-defines/local .env - Encrypt SOS activity log at rest and reduce precision in UI - Wire extended retention consent into incident persistence - Add reported_incidents schema + RLS migration; harden Edge function triggers - Make tests stable on desktop by disabling BLE scan on unsupported platforms Made-with: Cursor

* mesh radar modification * updation of scene intelligence --------- Co-authored-by: vijay-125ni <vijaybashkaran.12142005@gmail.com>

Bumps [build_runner](https://github.com/dart-lang/build) from 2.13.1 to 2.14.1. - [Release notes](https://github.com/dart-lang/build/releases) - [Commits](dart-lang/build@build_runner-v2.13.1...build_runner-v2.14.1) --- updated-dependencies: - dependency-name: build_runner dependency-version: 2.14.1 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [flutter_dotenv](https://github.com/java-james/flutter_dotenv) from 6.0.0 to 6.0.1. - [Changelog](https://github.com/java-james/flutter_dotenv/blob/master/CHANGELOG.md) - [Commits](java-james/flutter_dotenv@6.0.0...6.0.1) --- updated-dependencies: - dependency-name: flutter_dotenv dependency-version: 6.0.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…le, and docs

…Siren)

…fication service

NITISH-R-G and others added 30 commits April 17, 2026 19:57

Initial commit

0bd7501

Update project name in README

722fafc

feat: setup Supabase credentials and hardware SOS triggers

5489fc4

feat: implement hybrid offline-first architecture with Gemma 4 and ma…

a4d1852

…p integration

chore: harden application with real sensors, mesh networking, and gro…

a7d0eee

…unded AI

Merge pull request #1 from NITISH-R-G/audit-and-security-fixes-574306…

3750d1f

…0179640712131 Security Audit & Initial Architectural Fixes

chore: sync with upstream and implement RoadSOS V2.0 hardening

19b3a35

feat: RoadSOS V3.0 Enterprise Tier - DevOps, Scalability, and Tiered AI

923a0ff

chore: repository excellence transformation - structural, automated, …

2b53ffe

…and documented

feat: RoadSOS V4.0 AI Dominance - Gemma Telemetry Synthesis and Assis…

de46745

…tant Service

feat: RoadSOS V5.0 Global Infrastructure - Agent Orchestration and Ex…

fd0de19

…plainable AI

RoadSOS V8.0: The Guardian Ecosystem Implementation. Includes Scoped …

c6f0dec

…Disclosure (AES), Vital Scan (Gemma Pulse), Offline Mesh Chat, and Hardened SOS Recovery. Refactored CI/CD pipeline.

Add CodeQL analysis workflow

1883931

This workflow file sets up CodeQL analysis for the repository, specifying triggers for pushes and pull requests on the main branch, as well as a scheduled analysis. It includes a matrix for different programming languages and build modes.

feat: add vehicle rescue guide screen with offline data

35fc2dc

Fix method name case for triggerSOS

b529eb7

Fix method name casing for triggerSos

1bb6f2a

Refactor SOS methods and update map widget

68802ed

Add SOS trigger and cancel methods

fae4b1e

Fix method name casing for triggerSOS

042efae

Fix method name from triggerSos to triggerSOS

92951c2

Update dashboard.dart

7caf906

Refactor CodeQL workflow to include only actions language

30727b0

Update main.yml

a506319

Update ai_triage_service.dart

4ea32a2

Fix formatting issue in ai_triage_service.dart

30fceb9

Update emergency_orchestrator.dart

b4a52fe

Fix case sensitivity in severityLevel logging

1191d3e

Fixing in pubspec

e13ad85

Removed the .env file from the assets section.

NITISH-R-G and others added 25 commits April 28, 2026 10:43

feat: family live links, tracking service, theme tokens, Supabase edge

af45c29

Made-with: Cursor

ux: wire emergency theme to orchestrator + family link channel order

dc6fd29

Use SOSPhase for blood-red theme; document family-track in supabase README; borderSubtle getter; run family link before activity log for accurate channel snapshot. Made-with: Cursor

Merge pull request #20 from NITISH-R-G/cursor/family-tracking-live-links

b92efea

Cursor/family tracking live links

fix: align setup script with assets/.env (#23)

ebefd08

Fixes #22. Made-with: Cursor

chore: add verify script (analyze + tests) (#24)

3972592

Made-with: Cursor Co-authored-by: Nitish R G <NITISH-R-G@users.noreply.github.com>

chore: make verify script output UTF-8 friendly (#25)

9dff4d6

Made-with: Cursor

Modify mesh radar functionality (#29)

be77bb3

* mesh radar modification * updation of scene intelligence --------- Co-authored-by: vijay-125ni <vijaybashkaran.12142005@gmail.com>

fix: resolve merge conflict

8ec513d

feat: add vehicle rescue to safety tools sheet

eea5754

feat: add vehicle rescue screen with offline guide

7fae640

fix: wire up 108 call button in vehicle rescue screen

21f4e55

fix: resolve pubspec.yaml merge conflicts

2fbed37

fix: regenerate corrupted pubspec.lock

6089787

fix: resolve all merge conflicts with origin/main

993f2ad

fix: resolve remaining merge conflicts in AndroidManifest, build.grad…

b6fe268

…le, and docs

feat: implement multi-contact SOS dispatch and UI support

d1a1ac8

feat: implement Beacon of Life autonomous hardware SOS (Flashlight + …

b916a69

…Siren)

merge: resolve conflicts with main and integrate beacon with new noti…

8882870

…fication service

fix: upgrade torch_light version to resolve CI build failure

af0cd61

chore: merge main into scene-intelligence branch

b822043

feat: add scene intelligence screen with AI crash analysis

da2c9e0

Abirami-2743 requested a review from NITISH-R-G as a code owner May 16, 2026 12:40

Abirami-2743 added 3 commits May 16, 2026 18:13

fix: dart format scene intelligence screen

8f79149

fix: dart format all files

434cdbb

fix: align namespace and applicationId with Kotlin package name

122d82d

NITISH-R-G mentioned this pull request May 17, 2026

chore: PR cleanup — consolidate Gemma mirrors, CORS fix, AGENTS.md, tests #116

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: scene intelligence — AI crash scene analyzer with Gemini Vision#103

feat: scene intelligence — AI crash scene analyzer with Gemini Vision#103
Abirami-2743 wants to merge 84 commits into
mainfrom
feature/scene-intelligence-abie

Abirami-2743 commented May 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

Abirami-2743 commented May 16, 2026

Description

Type of change

How Has This Been Tested?

Checklist

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants