AI-assisted voice capture inspection notes

A phone/tablet companion the inspector keeps open during the site visit. Records audio locally, transcribes on-device, and an LLM parses the messy spoken notes into clean structured fields the inspector can review, tweak, and copy/paste back into the SDCI desktop notes application at the end of the day.

Inspector tool Mobile / tablet Local-first audio LLM summarization Wireframe v0.1
01 · INSPECTOR

Pick the inspection

Today's route, pulled from seattle_permits where date_scheduled = today.

02 · DEVICE (LOCAL)

Record on-site

Audio captured + on-device transcription. Nothing leaves the phone yet.

03 · LLM

Parse to structured notes

Transcript → JSON: items checked, code refs, pass/fail, follow-ups, photos to attach.

04 · INSPECTOR

Review & edit

Inspector confirms each AI-extracted field. Low-confidence items are flagged.

05 · DESKTOP

Copy → paste into SDCI app

Single "Copy clean note" button produces the formatted block for the legacy desktop.

01 · TODAY
9:14 AM●●●● 4G 87%
Today · Tue Apr 28
5 inspections · District 3
9:30 · Up next
BLDG24-1042 · 1422 E Pine St
Framing — SFR ADU
11:00
BLDG24-0871 · 312 N 41st
1:00 PM
MEC24-2210 · 4500 Roosevelt
+ 2 more
Start 9:30 →
02 · RECORDING
REC 04:21○ 87%
BLDG24-1042 · Framing
1422 E Pine St · audio stays on device
Live transcript
You: "OK, walking around the rear deck, the joist hangers on the south side are missing the required nails…"
You: "…also the egress window in bedroom two looks under-sized, gonna measure that…"
04:21
⏸ Pause
📷 Photo
■ Stop
03 · REVIEW — the most important screen
9:48 AM○ 86%
Parsed notes · 12 min audio
Tap any field to edit · ▷ replays from local audio
AI extracted
Result 98%
Partial pass · 2 corrections
Items inspected 94%
Framing · Joist hangers · Egress window
Correction 1 MAJOR 76%
Joist hangers missing required nails
South side, rear deck · per SBC 2308.4
▷ 03:21 — "…the joist hangers on the south side don't have the full nail pattern, looks like only 4 of the 8 required…"
edit ▷ play 📷 1 photo
Correction 2 MINOR 52%
Egress window may be undersized
BR2 · 5.7 sqft min · needs measurement
▷ 08:14 — "…BR2 egress, I eyeballed it, looks borderline. Owner to verify with tape…"
low confidence — verify ▷ play
Follow-up 90%
Permit owner to measure BR2 egress, schedule re-inspection in ~14 days
AI confident
Needs a glance
Inspector edited
↻ Re-parse
▷ Play full
Looks good →
Raw transcript
Audio transcript · 4 min
On-device transcription of inspector walkthrough

[00:00]"Alright, starting the framing inspection at 1422 East Pine. This is BLDG24-1042, single family with the ADU addition. Let me walk around the exterior first."

[01:15]"OK front of the house looks good, framing is solid on the north side. Headers look properly sized. Let me check the Simpson ties… yeah those are good."

[02:48]"Moving around to the back now, looking at the rear deck. The ledger board attachment looks fine, lag bolts are there…"

[03:21]"OK so the joist hangers on the south side of the rear deck — they don't have the full nail pattern. Looks like only about 4 of the 8 required nails in each hanger. That's going to need a correction per SBC 2308.4. Let me snap a photo of this one."

[04:10]"Rest of the deck framing looks OK. Beam connections are good. Going inside now."

[05:30]"Inside the main floor, walls are framed correctly. Let me check the bedrooms. Bedroom one, egress window looks good, plenty of clear opening."

[08:14]"Bedroom two now. The egress window in here… it looks borderline to me. I'm going to eyeball it at maybe 5 square feet and we need 5.7 minimum. I have my tape measure... it's 5.5. Under, they'll have to swap it out."

04 · COPY OUT
9:51 AM○ 86%
Ready for desktop
Formatted for SDCI notes app
RESULT: PARTIAL PASS
DATE: 2026-04-28 09:30

ITEMS INSPECTED:
- Framing (rear deck, BR2 egress)

CORRECTIONS REQUIRED:
1. Joist hangers on south side
   rear deck missing required
   nails per SBC 2308.4.
2. Egress window BR2 below
   5.7 sqft min — to swap out.

RE-INSPECTION: in 14 days
⧉ Copy clean note
Save draft & next →

Audio handling — strict

  • Audio file never leaves the device — only the transcript text and parsed JSON sync.
  • On-device transcription (Whisper-mobile or Apple Speech). No raw audio to OpenAI / Anthropic.
  • Audio auto-deletes 7 days after the session is marked copied (configurable).
  • Inspector can play back audio from the device only — review screen has a "jump to 03:21" link, not a streaming URL.
  • Owner-present consent screen if the inspector taps record in someone's home (WA two-party consent).

Open questions for the team

  • Do we need to round-trip back into the SDCI desktop app via API, or is copy/paste good enough for v1?
  • Should the LLM be allowed to cite specific code sections, or only echo what the inspector said?
  • Two-party consent: opt-in screen at start of every recording, or once per inspection day?
  • What's the right level of structure — full JSON, or just a clean prose block?
  • Re-parse capability: useful, or risky once the inspector has hand-edited fields?
  • Tablet vs phone — same UI, or a denser side-by-side layout on iPad?