SPB Git

Repository Public

QA.md 5.1 KB

# QA — what was tested, how, and what was not

All results below were produced on 2026-11-18 on a MacBook Pro (macOS 27.0, Xcode 27.2), simulators on iOS 26.5. Logs: build/logs/ (not committed).

# Automated tests

Suite Command Result
Unit (44) swift test passed — timebase, ink codec, timeline index, edits and time map, silence / retake / chapters, auto-pause, captions, package and migration, event log, ZIP, library, PDF and ink rendering, annotated PDF, compositor, audio renderer, loudness, transcription helpers, remote client (stubbed HTTP), encrypted bundle, tus upload (stubbed server)
Integration (16) swift test passed — export decoded and checked for ink timing and A/V sync, edited export + undo + re-export, cancellation, HEVC, missing media, recording engine (segments, pause, pre-roll, route change, interruption, policies, PDF-only), crash recovery (on-disk copy and real SIGKILL), real microphone
90-minute export scripts/test-all.sh --long passed — see below
UI, iPhone simulator (2) scripts/test-ui.sh iphone passed
UI, iPad simulator (2) scripts/test-ui.sh ipad passed
UI, Mac (1) scripts/test-ui.sh mac passed — mouse stroke on the slide, page change, undo/redo, inspector, annotated-PDF export (window screenshots reviewed)

# Acceptance tests

# Requirement Status Evidence
1 macOS offline: 20-page PDF, mic + live annotations 10 min, pause/resume, reopen, edit, 1080p MP4, verify Passed in short form The in-app self-test ran the whole chain on macOS with the real microphone: 20 pages, 16.2 s recorded in 2 segments (audio −32 dBFS), scripted annotations, pause/resume, reopen, cut, 1080p H.264 export decoded, ink on time, originals unchanged. Mouse drawing through the real window is covered by the Mac UI test. Not done: a full 10-minute spoken session (the scripted run lasts 16 s; duration scaling is covered by the 90-minute synthetic test).
2 iPadOS offline with PencilKit and Apple Pencil on a real device Simulator only Self-test and UI test pass on the iPad simulator (PencilKit strokes drawn by simulated touches, microphone = the Mac's). No real iPad, no Apple Pencil: pressure, tilt, hover, palm rejection untested.
3 iOS offline with touch annotation and iPhone microphone, portrait / landscape Simulator only Same on the iPhone simulator, including rotation while recording (screenshots reviewed for both orientations). No real iPhone.
4 Annotated PDF matches the final annotation state, source PDF untouched Passed testAnnotatedPDFMatchesFinalStateAndLeavesSourceUntouched, self-test on 3 platforms
5 Interrupted capture: recover finalized segments, no false claim Passed testCrashRecovery (75 s of 75 s on-disk state), testRealProcessKillRecovery (SIGKILL: 8.3 s recovered = exactly the decodable frames)
6 90-minute synthetic timeline, A/V sync, memory / disk Passed 162 000 frames, sync within 3 ms at 89:59, 99 s wall, peak RSS 600 MB, project 520 MB (16-bit PCM), output 27.5 MB at 640×360
7 No network: core features usable; optional features explain prerequisites Passed by construction and test No network call exists in record/edit/export; providers return typed "unavailable" reasons shown in the UI (testProjectTranscriberPlacesChunksOnTheTimeline, testRemoteProviderRequestRetryAndErrors). Not tested with the network physically off.
8 Permissions denied: guidance and PDF-only mode Passed (engine + macOS self-test) testPDFOnlyModeRecordsAndExportsWithoutAudio; the macOS self-test ran in PDF-only mode. The alert itself was not exercised by a UI test.
9 Nondestructive editing: undo cuts, recover originals, re-export Passed testEditedExportThenUndoAndReexport, testHistoryIsReversible, self-test step 8 (checksums of originals unchanged)
10 Build and test logs for macOS and iOS Passed scripts/build-all.sh (4/4 OK), scripts/test-all.sh --ui (ALL PASSED)

# Never verified (needs hardware or a person)

  • Any real iPhone or iPad; Apple Pencil; iPhone/iPad microphones and cameras; lock screen and background recording on a device; incoming call interruption on a device; Bluetooth route changes on a device; thermal and battery behaviour over a long session.
  • The camera path end to end (capture → segment → picture-in-picture in the export): compositing is unit-tested with a synthetic image; no camera was opened.
  • On-device speech recognition (transcription, voice commands): the code path was never run with a real recognizer.
  • The remote transcription and upload clients against real servers (only in-process stubs).
  • macOS: shape tools, eraser, laser pointer, zoom/pan gestures, menus and keyboard shortcuts; a second window; the presentation window on a second display; VoiceOver on any platform; Dynamic Type at large sizes; the Intel slice of the universal binary.
  • 1080p / 4K export time and memory on a real 90-minute lecture; disk-full during export (the error path is coded, not provoked).
Files main
Menu

Theme