Skip to content

Benchmarks

Real measurements from the test app (30 stories completed across the Ralph Loop):

Feature complexityTimeCrashesManual interventions
Simple (search, toggle, store)3-5 min00
Medium (forms, charts, lists)5-10 min00
Complex (3-step wizard, onboarding)11-25 min00
4-feature batch verification~2 min00
PhaseTypical time
1-3 (Discovery, Exploration, Questions)~3 min
4 (Architecture)~1 min
5 (Implementation)~5 min
5.5 (Live verification)~5 min
6 (Code review + fixes)~4 min
7-8 (Summary + E2E proof)~2 min

All libraries below were successfully integrated and verified through the pipeline:

LibraryStory type
react-hook-formForm wizard
zodValidation
@tanstack/react-queryData fetching
@gorhom/bottom-sheetBottom sheet
@shopify/flash-listHigh-performance list
zustandState management
react-native-svgCharts
expo-notificationsPush notifications
react-native-reanimatedAnimations
react-native-gesture-handlerGestures
expo-hapticsHaptic feedback

Optimized device interaction latency via the fast-runner (XCTest HTTP server):

OperationLatencyImprovement
Tap~216ms13x faster than CLI
Snapshot (accessibility tree)~5ms100x faster
Screenshot~74ms4x faster
Per-step overhead~1.4svs ~3.1s baseline

The XPC floor (~210ms) is the hard limit for _XCT_synthesizeEvent — further tap optimization requires Apple framework changes.

TierPathWhen used
1fast-runner (XCTest HTTP)Default iOS path
2agent-device daemonfast-runner unavailable
3agent-device CLIDaemon unavailable