Marathon Cloud vs Firebase Test Lab
Firebase Test Lab runs instrumentation tests through gcloud or the Firebase Console: $1 per hour per Android virtual device, $5 per hour for the physical devices that iOS requires, with runs capped at 45 minutes on physical and 60 minutes on virtual devices. Marathon Cloud runs Android emulators and iOS simulators at $2 and $3 per hour billed per second, with no hard cap on total suite duration.
| Firebase Test Lab | Marathon Cloud | |
|---|---|---|
| Run timeout | 45 minutes on physical devices, 60 minutes on virtual devices. | 300 seconds per test by default; no hard cap on total suite duration. |
| Retries | --num-flaky-test-attempts reruns the whole test execution on a device when any test case fails, a fixed number of times. | Failed tests rerun on a different device; tests with a flaky history are retried preventively. |
| Sharding | gcloud beta flags --num-uniform-shards and --test-targets-for-shard. | Device pool sized from your suite's history, targeting 15 minutes per run. |
| Android pricing | $1 per hour per virtual device. | $2 per hour per Android device, billed per second. |
| iOS pricing | $5 per hour; iOS runs on physical devices only. | $3 per hour per iOS simulator, billed per second. |
| Setup | gcloud CLI or Firebase Console; Flank is optional. | One CLI command with the app and test bundle. |
| Getting started | Self-serve through a Google Cloud project; pay-as-you-go with per-project device quotas. | Self-serve: sign up, 50 free device hours, no credit card, one CLI command. No parallel count to buy — the pool is sized per run. |
Competitor facts verified 2026-09-29 from the vendor's public pages.
A Firebase Test Lab alternative for teams that run the whole suite on every pull request
Firebase Test Lab caps instrumentation runs at 45 minutes on physical and 60 minutes on virtual devices, and its flaky-test flag reruns the whole execution on a device. Marathon Cloud retries only the failing test, driven by its history, sizes the device pool from your suite’s history to target 15 minutes, and puts no hard cap on total suite duration.
Choose Firebase Test Lab when
- You want Android virtual devices at $1 per hour, pay-as-you-go through a Google Cloud project.
- You want iOS tests on physical devices.
- You already drive CI with gcloud and want sharding as gcloud flags.
Choose Marathon Cloud when
- You want a flaky test retried on its own, not the whole execution rerun on a device.
- You want iOS on simulators at $3 per hour instead of physical devices at $5 per hour.
- You want no run cap of 45 or 60 minutes, with the pool sized to target 15 minutes.
What a run costs on Marathon Cloud
A suite with 120 minutes of total test time runs on 8 devices for about 15 minutes: 2 device-hours, $4.00 on Android or $6.00 on iOS.