IssueTracker

It's cumbersome to deal with misconfigured data in CI (hitting this again when compose benchmarks were configured incorrectly in non-obvious way) - we should fail by default when misconfigured, so it's easier to track down incorrectly configured tests.

We'll make this setting configurable, since we don't want to entirely block folks without a real device to run benchmarks, but defaults are important.

Need to hit zero warnings in CI before we can land this.