ASTM F3548 UTM aggregate checks

scenarios.astm.utm.AggregateChecks

Resources

KML visualization

Case Step Event airmarket onesky sait sandbox
1 📓 all_queries: 2125
2 📓 airmarket/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 9, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 87, astm.f3548.v21.uss.getOperationalIntentDetails: 61, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 27, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 47, astm.f3548.v21.uss.makeUssReport: 1
3 📓 sait/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 86, astm.f3548.v21.uss.getOperationalIntentDetails: 61, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 27, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 47, astm.f3548.v21.uss.makeUssReport: 1
4 📓 sandbox/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 87, astm.f3548.v21.uss.getOperationalIntentDetails: 61, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 27, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 47, astm.f3548.v21.uss.makeUssReport: 1
5 📓 onesky/attributed_queries: interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 9, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 29, astm.f3548.v21.uss.getOperationalIntentDetails: 14, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 17, astm.f3548.v21.uss.makeUssReport: 1
Performance of SCD requests to USS Performance of successful operational intent details requests 10 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
11 📓 airmarket/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 61 queries, 95th percentile: 0.123s
12 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
13 📓 sait/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 61 queries, 95th percentile: 0.109s
14 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
15 📓 sandbox/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 61 queries, 95th percentile: 0.131s
16 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
17 📓 onesky/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 14 queries, 95th percentile: 0.176s
Interoperability test instance is available Interoperability test instance is available 22 📓 test_interop_interactions: Found 125 interactions with interoperability test instance for airmarket
23 ✅ Interoperability test instance is available ✅
24 📓 test_interop_interactions_1: Found 123 interactions with interoperability test instance for sait
25 ✅ Interoperability test instance is available ✅
26 📓 test_interop_interactions_2: Found 124 interactions with interoperability test instance for sandbox
27 ✅ Interoperability test instance is available ✅
28 📓 test_interop_interactions_3: Found 57 interactions with interoperability test instance for onesky
29 ✅ Interoperability test instance is available ✅
Notifications to operator Notifications for causing conflicts 33 📓 airmarket/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
34 ✅ Notifications for causing conflicts ✅
35 📓 sait/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
36 ✅ Notifications for causing conflicts ✅
37 📓 sandbox/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
38 ✅ Notifications for causing conflicts ✅
Notifications for observing conflicts 39 ✅ Notifications for observing conflicts ✅

IndexError at 2026-07-28T02:58:22.660751Z

Message: list index out of range

Stack trace:

Traceback (most recent call last):
  File "/app/monitoring/uss_qualifier/suites/suite.py", line 167, in _run_test_scenario
    scenario.run(context)
    ~~~~~~~~~~~~^^^^^^^^^
  File "/app/monitoring/uss_qualifier/scenarios/astm/utm/aggregate_checks.py", line 102, in run
    self._check_notification_latencies(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        context,
        ^^^^^^^^
    ...<3 lines>...
        "conflicts affecting the operator's flights",
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/app/monitoring/uss_qualifier/scenarios/astm/utm/aggregate_checks.py", line 230, in _check_notification_latencies
    median_latency = latency_list[
                     ~~~~~~~~~~~~^
        int((len(latency_list) + 1) / 2)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ].total_seconds()
    ^
IndexError: list index out of range