ASTM F3548 UTM aggregate checks

scenarios.astm.utm.AggregateChecks

Resources

KML visualization

Case Step Event airmarket onesky sait sandbox
1 📓 all_queries: 2717
2 📓 airmarket/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 57, astm.f3548.v21.uss.getOperationalIntentDetails: 44, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 21, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 59, astm.f3548.v21.uss.makeUssReport: 1
3 📓 sait/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 59, astm.f3548.v21.uss.getOperationalIntentDetails: 45, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 21, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 63, astm.f3548.v21.uss.makeUssReport: 1
4 📓 sandbox/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 59, astm.f3548.v21.uss.getOperationalIntentDetails: 45, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 21, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 60, astm.f3548.v21.uss.makeUssReport: 1
5 📓 onesky/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 55, astm.f3548.v21.uss.getOperationalIntentDetails: 31, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 18, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 46, astm.f3548.v21.uss.makeUssReport: 1
Performance of SCD requests to USS Performance of successful operational intent details requests 10 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
11 📓 airmarket/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 44 queries, 95th percentile: 0.054s
12 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
13 📓 sait/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 45 queries, 95th percentile: 0.0665s
14 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
15 📓 sandbox/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 45 queries, 95th percentile: 0.0764s
16 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
17 📓 onesky/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 31 queries, 95th percentile: 0.137s
Interoperability test instance is available Interoperability test instance is available 22 📓 test_interop_interactions: Found 88 interactions with interoperability test instance for airmarket
23 ✅ Interoperability test instance is available ✅
24 📓 test_interop_interactions_1: Found 90 interactions with interoperability test instance for sait
25 ✅ Interoperability test instance is available ✅
26 📓 test_interop_interactions_2: Found 90 interactions with interoperability test instance for sandbox
27 ✅ Interoperability test instance is available ✅
28 📓 test_interop_interactions_3: Found 83 interactions with interoperability test instance for onesky
29 ✅ Interoperability test instance is available ✅
Notifications to operator Notifications for causing conflicts 34 📓 airmarket/scd0090_notification: Median latency >0.00s, max >3.0s, min >0.0s
35 ✅ Notifications for causing conflicts ✅
36 📓 sait/scd0090_notification: Median latency >0.00s, max >2.8s, min >0.0s
37 ✅ Notifications for causing conflicts ✅
38 📓 sandbox/scd0090_notification: Median latency >0.00s, max >2.8s, min >0.0s
39 ✅ Notifications for causing conflicts ✅
40 📓 onesky/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
41 ✅ Notifications for causing conflicts ✅
Notifications for observing conflicts 46 📓 airmarket/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
47 ✅ Notifications for observing conflicts ✅
48 📓 sait/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
49 ✅ Notifications for observing conflicts ✅
50 📓 sandbox/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
51 ✅ Notifications for observing conflicts ✅
52 📓 onesky/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
53 ✅ Notifications for observing conflicts ✅