ASTM F3548 UTM aggregate checks

scenarios.astm.utm.AggregateChecks

Resources

KML visualization

Case Step Event airmarket onesky sait sandbox
1 📓 all_queries: 2780
2 📓 airmarket/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 83, astm.f3548.v21.uss.getOperationalIntentDetails: 60, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 24, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 53, astm.f3548.v21.uss.makeUssReport: 1
3 📓 sait/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 79, astm.f3548.v21.uss.getOperationalIntentDetails: 58, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 26, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 49, astm.f3548.v21.uss.makeUssReport: 1
4 📓 sandbox/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 50, astm.f3548.v21.uss.getOperationalIntentDetails: 37, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 25, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 19, astm.f3548.v21.uss.makeUssReport: 1
5 📓 onesky/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 56, astm.f3548.v21.uss.getOperationalIntentDetails: 29, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 16, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 35, astm.f3548.v21.uss.makeUssReport: 1
Performance of SCD requests to USS Performance of successful operational intent details requests 10 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
11 📓 airmarket/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 60 queries, 95th percentile: 0.0541s
12 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
13 📓 sait/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 58 queries, 95th percentile: 0.0682s
14 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
15 📓 sandbox/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 37 queries, 95th percentile: 0.0558s
16 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
17 📓 onesky/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 29 queries, 95th percentile: 0.167s
Interoperability test instance is available Interoperability test instance is available 22 📓 test_interop_interactions: Found 117 interactions with interoperability test instance for airmarket
23 ✅ Interoperability test instance is available ✅
24 📓 test_interop_interactions_1: Found 115 interactions with interoperability test instance for sait
25 ✅ Interoperability test instance is available ✅
26 📓 test_interop_interactions_2: Found 85 interactions with interoperability test instance for sandbox
27 ✅ Interoperability test instance is available ✅
28 📓 test_interop_interactions_3: Found 82 interactions with interoperability test instance for onesky
29 ✅ Interoperability test instance is available ✅
Notifications to operator Notifications for causing conflicts 34 📓 airmarket/scd0090_notification: Median latency >0.00s, max >2.7s, min >0.0s
35 ✅ Notifications for causing conflicts ✅
36 📓 sait/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
37 ✅ Notifications for causing conflicts ✅
38 📓 sandbox/scd0090_notification: Median latency >0.00s, max >2.0s, min >0.0s
39 ✅ Notifications for causing conflicts ✅
40 📓 onesky/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
41 ✅ Notifications for causing conflicts ✅
Notifications for observing conflicts 44 📓 airmarket/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
45 ✅ Notifications for observing conflicts ✅
46 📓 sait/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
47 ✅ Notifications for observing conflicts ✅