ASTM F3548 UTM aggregate checks

scenarios.astm.utm.AggregateChecks

Resources

KML visualization

Case Step Event airmarket onesky sait sandbox
1 📓 all_queries: 3287
2 📓 airmarket/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 103, astm.f3548.v21.uss.getOperationalIntentDetails: 78, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 32, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 63, astm.f3548.v21.uss.makeUssReport: 1
3 📓 sait/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 102, astm.f3548.v21.uss.getOperationalIntentDetails: 76, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 31, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 63, astm.f3548.v21.uss.makeUssReport: 1
4 📓 sandbox/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 102, astm.f3548.v21.uss.getOperationalIntentDetails: 76, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 31, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 58, astm.f3548.v21.uss.makeUssReport: 1
5 📓 onesky/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 68, astm.f3548.v21.uss.getOperationalIntentDetails: 39, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 24, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 43, astm.f3548.v21.uss.makeUssReport: 1
Performance of SCD requests to USS Performance of successful operational intent details requests 10 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
11 📓 airmarket/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 78 queries, 95th percentile: 0.0644s
12 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
13 📓 sait/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 76 queries, 95th percentile: 0.0595s
14 ✅ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time ✅
15 📓 sandbox/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 76 queries, 95th percentile: 0.0555s
16 ⚠️ Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time
95th percentile of durations for operational intent details requests to USS is higher than threshold
threshold: 1s, 95th percentile: 5.17s
⚠️
17 📓 onesky/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 39 queries, 95th percentile: 5.17s
Interoperability test instance is available Interoperability test instance is available 22 📓 test_interop_interactions: Found 145 interactions with interoperability test instance for airmarket
23 ✅ Interoperability test instance is available ✅
24 📓 test_interop_interactions_1: Found 143 interactions with interoperability test instance for sait
25 ✅ Interoperability test instance is available ✅
26 📓 test_interop_interactions_2: Found 143 interactions with interoperability test instance for sandbox
27 ✅ Interoperability test instance is available ✅
28 📓 test_interop_interactions_3: Found 102 interactions with interoperability test instance for onesky
29 ✅ Interoperability test instance is available ✅
Notifications to operator Notifications for causing conflicts 34 📓 airmarket/scd0090_notification: Median latency >0.00s, max >2.6s, min >0.0s
35 ✅ Notifications for causing conflicts ✅
36 📓 sait/scd0090_notification: Median latency >0.00s, max >2.3s, min >0.0s
37 ✅ Notifications for causing conflicts ✅
38 📓 sandbox/scd0090_notification: Median latency >0.00s, max >1.9s, min >0.0s
39 ✅ Notifications for causing conflicts ✅
40 📓 onesky/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
41 ✅ Notifications for causing conflicts ✅
Notifications for observing conflicts 45 📓 airmarket/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
46 ✅ Notifications for observing conflicts ✅
47 📓 sait/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
48 ✅ Notifications for observing conflicts ✅
49 📓 sandbox/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
50 ✅ Notifications for observing conflicts ✅