| Case | Step | Event | airmarket | onesky | sait | sandbox | ||
|---|---|---|---|---|---|---|---|---|
| 1 | 📓 |
all_queries: 2916
|
||||||
| 2 | 📓 |
airmarket/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 80, astm.f3548.v21.uss.getOperationalIntentDetails: 58, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 23, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 53, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| 3 | 📓 |
sait/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 64, astm.f3548.v21.uss.getOperationalIntentDetails: 49, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 23, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 54, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| 4 | 📓 |
sandbox/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 81, astm.f3548.v21.uss.getOperationalIntentDetails: 64, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 29, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 60, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| 5 | 📓 |
onesky/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 63, astm.f3548.v21.uss.getOperationalIntentDetails: 33, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 17, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 43, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| Performance of SCD requests to USS | Performance of successful operational intent details requests | 10 | ✅ | Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time | ✅ | |||
| 11 | 📓 |
airmarket/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 58 queries, 95th percentile: 0.0631s
|
||||||
| 12 | ✅ | Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time | ✅ | |||||
| 13 | 📓 |
sait/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 49 queries, 95th percentile: 0.086s
|
||||||
| 14 | ✅ | Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time | ✅ | |||||
| 15 | 📓 |
sandbox/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 64 queries, 95th percentile: 0.0588s
|
||||||
| 16 | ⚠️ |
Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time
95th percentile of durations for operational intent details requests to USS is higher than threshold threshold: 1s, 95th percentile: 1.69s |
⚠️ | |||||
| 17 | 📓 |
onesky/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 33 queries, 95th percentile: 1.69s
|
||||||
| Interoperability test instance is available | Interoperability test instance is available | 22 | 📓 |
test_interop_interactions: Found 113 interactions with interoperability test instance for airmarket
|
||||
| 23 | ✅ | Interoperability test instance is available | ✅ | |||||
| 24 | 📓 |
test_interop_interactions_1: Found 97 interactions with interoperability test instance for sait
|
||||||
| 25 | ✅ | Interoperability test instance is available | ✅ | |||||
| 26 | 📓 |
test_interop_interactions_2: Found 120 interactions with interoperability test instance for sandbox
|
||||||
| 27 | ✅ | Interoperability test instance is available | ✅ | |||||
| 28 | 📓 |
test_interop_interactions_3: Found 90 interactions with interoperability test instance for onesky
|
||||||
| 29 | ✅ | Interoperability test instance is available | ✅ | |||||
| Notifications to operator | Notifications for causing conflicts | 34 | 📓 |
airmarket/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||
| 35 | ✅ | Notifications for causing conflicts | ✅ | |||||
| 36 | 📓 |
sait/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||||
| 37 | ✅ | Notifications for causing conflicts | ✅ | |||||
| 38 | 📓 |
sandbox/scd0090_notification: Median latency >0.00s, max >2.8s, min >0.0s
|
||||||
| 39 | ✅ | Notifications for causing conflicts | ✅ | |||||
| 40 | 📓 |
onesky/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||||
| 41 | ✅ | Notifications for causing conflicts | ✅ | |||||
| Notifications for observing conflicts | 45 | 📓 |
airmarket/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
|||||
| 46 | ✅ | Notifications for observing conflicts | ✅ | |||||
| 47 | 📓 |
sait/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||||
| 48 | ✅ | Notifications for observing conflicts | ✅ | |||||
| 49 | 📓 |
sandbox/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||||
| 50 | ✅ | Notifications for observing conflicts | ✅ | |||||