| Case | Step | Event | airmarket | onesky | sait | sandbox | ||
|---|---|---|---|---|---|---|---|---|
| 1 | 📓 |
all_queries: 3287
|
||||||
| 2 | 📓 |
airmarket/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 103, astm.f3548.v21.uss.getOperationalIntentDetails: 78, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 32, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 63, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| 3 | 📓 |
sait/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 102, astm.f3548.v21.uss.getOperationalIntentDetails: 76, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 31, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 63, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| 4 | 📓 |
sandbox/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 102, astm.f3548.v21.uss.getOperationalIntentDetails: 76, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 31, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 58, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| 5 | 📓 |
onesky/attributed_queries: interuss.automated_testing.versioning.GetVersion: 3, interuss.automated_testing.flight_planning.v1.GetStatus: 2, interuss.automated_testing.flight_planning.v1.ClearArea: 8, interuss.automated_testing.flight_planning.v1.UpsertFlightPlan: 68, astm.f3548.v21.uss.getOperationalIntentDetails: 39, interuss.automated_testing.flight_planning.v1.DeleteFlightPlan: 24, interuss.automated_testing.flight_planning.v1.QueryUserNotifications: 43, astm.f3548.v21.uss.makeUssReport: 1
|
||||||
| Performance of SCD requests to USS | Performance of successful operational intent details requests | 10 | ✅ | Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time | ✅ | |||
| 11 | 📓 |
airmarket/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 78 queries, 95th percentile: 0.0644s
|
||||||
| 12 | ✅ | Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time | ✅ | |||||
| 13 | 📓 |
sait/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 76 queries, 95th percentile: 0.0595s
|
||||||
| 14 | ✅ | Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time | ✅ | |||||
| 15 | 📓 |
sandbox/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 76 queries, 95th percentile: 0.0555s
|
||||||
| 16 | ⚠️ |
Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time
95th percentile of durations for operational intent details requests to USS is higher than threshold threshold: 1s, 95th percentile: 5.17s |
⚠️ | |||||
| 17 | 📓 |
onesky/astm.f3548.v21.uss.getOperationalIntentDetails: checked performances on 39 queries, 95th percentile: 5.17s
|
||||||
| Interoperability test instance is available | Interoperability test instance is available | 22 | 📓 |
test_interop_interactions: Found 145 interactions with interoperability test instance for airmarket
|
||||
| 23 | ✅ | Interoperability test instance is available | ✅ | |||||
| 24 | 📓 |
test_interop_interactions_1: Found 143 interactions with interoperability test instance for sait
|
||||||
| 25 | ✅ | Interoperability test instance is available | ✅ | |||||
| 26 | 📓 |
test_interop_interactions_2: Found 143 interactions with interoperability test instance for sandbox
|
||||||
| 27 | ✅ | Interoperability test instance is available | ✅ | |||||
| 28 | 📓 |
test_interop_interactions_3: Found 102 interactions with interoperability test instance for onesky
|
||||||
| 29 | ✅ | Interoperability test instance is available | ✅ | |||||
| Notifications to operator | Notifications for causing conflicts | 34 | 📓 |
airmarket/scd0090_notification: Median latency >0.00s, max >2.6s, min >0.0s
|
||||
| 35 | ✅ | Notifications for causing conflicts | ✅ | |||||
| 36 | 📓 |
sait/scd0090_notification: Median latency >0.00s, max >2.3s, min >0.0s
|
||||||
| 37 | ✅ | Notifications for causing conflicts | ✅ | |||||
| 38 | 📓 |
sandbox/scd0090_notification: Median latency >0.00s, max >1.9s, min >0.0s
|
||||||
| 39 | ✅ | Notifications for causing conflicts | ✅ | |||||
| 40 | 📓 |
onesky/scd0090_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||||
| 41 | ✅ | Notifications for causing conflicts | ✅ | |||||
| Notifications for observing conflicts | 45 | 📓 |
airmarket/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
|||||
| 46 | ✅ | Notifications for observing conflicts | ✅ | |||||
| 47 | 📓 |
sait/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||||
| 48 | ✅ | Notifications for observing conflicts | ✅ | |||||
| 49 | 📓 |
sandbox/scd0095_notification: Median latency >0.00s, max >0.0s, min >0.0s
|
||||||
| 50 | ✅ | Notifications for observing conflicts | ✅ | |||||