ASTM F3548-21 evaluate system versions

scenarios.astm.utm.versioning.evaluate_system_versions.EvaluateSystemVersions

Resources

KML visualization

Case Step Event airmarket onesky sait sandbox
Evaluate versions Get test environment test versions 1 🌐
  • GET rtm.airmarket.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.airmarket.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.360096Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3NCwiaWF0IjoxNzkxMjI4ODc0LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLmFpcm1hcmtldC5zdGFnZS5mbHlzYWZlLmxpdmUifQ.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          77
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.113486
      • reported
        :
        2026-10-05T19:44:01.474921Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          brayden-dev-latest
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      airmarket
🌐
2 ✅ Valid response ✅
3 🌐
  • GET rtm.sait.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sait.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.475428Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3NSwiaWF0IjoxNzkxMjI4ODc1LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhaXQuc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.11915
      • reported
        :
        2026-10-05T19:44:01.595451Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sait
🌐
4 ✅ Valid response ✅
5 🌐
  • GET rtm.sandbox.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sandbox.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.595843Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3NywiaWF0IjoxNzkxMjI4ODc3LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhbmRib3guc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.107333
      • reported
        :
        2026-10-05T19:44:01.704005Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sandbox
🌐
6 ✅ Valid response ✅
7 🌐
  • GET iart.oneskysystems.com 500
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://iart.oneskysystems.com/uss/inbound/fp/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.704542Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3OSwiaWF0IjoxNzkxMjI4ODc5LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoiaWFydC5vbmVza3lzeXN0ZW1zLmNvbSJ9.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        500
      • headers
        :
        • Access-Control-Allow-Methods
          :
          *
        • Access-Control-Allow-Origin
          :
          *
        • Cache-Control
          :
          no-cache, no-store, max-age=0, must-revalidate
        • Content-Length
          :
          166
        • Content-Type
          :
          application/json
        • Expires
          :
          0
        • Pragma
          :
          no-cache
        • Referrer-Policy
          :
          no-referrer
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
        • Vary
          :
          Origin, Access-Control-Request-Method, Access-Control-Request-Headers
        • X-Content-Type-Options
          :
          nosniff
        • X-Frame-Options
          :
          SAMEORIGIN
        • X-Xss-Protection
          :
          0
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
      • elapsed_s
        :
        0.06587
      • reported
        :
        2026-10-05T19:44:01.771518Z
      • json
        :
        • timestamp
          :
          2026-10-05T19:44:01.765+00:00
        • path
          :
          /uss/inbound/fp/versions/astm.f3548.v21
        • status
          :
          500
        • error
          :
          Internal Server Error
        • requestId
          :
          89b10224-174
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      onesky
🌐
8 ⚠️ Valid response [7]
Error querying version
Attempt to get version returned status 500 rather than 200 as expected
⚠️
Get production environment versions 9 🌐
  • GET rtm.airmarket.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.airmarket.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.773401Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3NCwiaWF0IjoxNzkxMjI4ODc0LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLmFpcm1hcmtldC5zdGFnZS5mbHlzYWZlLmxpdmUifQ.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          77
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.052523
      • reported
        :
        2026-10-05T19:44:01.827252Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          brayden-dev-latest
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      airmarket
🌐
10 ✅ Valid response ✅
11 🌐
  • GET rtm.sait.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sait.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.827692Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3NSwiaWF0IjoxNzkxMjI4ODc1LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhaXQuc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.026271
      • reported
        :
        2026-10-05T19:44:01.855031Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sait
🌐
12 ✅ Valid response ✅
13 🌐
  • GET rtm.sandbox.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sandbox.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.855493Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3NywiaWF0IjoxNzkxMjI4ODc3LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhbmRib3guc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.035478
      • reported
        :
        2026-10-05T19:44:01.891851Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sandbox
🌐
14 ✅ Valid response ✅
15 🌐
  • GET iart.oneskysystems.com 500
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://iart.oneskysystems.com/uss/inbound/fp/versions/astm.f3548.v21
      • initiated_at
        :
        2026-10-05T19:44:01.892506Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5MTIzMjQ3OSwiaWF0IjoxNzkxMjI4ODc5LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoiaWFydC5vbmVza3lzeXN0ZW1zLmNvbSJ9.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        500
      • headers
        :
        • Access-Control-Allow-Methods
          :
          *
        • Access-Control-Allow-Origin
          :
          *
        • Cache-Control
          :
          no-cache, no-store, max-age=0, must-revalidate
        • Content-Length
          :
          166
        • Content-Type
          :
          application/json
        • Expires
          :
          0
        • Pragma
          :
          no-cache
        • Referrer-Policy
          :
          no-referrer
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
        • Vary
          :
          Origin, Access-Control-Request-Method, Access-Control-Request-Headers
        • X-Content-Type-Options
          :
          nosniff
        • X-Frame-Options
          :
          SAMEORIGIN
        • X-Xss-Protection
          :
          0
        • Date
          :
          Mon, 05 Oct 2026 19:44:01 GMT
      • elapsed_s
        :
        0.013291
      • reported
        :
        2026-10-05T19:44:01.906654Z
      • json
        :
        • timestamp
          :
          2026-10-05T19:44:01.902+00:00
        • path
          :
          /uss/inbound/fp/versions/astm.f3548.v21
        • status
          :
          500
        • error
          :
          Internal Server Error
        • requestId
          :
          89b10224-175
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      onesky
🌐
16 ⚠️ Valid response [15]
Error querying version
Attempt to get version returned status 500 rather than 200 as expected
⚠️
Evaluate current system versions 17 ✅ Test software version matches production ✅
18 ✅ Test software version matches production ✅
19 ✅ Test software version matches production ✅
20 ✅ At most one participant is testing a new software version ✅ ✅ ✅
Evaluate system version consistency 21 ✅ Software versions are consistent throughout test run ✅
22 ✅ Software versions are consistent throughout test run ✅
23 ✅ Software versions are consistent throughout test run ✅