ASTM F3548-21 evaluate system versions

scenarios.astm.utm.versioning.evaluate_system_versions.EvaluateSystemVersions

Resources

KML visualization

Case Step Event airmarket onesky sait sandbox
Evaluate versions Get test environment test versions 1 🌐
  • GET rtm.airmarket.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.airmarket.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.054266Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjAzOCwiaWF0IjoxNzkzODU4NDM4LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLmFpcm1hcmtldC5zdGFnZS5mbHlzYWZlLmxpdmUifQ.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          77
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.03423
      • reported
        :
        2026-11-05T06:12:54.089276Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          brayden-dev-latest
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      airmarket
🌐
2 ✅ Valid response ✅
3 🌐
  • GET rtm.sait.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sait.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.089736Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjA0MSwiaWF0IjoxNzkzODU4NDQxLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhaXQuc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.041586
      • reported
        :
        2026-11-05T06:12:54.132136Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sait
🌐
4 ✅ Valid response ✅
5 🌐
  • GET rtm.sandbox.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sandbox.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.132535Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjA0MywiaWF0IjoxNzkzODU4NDQzLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhbmRib3guc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.032569
      • reported
        :
        2026-11-05T06:12:54.165963Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sandbox
🌐
6 ✅ Valid response ✅
7 🌐
  • GET iart.oneskysystems.com 503
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://iart.oneskysystems.com/uss/inbound/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.166355Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjA0NSwiaWF0IjoxNzkzODU4NDQ1LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoiaWFydC5vbmVza3lzeXN0ZW1zLmNvbSJ9.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        503
      • headers
        :
        • Content-Type
          :
          text/plain; charset=utf-8
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
        • X-Content-Type-Options
          :
          nosniff
        • X-Frame-Options
          :
          SAMEORIGIN
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Length
          :
          20
      • elapsed_s
        :
        0.029099
      • reported
        :
        2026-11-05T06:12:54.196193Z
      • body
        :
        no available server
      • json
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      onesky
🌐
8 ⚠️ Valid response [7]
Error querying version
Attempt to get version returned status 503 rather than 200 as expected
⚠️
Get production environment versions 9 🌐
  • GET rtm.airmarket.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.airmarket.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.197636Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjAzOCwiaWF0IjoxNzkzODU4NDM4LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLmFpcm1hcmtldC5zdGFnZS5mbHlzYWZlLmxpdmUifQ.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          77
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.009305
      • reported
        :
        2026-11-05T06:12:54.207956Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          brayden-dev-latest
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      airmarket
🌐
10 ✅ Valid response ✅
11 🌐
  • GET rtm.sait.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sait.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.208479Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjA0MSwiaWF0IjoxNzkzODU4NDQxLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhaXQuc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.008116
      • reported
        :
        2026-11-05T06:12:54.217541Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sait
🌐
12 ✅ Valid response ✅
13 🌐
  • GET rtm.sandbox.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sandbox.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.217980Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjA0MywiaWF0IjoxNzkzODU4NDQzLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhbmRib3guc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.007734
      • reported
        :
        2026-11-05T06:12:54.226452Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sandbox
🌐
14 ✅ Valid response ✅
15 🌐
  • GET iart.oneskysystems.com 503
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://iart.oneskysystems.com/uss/inbound/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-05T06:12:54.226834Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzg2MjA0NSwiaWF0IjoxNzkzODU4NDQ1LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoiaWFydC5vbmVza3lzeXN0ZW1zLmNvbSJ9.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        503
      • headers
        :
        • Content-Type
          :
          text/plain; charset=utf-8
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
        • X-Content-Type-Options
          :
          nosniff
        • X-Frame-Options
          :
          SAMEORIGIN
        • Date
          :
          Thu, 05 Nov 2026 06:12:54 GMT
        • Content-Length
          :
          20
      • elapsed_s
        :
        0.002815
      • reported
        :
        2026-11-05T06:12:54.230326Z
      • body
        :
        no available server
      • json
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      onesky
🌐
16 ⚠️ Valid response [15]
Error querying version
Attempt to get version returned status 503 rather than 200 as expected
⚠️
Evaluate current system versions 17 ✅ Test software version matches production ✅
18 ✅ Test software version matches production ✅
19 ✅ Test software version matches production ✅
20 ✅ At most one participant is testing a new software version ✅ ✅ ✅
Evaluate system version consistency 21 ✅ Software versions are consistent throughout test run ✅
22 ✅ Software versions are consistent throughout test run ✅
23 ✅ Software versions are consistent throughout test run ✅