ASTM F3548-21 evaluate system versions

scenarios.astm.utm.versioning.evaluate_system_versions.EvaluateSystemVersions

Resources

KML visualization

Case Step Event airmarket onesky sait sandbox
Evaluate versions Get test environment test versions 1 🌐
  • GET rtm.airmarket.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.airmarket.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.435753Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQzMywiaWF0IjoxNzkzOTQ0ODMzLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLmFpcm1hcmtldC5zdGFnZS5mbHlzYWZlLmxpdmUifQ.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          77
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.039256
      • reported
        :
        2026-11-06T06:12:53.476291Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          brayden-dev-latest
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      airmarket
🌐
2 ✅ Valid response ✅
3 🌐
  • GET rtm.sait.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sait.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.476773Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQzNiwiaWF0IjoxNzkzOTQ0ODM2LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhaXQuc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.03968
      • reported
        :
        2026-11-06T06:12:53.517384Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sait
🌐
4 ✅ Valid response ✅
5 🌐
  • GET rtm.sandbox.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sandbox.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.517941Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQzOCwiaWF0IjoxNzkzOTQ0ODM4LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhbmRib3guc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.03265
      • reported
        :
        2026-11-06T06:12:53.551704Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sandbox
🌐
6 ✅ Valid response ✅
7 🌐
  • GET iart.oneskysystems.com 503
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://iart.oneskysystems.com/uss/inbound/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.552128Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQ0MSwiaWF0IjoxNzkzOTQ0ODQxLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoiaWFydC5vbmVza3lzeXN0ZW1zLmNvbSJ9.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        503
      • headers
        :
        • Content-Type
          :
          text/plain; charset=utf-8
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
        • X-Content-Type-Options
          :
          nosniff
        • X-Frame-Options
          :
          SAMEORIGIN
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Length
          :
          20
      • elapsed_s
        :
        0.025693
      • reported
        :
        2026-11-06T06:12:53.578684Z
      • body
        :
        no available server
      • json
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      onesky
🌐
8 ⚠️ Valid response [7]
Error querying version
Attempt to get version returned status 503 rather than 200 as expected
⚠️
Get production environment versions 9 🌐
  • GET rtm.airmarket.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.airmarket.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.580261Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQzMywiaWF0IjoxNzkzOTQ0ODMzLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLmFpcm1hcmtldC5zdGFnZS5mbHlzYWZlLmxpdmUifQ.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          77
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.010247
      • reported
        :
        2026-11-06T06:12:53.591585Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          brayden-dev-latest
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      airmarket
🌐
10 ✅ Valid response ✅
11 🌐
  • GET rtm.sait.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sait.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.592133Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQzNiwiaWF0IjoxNzkzOTQ0ODM2LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhaXQuc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          GET, OPTIONS
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.009005
      • reported
        :
        2026-11-06T06:12:53.602014Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sait
🌐
12 ✅ Valid response ✅
13 🌐
  • GET rtm.sandbox.stage.flysafe.live 200
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://rtm.sandbox.stage.flysafe.live/versioning/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.602412Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQzOCwiaWF0IjoxNzkzOTQ0ODM4LCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoicnRtLnNhbmRib3guc3RhZ2UuZmx5c2FmZS5saXZlIn0.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        200
      • headers
        :
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Type
          :
          application/json
        • Content-Length
          :
          66
        • Connection
          :
          keep-alive
        • vary
          :
          Accept, Cookie
        • allow
          :
          OPTIONS, GET
        • x-frame-options
          :
          DENY
        • x-content-type-options
          :
          nosniff
        • referrer-policy
          :
          same-origin
        • cross-origin-opener-policy
          :
          same-origin
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
      • elapsed_s
        :
        0.009328
      • reported
        :
        2026-11-06T06:12:53.612578Z
      • json
        :
        • system_identity
          :
          astm.f3548.v21
        • system_version
          :
          Unknown
      • body
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      sandbox
🌐
14 ✅ Valid response ✅
15 🌐
  • GET iart.oneskysystems.com 503
    :
    • request
      :
      • method
        :
        GET
      • url
        :
        https://iart.oneskysystems.com/uss/inbound/versions/astm.f3548.v21
      • initiated_at
        :
        2026-11-06T06:12:53.612975Z
      • headers
        :
        • User-Agent
          :
          python-requests/2.34.2
        • Accept-Encoding
          :
          gzip, deflate, br
        • Accept
          :
          */*
        • Connection
          :
          keep-alive
        • Authorization
          :
          Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6InhEUVVkQWhqZ0dYaHBIX3BTTWNMWGM4MnllUFlabFlfLUVtMDhwdnp1VE0iLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2F1dGguc3RhZ2UuaWFydC5zb2Z0d2FyZSIsImV4cCI6MTc5Mzk0ODQ0MSwiaWF0IjoxNzkzOTQ0ODQxLCJzdWIiOiJEU1MgUXVhbGlmZXIxIiwic2NvcGUiOiJpbnRlcnVzcy52ZXJzaW9uaW5nLnJlYWRfc3lzdGVtX3ZlcnNpb25zIiwidHlwIjoiQmVhcmVyIiwiYXVkIjoiaWFydC5vbmVza3lzeXN0ZW1zLmNvbSJ9.REDACTED
      • json
        :
        None
      • body
        :
        None
    • response
      :
      • code
        :
        503
      • headers
        :
        • Content-Type
          :
          text/plain; charset=utf-8
        • Strict-Transport-Security
          :
          max-age=31536000; includeSubDomains
        • X-Content-Type-Options
          :
          nosniff
        • X-Frame-Options
          :
          SAMEORIGIN
        • Date
          :
          Fri, 06 Nov 2026 06:12:53 GMT
        • Content-Length
          :
          20
      • elapsed_s
        :
        0.006311
      • reported
        :
        2026-11-06T06:12:53.620296Z
      • body
        :
        no available server
      • json
        :
        None
    • query_type
      :
      interuss.automated_testing.versioning.GetVersion
    • participant_id
      :
      onesky
🌐
16 ⚠️ Valid response [15]
Error querying version
Attempt to get version returned status 503 rather than 200 as expected
⚠️
Evaluate current system versions 17 ✅ Test software version matches production ✅
18 ✅ Test software version matches production ✅
19 ✅ Test software version matches production ✅
20 ✅ At most one participant is testing a new software version ✅ ✅ ✅
Evaluate system version consistency 21 ✅ Software versions are consistent throughout test run ✅
22 ✅ Software versions are consistent throughout test run ✅
23 ✅ Software versions are consistent throughout test run ✅