2024-03-29T08:39:36.254 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-29T08:39:36.254 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} --name vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161 --verbose -- /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161/orig.config.yaml
2024-03-29T08:39:36.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-29T08:39:36.393 INFO:teuthology.run:Config:
  archive_path: /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161
  branch: wip-vshankar-testing-20240326.105515-reef
  description: fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd}
    no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn}
    tasks/{0-pacific 1-upgrade}}
  email: vshankar@redhat.com
  first_in_suite: false
  job_id: '7628161'
  kernel:
    flavor: default
    kdb: true
    sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2
  ktype: distro
  last_in_suite: false
  machine_type: smithi
  meta:
  - desc: 'install ceph/pacific latest
  
      '
  name: vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi
  no_nested_subset: false
  nuke-on-error: true
  openstack:
  - volumes:
      count: 4
      size: 10
  os_type: centos
  os_version: 8.stream
  overrides:
    admin_socket:
      branch: wip-vshankar-testing-20240326.105515-reef
    ceph:
      conf:
        client:
          client mount timeout: 600
          debug client: 20
          debug ms: 1
          rados mon op timeout: 900
          rados osd op timeout: 900
        global:
          bluestore warn on legacy statfs: false
          bluestore warn on no per pool omap: false
          mon pg warn min per osd: 0
        mds:
          debug mds: 20
          debug mds balancer: 20
          debug ms: 1
          mds debug frag: true
          mds debug scatterstat: true
          mds op complaint time: 180
          mds verify scatter: true
          osd op complaint time: 180
          rados mon op timeout: 900
          rados osd op timeout: 900
        mgr:
          debug mgr: 20
          debug ms: 1
        mon:
          debug mon: 20
          debug ms: 1
          debug paxos: 20
          mon op complaint time: 120
          mon warn on osd down out interval zero: false
        osd:
          bdev async discard: true
          bdev enable discard: true
          bluestore allocator: bitmap
          bluestore block size: 96636764160
          bluestore fsck on mount: true
          debug bluefs: 1/20
          debug bluestore: 1/20
          debug ms: 1
          debug osd: 20
          debug rocksdb: 4/10
          mon osd backfillfull_ratio: 0.85
          mon osd full ratio: 0.9
          mon osd nearfull ratio: 0.8
          osd failsafe full ratio: 0.95
          osd objectstore: bluestore
          osd op complaint time: 180
      flavor: default
      fs: xfs
      log-ignorelist:
      - \(MDS_ALL_DOWN\)
      - \(MDS_UP_LESS_THAN_MAX\)
      - FS_DEGRADED
      - FS_INLINE_DATA_DEPRECATED
      - FS_WITH_FAILED_MDS
      - MDS_ALL_DOWN
      - MDS_DAMAGE
      - MDS_DEGRADED
      - MDS_FAILED
      - MDS_INSUFFICIENT_STANDBY
      - MDS_UP_LESS_THAN_MAX
      - POOL_APP_NOT_ENABLED
      - overall HEALTH_
      - Replacing daemon
      - overall HEALTH_
      - \(OSD_DOWN\)
      - \(OSD_
      - but it is still running
      - is not responding
      - scrub mismatch
      - ScrubResult
      - wrongly marked
      - \(POOL_APP_NOT_ENABLED\)
      - \(SLOW_OPS\)
      - overall HEALTH_
      - \(MON_MSGR2_NOT_ENABLED\)
      - slow request
      sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
    ceph-deploy:
      bluestore: true
      conf:
        client:
          log file: /var/log/ceph/ceph-$name.$pid.log
        mon:
          osd default pool size: 2
        osd:
          bdev async discard: true
          bdev enable discard: true
          bluestore block size: 96636764160
          bluestore fsck on mount: true
          debug bluefs: 1/20
          debug bluestore: 1/20
          debug rocksdb: 4/10
          mon osd backfillfull_ratio: 0.85
          mon osd full ratio: 0.9
          mon osd nearfull ratio: 0.8
          osd failsafe full ratio: 0.95
          osd objectstore: bluestore
      fs: xfs
    install:
      ceph:
        flavor: default
        sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
    selinux:
      whitelist:
      - scontext=system_u:system_r:logrotate_t:s0
    thrashosds:
      bdev_inject_crash: 2
      bdev_inject_crash_probability: 0.5
    workunit:
      branch: wip-vshankar-testing-20240326.105515-reef
      sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
  owner: scheduled_vshankar@teuthology
  priority: 120
  repo: https://git.ceph.com/ceph-ci.git
  roles:
  - - mon.a
    - mon.b
    - mon.c
    - mgr.x
    - mgr.y
    - osd.0
    - osd.1
    - osd.2
    - osd.3
  seed: 7327
  sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
  sleep_before_teardown: 0
  subset: 990/1024
  suite: fs
  suite_branch: wip-vshankar-testing-20240326.105515-reef
  suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d0e392d9aee635f2b65768c460c7a151ead7a5e2/qa
  suite_relpath: qa
  suite_repo: https://git.ceph.com/ceph-ci.git
  suite_sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
  targets:
    smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhVHZfeYp5C9I6Dx1p4wqUvcyFVGjokI+WviqpJ+4RjSvLf8DskHjuKy8w87ofcjt8Jm2LCE+GTLz/ZRCRhQ6g=
  tasks:
  - install:
      branch: pacific
      exclude_packages:
      - librados3
      - ceph-mgr-dashboard
      - ceph-mgr-diskprediction-local
      - ceph-mgr-rook
      - ceph-mgr-cephadm
      - cephadm
      - ceph-volume
      extra_packages:
      - librados2
  - print: '**** done installing pacific'
  - ceph:
      conf:
        global:
          mon warn on pool no app: false
          ms bind msgr2: false
      log-ignorelist:
      - overall HEALTH_
      - \(FS_
      - \(MDS_
      - \(OSD_
      - \(MON_DOWN\)
      - \(CACHE_POOL_
      - \(POOL_
      - \(MGR_DOWN\)
      - \(PG_
      - \(SMALLER_PGP_NUM\)
      - Monitor daemon marked osd
      - Behind on trimming
      - Manager daemon
  - exec:
      osd.0:
      - ceph osd set-require-min-compat-client pacific
  - print: '**** done ceph'
  - print: '*** upgrading, no cephfs present'
  - exec:
      mon.a:
      - ceph fs dump
  - install.upgrade:
      mon.a: null
  - print: '**** done install.upgrade'
  - ceph.restart:
      daemons:
      - mon.*
      - mgr.*
      mon-health-to-clog: false
      wait-for-healthy: false
  - ceph.healthy: null
  - ceph.restart:
      daemons:
      - osd.*
      wait-for-healthy: false
      wait-for-osds-up: true
  - exec:
      mon.a:
      - ceph versions
      - ceph osd dump -f json-pretty
      - ceph fs dump
      - ceph osd require-osd-release quincy
      - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off
        ; done
  - ceph.healthy: null
  - print: '**** done ceph.restart'
  teuthology:
    fragments_dropped: []
    meta: {}
    postmerge: []
  teuthology_branch: main
  teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d
  timestamp: 2024-03-28_11:21:59
  tube: smithi
  user: vshankar
  verbose: false
  worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885
2024-03-29T08:39:36.393 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d0e392d9aee635f2b65768c460c7a151ead7a5e2/qa; will attempt to use it
2024-03-29T08:39:36.394 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d0e392d9aee635f2b65768c460c7a151ead7a5e2/qa/tasks
2024-03-29T08:39:36.394 INFO:teuthology.run_tasks:Running task internal.check_packages...
2024-03-29T08:39:36.395 INFO:teuthology.task.internal:Checking packages...
2024-03-29T08:39:36.421 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'
2024-03-29T08:39:36.421 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2024-03-29T08:39:36.421 INFO:teuthology.packaging:ref: None
2024-03-29T08:39:36.421 INFO:teuthology.packaging:tag: None
2024-03-29T08:39:36.421 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240326.105515-reef
2024-03-29T08:39:36.421 INFO:teuthology.packaging:sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
2024-03-29T08:39:36.421 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20240326.105515-reef
2024-03-29T08:39:36.562 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1015.gd0e392d9
2024-03-29T08:39:36.564 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep...
2024-03-29T08:39:36.572 INFO:teuthology.task.internal:no buildpackages task found
2024-03-29T08:39:36.572 INFO:teuthology.run_tasks:Running task internal.save_config...
2024-03-29T08:39:36.580 INFO:teuthology.task.internal:Saving configuration
2024-03-29T08:39:36.597 INFO:teuthology.run_tasks:Running task internal.check_lock...
2024-03-29T08:39:36.605 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-03-29T08:39:36.630 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 08:34:23.910850', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhVHZfeYp5C9I6Dx1p4wqUvcyFVGjokI+WviqpJ+4RjSvLf8DskHjuKy8w87ofcjt8Jm2LCE+GTLz/ZRCRhQ6g='}
2024-03-29T08:39:36.630 INFO:teuthology.run_tasks:Running task internal.add_remotes...
2024-03-29T08:39:36.638 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2024-03-29T08:39:36.638 INFO:teuthology.run_tasks:Running task console_log...
2024-03-29T08:39:36.679 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe67c27f790>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe67be5fee0>, signals=[15])
2024-03-29T08:39:36.679 INFO:teuthology.run_tasks:Running task internal.connect...
2024-03-29T08:39:36.689 INFO:teuthology.task.internal:Opening connections...
2024-03-29T08:39:36.689 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:39:36.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-29T08:39:36.770 INFO:teuthology.run_tasks:Running task internal.push_inventory...
2024-03-29T08:39:36.780 DEBUG:teuthology.orchestra.run.smithi171:> uname -m
2024-03-29T08:39:36.802 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2024-03-29T08:39:36.802 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-03-29T08:39:36.862 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-03-29T08:39:36.862 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8"
2024-03-29T08:39:36.862 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-29T08:39:36.863 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-29T08:39:36.864 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-03-29T08:39:36.891 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles...
2024-03-29T08:39:36.904 INFO:teuthology.run_tasks:Running task internal.check_conflict...
2024-03-29T08:39:36.917 INFO:teuthology.task.internal:Checking for old test directory...
2024-03-29T08:39:36.917 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest
2024-03-29T08:39:36.937 INFO:teuthology.run_tasks:Running task internal.check_ceph_data...
2024-03-29T08:39:36.945 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph...
2024-03-29T08:39:36.945 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph)
2024-03-29T08:39:37.007 INFO:teuthology.run_tasks:Running task internal.vm_setup...
2024-03-29T08:39:37.040 INFO:teuthology.run_tasks:Running task kernel...
2024-03-29T08:39:37.058 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}
2024-03-29T08:39:37.058 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300
2024-03-29T08:39:37.059 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv
2024-03-29T08:39:37.077 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-03-29T08:39:37.078 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2
2024-03-29T08:39:37.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"...
2024-03-29T08:39:37.078 DEBUG:teuthology.orchestra.run.smithi171:> uname -r
2024-03-29T08:39:37.141 INFO:teuthology.orchestra.run.smithi171.stdout:4.18.0-489.el8.x86_64
2024-03-29T08:39:37.141 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2
2024-03-29T08:39:37.142 DEBUG:teuthology.task.kernel:failed to parse current kernel version
2024-03-29T08:39:37.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2
2024-03-29T08:39:37.283 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum upgrade -y linux-firmware
2024-03-29T08:39:40.925 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - AppStream                      26 MB/s |  28 MB     00:01
2024-03-29T08:39:46.684 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - BaseOS                         12 MB/s |  10 MB     00:00
2024-03-29T08:39:48.734 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - Extras                         40 kB/s |  18 kB     00:00
2024-03-29T08:39:49.060 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - Extras common packages         34 kB/s | 7.5 kB     00:00
2024-03-29T08:39:49.353 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph     17 kB/s | 3.5 kB     00:00
2024-03-29T08:39:50.906 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux              11 MB/s |  16 MB     00:01
2024-03-29T08:39:54.770 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras                                      209 kB/s |  24 kB     00:00
2024-03-29T08:39:57.900 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:39:57.900 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:39:57.900 INFO:teuthology.orchestra.run.smithi171.stdout: Package           Arch      Version                            Repo       Size
2024-03-29T08:39:57.900 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:39:57.900 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading:
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout: linux-firmware    noarch    20240111-121.gitb3132c18.el8       baseos    355 M
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade  1 Package
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 355 M
2024-03-29T08:39:57.901 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:40:07.812 INFO:teuthology.orchestra.run.smithi171.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa  36 MB/s | 355 MB     00:09
2024-03-29T08:40:07.812 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:40:07.813 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                            36 MB/s | 355 MB     00:09
2024-03-29T08:40:09.911 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:40:09.998 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:40:09.998 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:40:12.212 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:40:12.225 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:40:35.442 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:40:35.781 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : linux-firmware-20240111-121.gitb3132c18.el8.noarch     1/2
2024-03-29T08:40:36.010 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : linux-firmware-20230217-113.git83f1d778.el8.noarch     2/2
2024-03-29T08:40:36.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch     2/2
2024-03-29T08:40:36.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : linux-firmware-20240111-121.gitb3132c18.el8.noarch     1/2
2024-03-29T08:40:36.753 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : linux-firmware-20230217-113.git83f1d778.el8.noarch     2/2
2024-03-29T08:40:36.754 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:40:36.754 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded:
2024-03-29T08:40:36.754 INFO:teuthology.orchestra.run.smithi171.stdout:  linux-firmware-20240111-121.gitb3132c18.el8.noarch
2024-03-29T08:40:36.754 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:40:36.754 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:40:36.951 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a...
2024-03-29T08:40:36.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2
2024-03-29T08:40:37.092 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/
2024-03-29T08:40:37.093 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/ --input-file=-
2024-03-29T08:40:37.095 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi171.front.sepia.ceph.com to complete...
2024-03-29T08:40:53.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29 08:40:53 URL:https://1.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/8/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [401601944/401601944] -> "/tmp/kernel.x86_64.rpm" [1]
2024-03-29T08:40:53.735 INFO:teuthology.orchestra.run.smithi171.stderr:FINISHED --2024-03-29 08:40:53--
2024-03-29T08:40:53.735 INFO:teuthology.orchestra.run.smithi171.stderr:Total wall clock time: 17s
2024-03-29T08:40:53.735 INFO:teuthology.orchestra.run.smithi171.stderr:Downloaded: 1 files, 383M in 16s (23.4 MB/s)
2024-03-29T08:40:53.738 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a...
2024-03-29T08:40:53.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm
2024-03-29T08:40:55.476 INFO:teuthology.orchestra.run.smithi171.stdout:Verifying...                          ########################################
2024-03-29T08:40:55.520 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing...                          ########################################
2024-03-29T08:40:55.629 INFO:teuthology.orchestra.run.smithi171.stdout:Updating / installing...
2024-03-29T08:41:35.948 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-6.8.0_g1df0c7e8a235-1          ########################################
2024-03-29T08:41:37.816 INFO:teuthology.orchestra.run.smithi171.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y
2024-03-29T08:41:58.044 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None)
2024-03-29T08:41:58.044 DEBUG:teuthology.orchestra.run.smithi171:> rpm -qlp /tmp/kernel.x86_64.rpm
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko
2024-03-29T08:41:58.102 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko
2024-03-29T08:41:58.103 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto
2024-03-29T08:41:58.104 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko
2024-03-29T08:41:58.105 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko
2024-03-29T08:41:58.106 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko
2024-03-29T08:41:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko
2024-03-29T08:41:58.108 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko
2024-03-29T08:41:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko
2024-03-29T08:41:58.110 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko
2024-03-29T08:41:58.111 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko
2024-03-29T08:41:58.112 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko
2024-03-29T08:41:58.113 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback
2024-03-29T08:41:58.114 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko
2024-03-29T08:41:58.115 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko
2024-03-29T08:41:58.116 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko
2024-03-29T08:41:58.117 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko
2024-03-29T08:41:58.118 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko
2024-03-29T08:41:58.119 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko
2024-03-29T08:41:58.120 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko
2024-03-29T08:41:58.121 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko
2024-03-29T08:41:58.122 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko
2024-03-29T08:41:58.123 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko
2024-03-29T08:41:58.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko
2024-03-29T08:41:58.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko
2024-03-29T08:41:58.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko
2024-03-29T08:41:58.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko
2024-03-29T08:41:58.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko
2024-03-29T08:41:58.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko
2024-03-29T08:41:58.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko
2024-03-29T08:41:58.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko
2024-03-29T08:41:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko
2024-03-29T08:41:58.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko
2024-03-29T08:41:58.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko
2024-03-29T08:41:58.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko
2024-03-29T08:41:58.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko
2024-03-29T08:41:58.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt
2024-03-29T08:41:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko
2024-03-29T08:41:58.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko
2024-03-29T08:41:58.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko
2024-03-29T08:41:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko
2024-03-29T08:41:58.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko
2024-03-29T08:41:58.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd
2024-03-29T08:41:58.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko
2024-03-29T08:41:58.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko
2024-03-29T08:41:58.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko
2024-03-29T08:41:58.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710
2024-03-29T08:41:58.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko
2024-03-29T08:41:58.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom
2024-03-29T08:41:58.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko
2024-03-29T08:41:58.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko
2024-03-29T08:41:58.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko
2024-03-29T08:41:58.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko
2024-03-29T08:41:58.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko
2024-03-29T08:41:58.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko
2024-03-29T08:41:58.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net
2024-03-29T08:41:58.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko
2024-03-29T08:41:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec
2024-03-29T08:41:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros
2024-03-29T08:41:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko
2024-03-29T08:41:58.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko
2024-03-29T08:41:58.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec
2024-03-29T08:41:58.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko
2024-03-29T08:41:58.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko
2024-03-29T08:41:58.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko
2024-03-29T08:41:58.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core
2024-03-29T08:41:58.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko
2024-03-29T08:41:58.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko
2024-03-29T08:41:58.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko
2024-03-29T08:41:58.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko
2024-03-29T08:41:58.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko
2024-03-29T08:41:58.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio
2024-03-29T08:41:58.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko
2024-03-29T08:41:58.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko
2024-03-29T08:41:58.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko
2024-03-29T08:41:58.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip
2024-03-29T08:41:58.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko
2024-03-29T08:41:58.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host
2024-03-29T08:41:58.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie
2024-03-29T08:41:58.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko
2024-03-29T08:41:58.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko
2024-03-29T08:41:58.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap
2024-03-29T08:41:58.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko
2024-03-29T08:41:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko
2024-03-29T08:41:58.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko
2024-03-29T08:41:58.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko
2024-03-29T08:41:58.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa
2024-03-29T08:41:58.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko
2024-03-29T08:41:58.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko
2024-03-29T08:41:58.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko
2024-03-29T08:41:58.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas
2024-03-29T08:41:58.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko
2024-03-29T08:41:58.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko
2024-03-29T08:41:58.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko
2024-03-29T08:41:58.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko
2024-03-29T08:41:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko
2024-03-29T08:41:58.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250
2024-03-29T08:41:58.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko
2024-03-29T08:41:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko
2024-03-29T08:41:58.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga
2024-03-29T08:41:58.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko
2024-03-29T08:41:58.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko
2024-03-29T08:41:58.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko
2024-03-29T08:41:58.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko
2024-03-29T08:41:58.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko
2024-03-29T08:41:58.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko
2024-03-29T08:41:58.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video
2024-03-29T08:41:58.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko
2024-03-29T08:41:58.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko
2024-03-29T08:41:58.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko
2024-03-29T08:41:58.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko
2024-03-29T08:41:58.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko
2024-03-29T08:41:58.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko
2024-03-29T08:41:58.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm
2024-03-29T08:41:58.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko
2024-03-29T08:41:58.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix
2024-03-29T08:41:58.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko
2024-03-29T08:41:58.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko
2024-03-29T08:41:58.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko
2024-03-29T08:41:58.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko
2024-03-29T08:41:58.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko
2024-03-29T08:41:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko
2024-03-29T08:41:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko
2024-03-29T08:41:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko
2024-03-29T08:41:58.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko
2024-03-29T08:41:58.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko
2024-03-29T08:41:58.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm
2024-03-29T08:41:58.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko
2024-03-29T08:41:58.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv
2024-03-29T08:41:58.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko
2024-03-29T08:41:58.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko
2024-03-29T08:41:58.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko
2024-03-29T08:41:58.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan
2024-03-29T08:41:58.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko
2024-03-29T08:41:58.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko
2024-03-29T08:41:58.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko
2024-03-29T08:41:58.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko
2024-03-29T08:41:58.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko
2024-03-29T08:41:58.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko
2024-03-29T08:41:58.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key
2024-03-29T08:41:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko
2024-03-29T08:41:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko
2024-03-29T08:41:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko
2024-03-29T08:41:58.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko
2024-03-29T08:41:58.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko
2024-03-29T08:41:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko
2024-03-29T08:41:58.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko
2024-03-29T08:41:58.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko
2024-03-29T08:41:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko
2024-03-29T08:41:58.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko
2024-03-29T08:41:58.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko
2024-03-29T08:41:58.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko
2024-03-29T08:41:58.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko
2024-03-29T08:41:58.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko
2024-03-29T08:41:58.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko
2024-03-29T08:41:58.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko
2024-03-29T08:41:58.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko
2024-03-29T08:41:58.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko
2024-03-29T08:41:58.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko
2024-03-29T08:41:58.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock
2024-03-29T08:41:58.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys
2024-03-29T08:41:58.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order
2024-03-29T08:41:58.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep
2024-03-29T08:41:58.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols
2024-03-29T08:41:58.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin
2024-03-29T08:41:58.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz
2024-03-29T08:41:58.260 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235
2024-03-29T08:41:58.260 DEBUG:teuthology.orchestra.run.smithi171:> rpm --scripts -qp /tmp/kernel.x86_64.rpm
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:postinstall scriptlet (using /bin/sh):
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -x /usr/bin/kernel-install ]; then
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:	/usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:fi
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:for file in vmlinuz System.map config; do
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:	if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:		cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:	fi
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:done
2024-03-29T08:41:58.285 INFO:teuthology.orchestra.run.smithi171.stdout:preuninstall scriptlet (using /bin/sh):
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -x /sbin/new-kernel-pkg ]; then
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:elif [ -x /usr/bin/kernel-install ]; then
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-install remove 6.8.0-g1df0c7e8a235
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:fi
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:postuninstall scriptlet (using /bin/sh):
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -x /sbin/update-bootloader ]; then
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235
2024-03-29T08:41:58.286 INFO:teuthology.orchestra.run.smithi171.stdout:fi
2024-03-29T08:41:58.287 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools
2024-03-29T08:41:58.369 INFO:teuthology.orchestra.run.smithi171.stdout:Name        : grub2-tools
2024-03-29T08:41:58.369 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch       : 1
2024-03-29T08:41:58.369 INFO:teuthology.orchestra.run.smithi171.stdout:Version     : 2.02
2024-03-29T08:41:58.369 INFO:teuthology.orchestra.run.smithi171.stdout:Release     : 129.el8
2024-03-29T08:41:58.369 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64
2024-03-29T08:41:58.369 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC
2024-03-29T08:41:58.369 INFO:teuthology.orchestra.run.smithi171.stdout:Group       : System Environment/Base
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Size        : 9265586
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:License     : GPLv3+
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Signature   : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM  : grub2-2.02-129.el8.src.rpm
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date  : Tue 19 Jul 2022 02:30:39 PM UTC
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host  : kbuilder.bsys.centos.org
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Relocations : (not relocatable)
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Packager    : CentOS BuildSystem <http://bugs.centos.org>
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor      : CentOS
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:URL         : http://www.gnu.org/software/grub/
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Summary     : Support tools for GRUB.
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:Description :
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:41:58.370 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and
2024-03-29T08:41:58.371 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture.  It supports a rich
2024-03-29T08:41:58.371 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and
2024-03-29T08:41:58.371 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices.
2024-03-29T08:41:58.371 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:41:58.371 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms.
2024-03-29T08:41:58.372 INFO:teuthology.task.kernel:Updating Grub Version: grub2
2024-03-29T08:41:58.372 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 6.8.0-g1df0c7e8a235
2024-03-29T08:41:58.372 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg
2024-03-29T08:42:04.355 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ...
2024-03-29T08:42:06.283 INFO:teuthology.orchestra.run.smithi171.stderr:done
2024-03-29T08:42:06.285 DEBUG:teuthology.orchestra.run.smithi171:> mktemp
2024-03-29T08:42:06.318 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.0bz3ypTAT6
2024-03-29T08:42:06.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0bz3ypTAT6
2024-03-29T08:42:06.401 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.0bz3ypTAT6
2024-03-29T08:42:06.570 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.0bz3ypTAT6 is 6KB
2024-03-29T08:42:06.619 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.0bz3ypTAT6
2024-03-29T08:42:06.636 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true
2024-03-29T08:42:06.701 INFO:teuthology.orchestra.run.smithi171.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf
2024-03-29T08:42:06.702 INFO:teuthology.orchestra.run.smithi171.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf
2024-03-29T08:42:06.702 INFO:teuthology.orchestra.run.smithi171.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf
2024-03-29T08:42:06.702 INFO:teuthology.orchestra.run.smithi171.stdout:a1b29d6c289747bdb22930598d39874a-6.8.0-g1df0c7e8a235.conf
2024-03-29T08:42:06.703 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.8.0-g1df0c7e8a235
2024-03-29T08:42:06.880 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now
2024-03-29T08:42:36.912 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version...
2024-03-29T08:42:36.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-29T08:42:36.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-29T08:43:11.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-29T08:43:20.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-29T08:43:20.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-29T08:43:38.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-29T08:43:50.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-29T08:43:50.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-29T08:43:52.076 DEBUG:teuthology.orchestra.run.smithi171:> true
2024-03-29T08:43:52.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-29T08:43:52.600 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"...
2024-03-29T08:43:52.600 DEBUG:teuthology.orchestra.run.smithi171:> uname -r
2024-03-29T08:43:52.646 INFO:teuthology.orchestra.run.smithi171.stdout:6.8.0-g1df0c7e8a235
2024-03-29T08:43:52.646 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235
2024-03-29T08:43:52.646 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install
2024-03-29T08:43:52.647 DEBUG:teuthology.task.kernel:Distro of this test job: centos
2024-03-29T08:43:53.647 INFO:teuthology.task.kernel:Enabling kdb on mon.a...
2024-03-29T08:43:53.647 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc
2024-03-29T08:43:53.761 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1
2024-03-29T08:43:53.787 DEBUG:teuthology.parallel:result is None
2024-03-29T08:43:53.787 INFO:teuthology.run_tasks:Running task internal.base...
2024-03-29T08:43:53.795 INFO:teuthology.task.internal:Creating test directory...
2024-03-29T08:43:53.796 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest
2024-03-29T08:43:53.845 INFO:teuthology.run_tasks:Running task internal.archive_upload...
2024-03-29T08:43:53.853 INFO:teuthology.run_tasks:Running task internal.archive...
2024-03-29T08:43:53.859 INFO:teuthology.task.internal:Creating archive directory...
2024-03-29T08:43:53.860 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive
2024-03-29T08:43:53.913 INFO:teuthology.run_tasks:Running task internal.coredump...
2024-03-29T08:43:53.920 INFO:teuthology.task.internal:Enabling coredump saving...
2024-03-29T08:43:53.920 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf
2024-03-29T08:43:54.012 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core
2024-03-29T08:43:54.040 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core
2024-03-29T08:43:54.043 INFO:teuthology.run_tasks:Running task internal.sudo...
2024-03-29T08:43:54.052 INFO:teuthology.task.internal:Configuring sudo...
2024-03-29T08:43:54.052 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers
2024-03-29T08:43:54.123 INFO:teuthology.run_tasks:Running task internal.syslog...
2024-03-29T08:43:54.132 INFO:teuthology.task.internal.syslog:Starting syslog monitoring...
2024-03-29T08:43:54.132 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog
2024-03-29T08:43:54.177 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log
2024-03-29T08:43:54.290 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log
2024-03-29T08:43:54.357 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log
2024-03-29T08:43:54.429 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log
2024-03-29T08:43:54.513 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:43:54.513 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf
2024-03-29T08:43:54.600 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart
2024-03-29T08:43:54.723 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service
2024-03-29T08:43:54.971 INFO:teuthology.run_tasks:Running task internal.timer...
2024-03-29T08:43:54.978 INFO:teuthology.task.internal:Starting timer...
2024-03-29T08:43:54.978 INFO:teuthology.run_tasks:Running task pcp...
2024-03-29T08:43:54.988 INFO:teuthology.run_tasks:Running task selinux...
2024-03-29T08:43:54.997 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}
2024-03-29T08:43:54.997 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate
2024-03-29T08:43:55.125 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs:
2024-03-29T08:43:55.129 DEBUG:teuthology.task.selinux:Getting current SELinux state
2024-03-29T08:43:55.129 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce
2024-03-29T08:43:55.172 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive
2024-03-29T08:43:55.173 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'}
2024-03-29T08:43:55.173 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0
2024-03-29T08:43:55.282 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-03-29T08:43:55.283 INFO:teuthology.task.selinux:Putting SELinux into permissive mode
2024-03-29T08:43:55.283 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive
2024-03-29T08:43:55.347 INFO:teuthology.run_tasks:Running task ansible.cephlab...
2024-03-29T08:43:55.358 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git
2024-03-29T08:43:55.363 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin
2024-03-29T08:43:55.489 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main
2024-03-29T08:43:55.509 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}]
2024-03-29T08:43:55.510 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml
2024-03-29T08:51:07.113 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi171.front.sepia.ceph.com')]
2024-03-29T08:51:07.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-29T08:51:07.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-29T08:51:07.203 DEBUG:teuthology.orchestra.run.smithi171:> true
2024-03-29T08:51:07.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-29T08:51:07.318 INFO:teuthology.run_tasks:Running task clock...
2024-03-29T08:51:07.331 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew...
2024-03-29T08:51:07.331 INFO:teuthology.orchestra.run:Running command with timeout 360
2024-03-29T08:51:07.331 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2024-03-29T08:51:07.430 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded.
2024-03-29T08:51:07.461 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded.
2024-03-29T08:51:07.547 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found
2024-03-29T08:51:07.574 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon
2024-03-29T08:51:07.604 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found.
2024-03-29T08:51:07.635 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found.
2024-03-29T08:51:07.738 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found
2024-03-29T08:51:07.745 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
2024-03-29T08:51:07.745 INFO:teuthology.orchestra.run.smithi171.stdout:===============================================================================
2024-03-29T08:51:07.745 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com     0   6     0     -     +0ns[   +0ns] +/-    0ns
2024-03-29T08:51:07.745 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com     0   6     0     -     +0ns[   +0ns] +/-    0ns
2024-03-29T08:51:07.745 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com     0   6     0     -     +0ns[   +0ns] +/-    0ns
2024-03-29T08:51:07.745 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com     0   6     0     -     +0ns[   +0ns] +/-    0ns
2024-03-29T08:51:07.746 INFO:teuthology.run_tasks:Running task install...
2024-03-29T08:51:07.754 DEBUG:teuthology.task.install:project ceph
2024-03-29T08:51:07.754 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}}
2024-03-29T08:51:07.754 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}
2024-03-29T08:51:07.754 INFO:teuthology.task.install:Using flavor: default
2024-03-29T08:51:07.760 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']}
2024-03-29T08:51:07.760 INFO:teuthology.task.install:extra packages: ['librados2']
2024-03-29T08:51:07.760 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2', 'tag': None, 'wait_for_package': False}
2024-03-29T08:51:07.761 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2024-03-29T08:51:07.761 INFO:teuthology.packaging:ref: None
2024-03-29T08:51:07.761 INFO:teuthology.packaging:tag: None
2024-03-29T08:51:07.761 INFO:teuthology.packaging:branch: pacific
2024-03-29T08:51:07.761 INFO:teuthology.packaging:sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
2024-03-29T08:51:07.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific
2024-03-29T08:51:07.969 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/
2024-03-29T08:51:07.969 INFO:teuthology.task.install.rpm:Package version is 16.2.15-0
2024-03-29T08:51:08.000 INFO:teuthology.packaging:Writing yum repo:
[ceph]
name=ceph packages for $basearch
baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/$basearch
enabled=1
gpgcheck=0
type=rpm-md

[ceph-noarch]
name=ceph noarch packages
baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/noarch
enabled=1
gpgcheck=0
type=rpm-md

[ceph-source]
name=ceph source packages
baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/SRPMS
enabled=1
gpgcheck=0
type=rpm-md

2024-03-29T08:51:08.000 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:51:08.000 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo
2024-03-29T08:51:08.067 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64
2024-03-29T08:51:08.067 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2024-03-29T08:51:08.067 INFO:teuthology.packaging:ref: None
2024-03-29T08:51:08.067 INFO:teuthology.packaging:tag: None
2024-03-29T08:51:08.067 INFO:teuthology.packaging:branch: pacific
2024-03-29T08:51:08.067 INFO:teuthology.packaging:sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
2024-03-29T08:51:08.068 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi
2024-03-29T08:51:08.176 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig
2024-03-29T08:51:08.268 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf
2024-03-29T08:51:08.333 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1
2024-03-29T08:51:08.336 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all
2024-03-29T08:51:08.682 INFO:teuthology.orchestra.run.smithi171.stdout:76 files removed
2024-03-29T08:51:08.718 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw
2024-03-29T08:51:09.335 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64                        968 kB/s |  76 kB     00:00
2024-03-29T08:51:09.444 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages                            211 kB/s |  15 kB     00:00
2024-03-29T08:51:09.562 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages                             19 kB/s | 1.7 kB     00:00
2024-03-29T08:51:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - AppStream                      15 MB/s |  28 MB     00:01
2024-03-29T08:51:18.180 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - BaseOS                        7.5 MB/s |  10 MB     00:01
2024-03-29T08:51:20.264 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - Extras                         44 kB/s |  18 kB     00:00
2024-03-29T08:51:20.806 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - Extras common packages         17 kB/s | 7.5 kB     00:00
2024-03-29T08:51:24.409 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - PowerTools                    1.4 MB/s | 4.9 MB     00:03
2024-03-29T08:51:25.527 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph     26 kB/s | 3.5 kB     00:00
2024-03-29T08:51:27.306 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux             9.7 MB/s |  16 MB     00:01
2024-03-29T08:51:31.745 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras                                      372 kB/s |  24 kB     00:00
2024-03-29T08:51:35.632 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout: Package                   Arch       Version               Repository     Size
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw              x86_64     2:16.2.15-0.el8       ceph           12 M
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading:
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout: librados2                 x86_64     2:16.2.15-0.el8       ceph          3.7 M
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1                   x86_64     2:16.2.15-0.el8       ceph          4.2 M
2024-03-29T08:51:35.635 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies:
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base                 x86_64     2:16.2.15-0.el8       ceph          6.1 M
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common               x86_64     2:16.2.15-0.el8       ceph           24 M
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux              x86_64     2:16.2.15-0.el8       ceph           26 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs           x86_64     1:2.7-9.el8           epel          306 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: leveldb                   x86_64     1.22-1.el8            epel          181 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2                x86_64     2:16.2.15-0.el8       ceph          825 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: liboath                   x86_64     2.6.2-3.el8           epel           59 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq               x86_64     0.9.0-5.el8           baseos         47 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1          x86_64     2:16.2.15-0.el8       ceph          494 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka                x86_64     1.6.1-1.el8           appstream     677 k
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2                   x86_64     2:16.2.15-0.el8       ceph          3.8 M
2024-03-29T08:51:35.636 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind                 x86_64     1.3.1-3.el8           epel           75 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust                 x86_64     2.8.1-11.el8          appstream     259 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse     x86_64     2:16.2.15-0.el8       ceph           45 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common       x86_64     2:16.2.15-0.el8       ceph           99 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs            x86_64     2:16.2.15-0.el8       ceph          215 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable       noarch     0.7.2-14.el8          appstream      44 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados             x86_64     2:16.2.15-0.el8       ceph          389 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd               x86_64     2:16.2.15-0.el8       ceph          369 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw               x86_64     2:16.2.15-0.el8       ceph          114 k
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout:Install  21 Packages
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade   2 Packages
2024-03-29T08:51:35.637 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:51:35.638 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 58 M
2024-03-29T08:51:35.638 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:51:36.280 INFO:teuthology.orchestra.run.smithi171.stdout:(1/23): ceph-base-16.2.15-0.el8.x86_64.rpm       28 MB/s | 6.1 MB     00:00
2024-03-29T08:51:36.305 INFO:teuthology.orchestra.run.smithi171.stdout:(2/23): ceph-selinux-16.2.15-0.el8.x86_64.rpm   1.0 MB/s |  26 kB     00:00
2024-03-29T08:51:36.347 INFO:teuthology.orchestra.run.smithi171.stdout:(3/23): libcephfs2-16.2.15-0.el8.x86_64.rpm      19 MB/s | 825 kB     00:00
2024-03-29T08:51:36.381 INFO:teuthology.orchestra.run.smithi171.stdout:(4/23): libradosstriper1-16.2.15-0.el8.x86_64.r  15 MB/s | 494 kB     00:00
2024-03-29T08:51:36.498 INFO:teuthology.orchestra.run.smithi171.stdout:(5/23): librgw2-16.2.15-0.el8.x86_64.rpm         32 MB/s | 3.8 MB     00:00
2024-03-29T08:51:36.523 INFO:teuthology.orchestra.run.smithi171.stdout:(6/23): python3-ceph-argparse-16.2.15-0.el8.x86 1.8 MB/s |  45 kB     00:00
2024-03-29T08:51:36.549 INFO:teuthology.orchestra.run.smithi171.stdout:(7/23): python3-ceph-common-16.2.15-0.el8.x86_6 3.9 MB/s |  99 kB     00:00
2024-03-29T08:51:36.574 INFO:teuthology.orchestra.run.smithi171.stdout:(8/23): python3-cephfs-16.2.15-0.el8.x86_64.rpm 8.4 MB/s | 215 kB     00:00
2024-03-29T08:51:36.608 INFO:teuthology.orchestra.run.smithi171.stdout:(9/23): python3-rados-16.2.15-0.el8.x86_64.rpm   11 MB/s | 389 kB     00:00
2024-03-29T08:51:36.642 INFO:teuthology.orchestra.run.smithi171.stdout:(10/23): python3-rbd-16.2.15-0.el8.x86_64.rpm    11 MB/s | 369 kB     00:00
2024-03-29T08:51:36.767 INFO:teuthology.orchestra.run.smithi171.stdout:(11/23): ceph-radosgw-16.2.15-0.el8.x86_64.rpm   16 MB/s |  12 MB     00:00
2024-03-29T08:51:36.792 INFO:teuthology.orchestra.run.smithi171.stdout:(12/23): python3-rgw-16.2.15-0.el8.x86_64.rpm   760 kB/s | 114 kB     00:00
2024-03-29T08:51:37.110 INFO:teuthology.orchestra.run.smithi171.stdout:(13/23): ceph-common-16.2.15-0.el8.x86_64.rpm    23 MB/s |  24 MB     00:01
2024-03-29T08:51:37.235 INFO:teuthology.orchestra.run.smithi171.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm      1.4 MB/s | 677 kB     00:00
2024-03-29T08:51:37.260 INFO:teuthology.orchestra.run.smithi171.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm      555 kB/s | 259 kB     00:00
2024-03-29T08:51:37.285 INFO:teuthology.orchestra.run.smithi171.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 251 kB/s |  44 kB     00:00
2024-03-29T08:51:37.619 INFO:teuthology.orchestra.run.smithi171.stdout:(17/23): librabbitmq-0.9.0-5.el8.x86_64.rpm     122 kB/s |  47 kB     00:00
2024-03-29T08:51:37.861 INFO:teuthology.orchestra.run.smithi171.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm          314 kB/s | 181 kB     00:00
2024-03-29T08:51:37.945 INFO:teuthology.orchestra.run.smithi171.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm   448 kB/s | 306 kB     00:00
2024-03-29T08:51:37.987 INFO:teuthology.orchestra.run.smithi171.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm       599 kB/s |  75 kB     00:00
2024-03-29T08:51:38.087 INFO:teuthology.orchestra.run.smithi171.stdout:(21/23): librados2-16.2.15-0.el8.x86_64.rpm      26 MB/s | 3.7 MB     00:00
2024-03-29T08:51:38.112 INFO:teuthology.orchestra.run.smithi171.stdout:(22/23): liboath-2.6.2-3.el8.x86_64.rpm         119 kB/s |  59 kB     00:00
2024-03-29T08:51:38.188 INFO:teuthology.orchestra.run.smithi171.stdout:(23/23): librbd1-16.2.15-0.el8.x86_64.rpm        21 MB/s | 4.2 MB     00:00
2024-03-29T08:51:38.193 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:51:38.193 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                            23 MB/s |  58 MB     00:02
2024-03-29T08:51:38.283 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:51:38.335 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:51:38.335 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:51:38.724 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:51:38.728 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:51:39.854 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:51:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : liboath-2.6.2-3.el8.x86_64                            1/25
2024-03-29T08:51:40.267 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : lttng-ust-2.8.1-11.el8.x86_64                         2/25
2024-03-29T08:51:40.692 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64                         2/25
2024-03-29T08:51:40.900 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : librados2-2:16.2.15-0.el8.x86_64                      3/25
2024-03-29T08:51:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librados2-2:16.2.15-0.el8.x86_64                      3/25
2024-03-29T08:51:41.317 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-rados-2:16.2.15-0.el8.x86_64                  4/25
2024-03-29T08:51:41.508 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : libcephfs2-2:16.2.15-0.el8.x86_64                     5/25
2024-03-29T08:51:41.961 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64                     5/25
2024-03-29T08:51:42.166 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : librbd1-2:16.2.15-0.el8.x86_64                        6/25
2024-03-29T08:51:42.248 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64                        6/25
2024-03-29T08:51:42.523 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : librabbitmq-0.9.0-5.el8.x86_64                        7/25
2024-03-29T08:51:43.040 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : librdkafka-1.6.1-1.el8.x86_64                         8/25
2024-03-29T08:51:43.208 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : librgw2-2:16.2.15-0.el8.x86_64                        9/25
2024-03-29T08:51:43.290 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64                        9/25
2024-03-29T08:51:43.497 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : leveldb-1.22-1.el8.x86_64                            10/25
2024-03-29T08:51:43.640 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-ceph-argparse-2:16.2.15-0.el8.x86_64         11/25
2024-03-29T08:51:43.830 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-cephfs-2:16.2.15-0.el8.x86_64                12/25
2024-03-29T08:51:44.078 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-rgw-2:16.2.15-0.el8.x86_64                   13/25
2024-03-29T08:51:44.377 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-rbd-2:16.2.15-0.el8.x86_64                   14/25
2024-03-29T08:51:44.516 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : libradosstriper1-2:16.2.15-0.el8.x86_64              15/25
2024-03-29T08:51:44.620 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64              15/25
2024-03-29T08:51:44.855 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : libunwind-1.3.1-3.el8.x86_64                         16/25
2024-03-29T08:51:45.050 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : gperftools-libs-1:2.7-9.el8.x86_64                   17/25
2024-03-29T08:51:45.275 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-prettytable-0.7.2-14.el8.noarch              18/25
2024-03-29T08:51:45.491 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-ceph-common-2:16.2.15-0.el8.x86_64           19/25
2024-03-29T08:51:48.188 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64                   20/25
2024-03-29T08:51:48.433 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-common-2:16.2.15-0.el8.x86_64                   20/25
2024-03-29T08:51:49.235 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64                   20/25
2024-03-29T08:51:49.961 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-base-2:16.2.15-0.el8.x86_64                     21/25
2024-03-29T08:51:50.166 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64                     21/25
2024-03-29T08:51:50.290 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-selinux-2:16.2.15-0.el8.x86_64                  22/25
2024-03-29T08:52:11.302 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64                  22/25
2024-03-29T08:52:11.302 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys
2024-03-29T08:52:11.302 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc
2024-03-29T08:52:11.302 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev
2024-03-29T08:52:11.302 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /run
2024-03-29T08:52:11.302 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt
2024-03-29T08:52:11.302 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp
2024-03-29T08:52:11.303 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home
2024-03-29T08:52:11.303 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp
2024-03-29T08:52:11.303 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev
2024-03-29T08:52:11.303 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:12.549 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-radosgw-2:16.2.15-0.el8.x86_64                  23/25
2024-03-29T08:52:12.660 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64                  23/25
2024-03-29T08:52:12.660 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : librbd1-1:12.2.7-9.el8.x86_64                        24/25
2024-03-29T08:52:12.891 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64                        24/25
2024-03-29T08:52:12.892 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : librados2-1:12.2.7-9.el8.x86_64                      25/25
2024-03-29T08:52:13.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librados2-1:12.2.7-9.el8.x86_64                      25/25
2024-03-29T08:52:13.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-base-2:16.2.15-0.el8.x86_64                      1/25
2024-03-29T08:52:13.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-common-2:16.2.15-0.el8.x86_64                    2/25
2024-03-29T08:52:13.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-radosgw-2:16.2.15-0.el8.x86_64                   3/25
2024-03-29T08:52:13.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-selinux-2:16.2.15-0.el8.x86_64                   4/25
2024-03-29T08:52:13.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephfs2-2:16.2.15-0.el8.x86_64                     5/25
2024-03-29T08:52:13.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libradosstriper1-2:16.2.15-0.el8.x86_64               6/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librgw2-2:16.2.15-0.el8.x86_64                        7/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-ceph-argparse-2:16.2.15-0.el8.x86_64          8/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-ceph-common-2:16.2.15-0.el8.x86_64            9/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-cephfs-2:16.2.15-0.el8.x86_64                10/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rados-2:16.2.15-0.el8.x86_64                 11/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rbd-2:16.2.15-0.el8.x86_64                   12/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rgw-2:16.2.15-0.el8.x86_64                   13/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librdkafka-1.6.1-1.el8.x86_64                        14/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : lttng-ust-2.8.1-11.el8.x86_64                        15/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-prettytable-0.7.2-14.el8.noarch              16/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librabbitmq-0.9.0-5.el8.x86_64                       17/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : gperftools-libs-1:2.7-9.el8.x86_64                   18/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : leveldb-1.22-1.el8.x86_64                            19/25
2024-03-29T08:52:13.910 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : liboath-2.6.2-3.el8.x86_64                           20/25
2024-03-29T08:52:13.911 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libunwind-1.3.1-3.el8.x86_64                         21/25
2024-03-29T08:52:13.911 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librados2-2:16.2.15-0.el8.x86_64                     22/25
2024-03-29T08:52:13.911 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librados2-1:12.2.7-9.el8.x86_64                      23/25
2024-03-29T08:52:13.911 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librbd1-2:16.2.15-0.el8.x86_64                       24/25
2024-03-29T08:52:14.636 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librbd1-1:12.2.7-9.el8.x86_64                        25/25
2024-03-29T08:52:14.636 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded:
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  librados2-2:16.2.15-0.el8.x86_64        librbd1-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-base-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-common-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-radosgw-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-selinux-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  gperftools-libs-1:2.7-9.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  leveldb-1.22-1.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  libcephfs2-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.637 INFO:teuthology.orchestra.run.smithi171.stdout:  liboath-2.6.2-3.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  librabbitmq-0.9.0-5.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  libradosstriper1-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  librdkafka-1.6.1-1.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  librgw2-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  libunwind-1.3.1-3.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  lttng-ust-2.8.1-11.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-ceph-argparse-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-ceph-common-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-cephfs-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-prettytable-0.7.2-14.el8.noarch
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-rados-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-rbd-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.638 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-rgw-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:14.639 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:14.639 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:52:14.998 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-test
2024-03-29T08:52:15.924 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:00:44 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:52:17.610 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:52:17.611 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:17.611 INFO:teuthology.orchestra.run.smithi171.stdout: Package             Architecture Version                 Repository       Size
2024-03-29T08:52:17.611 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:17.611 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:52:17.611 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test           x86_64       2:16.2.15-0.el8         ceph             52 M
2024-03-29T08:52:17.611 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies:
2024-03-29T08:52:17.611 INFO:teuthology.orchestra.run.smithi171.stdout: jq                  x86_64       1.6-8.el8               appstream       203 k
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite       x86_64       2:16.2.15-0.el8         ceph            174 k
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma           x86_64       6.8.2-3.el8             appstream       188 k
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout: socat               x86_64       1.7.4.1-1.el8           appstream       323 k
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet          x86_64       1.6.1-20.el8            appstream        71 k
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout:Install  6 Packages
2024-03-29T08:52:17.612 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:17.613 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 53 M
2024-03-29T08:52:17.613 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 197 M
2024-03-29T08:52:17.613 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:52:17.723 INFO:teuthology.orchestra.run.smithi171.stdout:(1/6): libcephsqlite-16.2.15-0.el8.x86_64.rpm   3.4 MB/s | 174 kB     00:00
2024-03-29T08:52:17.874 INFO:teuthology.orchestra.run.smithi171.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm                  1.0 MB/s | 203 kB     00:00
2024-03-29T08:52:17.899 INFO:teuthology.orchestra.run.smithi171.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm         1.0 MB/s | 188 kB     00:00
2024-03-29T08:52:18.000 INFO:teuthology.orchestra.run.smithi171.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm       707 kB/s |  71 kB     00:00
2024-03-29T08:52:18.055 INFO:teuthology.orchestra.run.smithi171.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm           1.7 MB/s | 323 kB     00:00
2024-03-29T08:52:18.658 INFO:teuthology.orchestra.run.smithi171.stdout:(6/6): ceph-test-16.2.15-0.el8.x86_64.rpm        53 MB/s |  52 MB     00:00
2024-03-29T08:52:18.661 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:52:18.661 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                            51 MB/s |  53 MB     00:01
2024-03-29T08:52:18.752 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:52:18.776 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:52:18.776 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:52:19.125 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:52:19.129 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:52:19.656 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:52:19.872 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : xmlstarlet-1.6.1-20.el8.x86_64                         1/6
2024-03-29T08:52:20.048 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : socat-1.7.4.1-1.el8.x86_64                             2/6
2024-03-29T08:52:20.160 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : oniguruma-6.8.2-3.el8.x86_64                           3/6
2024-03-29T08:52:20.241 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: oniguruma-6.8.2-3.el8.x86_64                           3/6
2024-03-29T08:52:20.467 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : jq-1.6-8.el8.x86_64                                    4/6
2024-03-29T08:52:20.610 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : libcephsqlite-2:16.2.15-0.el8.x86_64                   5/6
2024-03-29T08:52:25.527 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64                   5/6
2024-03-29T08:52:25.758 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-test-2:16.2.15-0.el8.x86_64                       6/6
2024-03-29T08:52:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-test-2:16.2.15-0.el8.x86_64                       6/6
2024-03-29T08:52:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-test-2:16.2.15-0.el8.x86_64                       1/6
2024-03-29T08:52:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephsqlite-2:16.2.15-0.el8.x86_64                   2/6
2024-03-29T08:52:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : jq-1.6-8.el8.x86_64                                    3/6
2024-03-29T08:52:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : oniguruma-6.8.2-3.el8.x86_64                           4/6
2024-03-29T08:52:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : socat-1.7.4.1-1.el8.x86_64                             5/6
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : xmlstarlet-1.6.1-20.el8.x86_64                         6/6
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-test-2:16.2.15-0.el8.x86_64          jq-1.6-8.el8.x86_64
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:  libcephsqlite-2:16.2.15-0.el8.x86_64      oniguruma-6.8.2-3.el8.x86_64
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:  socat-1.7.4.1-1.el8.x86_64                xmlstarlet-1.6.1-20.el8.x86_64
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:26.570 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:52:26.764 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph
2024-03-29T08:52:27.727 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:00:56 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:52:29.432 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:52:29.435 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:29.435 INFO:teuthology.orchestra.run.smithi171.stdout: Package                     Arch      Version             Repository      Size
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: ceph                        x86_64    2:16.2.15-0.el8     ceph           6.3 k
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies:
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds                    x86_64    2:16.2.15-0.el8     ceph           2.4 M
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr                    x86_64    2:16.2.15-0.el8     ceph           1.6 M
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core       noarch    2:16.2.15-0.el8     ceph-noarch    245 k
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon                    x86_64    2:16.2.15-0.el8     ceph           5.2 M
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd                    x86_64    2:16.2.15-0.el8     ceph            19 M
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt              x86_64    3.1.6-2.el8.1       epel            44 k
2024-03-29T08:52:29.436 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4      noarch    4.6.3-2.el8.1       epel           185 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi                x86_64    1.11.5-6.el8        baseos         249 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot             noarch    8.5.2-1.el8         epel           173 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy            noarch    18.4.0-1.el8        epel           384 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography        x86_64    3.2.1-7.el8         baseos         641 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco              noarch    6.2-6.el8           epel            11 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools    noarch    2.0-4.el8           epel            18 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils            noarch    0.3.5-11.el8        epel            49 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako                noarch    1.0.6-14.el8        appstream      157 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe          x86_64    0.23-19.el8         appstream       39 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools      noarch    7.2.0-3.el8         epel            59 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan               noarch    1.3.2-9.el8         epel           283 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend             noarch    2.6-1.el8           epel            16 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL           noarch    19.0.0-1.el8        appstream      103 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser           noarch    2.14-14.el8         baseos         109 k
2024-03-29T08:52:29.437 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz                noarch    2017.2-11.el8       appstream       57 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric       noarch    0.8.1-17.el8        epel            19 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch      noarch    3.4.0.3-18.el8      epel            24 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora             noarch    1.14.1-5.el8        epel            29 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme             noarch    0.6.0-4.el8         epel            27 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress            noarch    1.4.3-1.el8         epel           255 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob               noarch    1.8.5-1.el8.1       epel           251 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest             noarch    2.0.33-1.el8        epel            85 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug            noarch    0.12.2-4.el8        appstream      457 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile         noarch    2.0-2.el8           epel            23 k
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:52:29.438 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:29.439 INFO:teuthology.orchestra.run.smithi171.stdout:Install  32 Packages
2024-03-29T08:52:29.439 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:29.439 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 32 M
2024-03-29T08:52:29.439 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 104 M
2024-03-29T08:52:29.439 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:52:29.690 INFO:teuthology.orchestra.run.smithi171.stdout:(1/32): ceph-16.2.15-0.el8.x86_64.rpm           113 kB/s | 6.3 kB     00:00
2024-03-29T08:52:29.770 INFO:teuthology.orchestra.run.smithi171.stdout:(2/32): ceph-mgr-16.2.15-0.el8.x86_64.rpm        12 MB/s | 1.6 MB     00:00
2024-03-29T08:52:29.832 INFO:teuthology.orchestra.run.smithi171.stdout:(3/32): ceph-mds-16.2.15-0.el8.x86_64.rpm        12 MB/s | 2.4 MB     00:00
2024-03-29T08:52:29.866 INFO:teuthology.orchestra.run.smithi171.stdout:(4/32): ceph-mgr-modules-core-16.2.15-0.el8.noa 7.2 MB/s | 245 kB     00:00
2024-03-29T08:52:29.975 INFO:teuthology.orchestra.run.smithi171.stdout:(5/32): ceph-mon-16.2.15-0.el8.x86_64.rpm        18 MB/s | 5.2 MB     00:00
2024-03-29T08:52:30.042 INFO:teuthology.orchestra.run.smithi171.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm    897 kB/s | 157 kB     00:00
2024-03-29T08:52:30.075 INFO:teuthology.orchestra.run.smithi171.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 387 kB/s |  39 kB     00:00
2024-03-29T08:52:30.301 INFO:teuthology.orchestra.run.smithi171.stdout:(8/32): ceph-osd-16.2.15-0.el8.x86_64.rpm        35 MB/s |  19 MB     00:00
2024-03-29T08:52:30.335 INFO:teuthology.orchestra.run.smithi171.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm   220 kB/s |  57 kB     00:00
2024-03-29T08:52:30.360 INFO:teuthology.orchestra.run.smithi171.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 325 kB/s | 103 kB     00:00
2024-03-29T08:52:30.536 INFO:teuthology.orchestra.run.smithi171.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.9 MB/s | 457 kB     00:00
2024-03-29T08:52:30.878 INFO:teuthology.orchestra.run.smithi171.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm   459 kB/s | 249 kB     00:00
2024-03-29T08:52:30.992 INFO:teuthology.orchestra.run.smithi171.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 384 kB/s |  44 kB     00:00
2024-03-29T08:52:31.053 INFO:teuthology.orchestra.run.smithi171.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 211 kB/s | 109 kB     00:00
2024-03-29T08:52:31.087 INFO:teuthology.orchestra.run.smithi171.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.9 MB/s | 185 kB     00:00
2024-03-29T08:52:31.121 INFO:teuthology.orchestra.run.smithi171.stdout:(16/32): python3-cryptography-3.2.1-7.el8.x86_6 843 kB/s | 641 kB     00:00
2024-03-29T08:52:31.180 INFO:teuthology.orchestra.run.smithi171.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm    191 kB/s |  11 kB     00:00
2024-03-29T08:52:31.205 INFO:teuthology.orchestra.run.smithi171.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB     00:00
2024-03-29T08:52:31.230 INFO:teuthology.orchestra.run.smithi171.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 350 kB/s |  18 kB     00:00
2024-03-29T08:52:31.256 INFO:teuthology.orchestra.run.smithi171.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.2 MB/s | 384 kB     00:00
2024-03-29T08:52:31.281 INFO:teuthology.orchestra.run.smithi171.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 646 kB/s |  49 kB     00:00
2024-03-29T08:52:31.323 INFO:teuthology.orchestra.run.smithi171.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 635 kB/s |  59 kB     00:00
2024-03-29T08:52:31.348 INFO:teuthology.orchestra.run.smithi171.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm   233 kB/s |  16 kB     00:00
2024-03-29T08:52:31.374 INFO:teuthology.orchestra.run.smithi171.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 374 kB/s |  19 kB     00:00
2024-03-29T08:52:31.399 INFO:teuthology.orchestra.run.smithi171.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm   1.9 MB/s | 283 kB     00:00
2024-03-29T08:52:31.424 INFO:teuthology.orchestra.run.smithi171.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 316 kB/s |  24 kB     00:00
2024-03-29T08:52:31.450 INFO:teuthology.orchestra.run.smithi171.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 386 kB/s |  29 kB     00:00
2024-03-29T08:52:31.492 INFO:teuthology.orchestra.run.smithi171.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 299 kB/s |  27 kB     00:00
2024-03-29T08:52:31.534 INFO:teuthology.orchestra.run.smithi171.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB     00:00
2024-03-29T08:52:31.559 INFO:teuthology.orchestra.run.smithi171.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.2 MB/s |  85 kB     00:00
2024-03-29T08:52:31.585 INFO:teuthology.orchestra.run.smithi171.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 457 kB/s |  23 kB     00:00
2024-03-29T08:52:31.643 INFO:teuthology.orchestra.run.smithi171.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.3 MB/s | 251 kB     00:00
2024-03-29T08:52:31.645 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:52:31.645 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                            14 MB/s |  32 MB     00:02
2024-03-29T08:52:31.819 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:52:31.862 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:52:31.862 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:52:32.236 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:52:32.240 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:52:33.413 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:52:33.677 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-more-itertools-7.2.0-3.el8.noarch             1/32
2024-03-29T08:52:33.868 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-webob-1.8.5-1.el8.1.noarch                    2/32
2024-03-29T08:52:34.135 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-zc-lockfile-2.0-2.el8.noarch                  3/32
2024-03-29T08:52:34.357 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-waitress-1.4.3-1.el8.noarch                   4/32
2024-03-29T08:52:34.513 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-singledispatch-3.4.0.3-18.el8.noarch          5/32
2024-03-29T08:52:34.738 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-simplegeneric-0.8.1-17.el8.noarch             6/32
2024-03-29T08:52:34.945 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-logutils-0.3.5-11.el8.noarch                  7/32
2024-03-29T08:52:35.131 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-jaraco-6.2-6.el8.noarch                       8/32
2024-03-29T08:52:35.378 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-jaraco-functools-2.0-4.el8.noarch             9/32
2024-03-29T08:52:35.638 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-beautifulsoup4-4.6.3-2.el8.1.noarch          10/32
2024-03-29T08:52:35.901 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-webtest-2.0.33-1.el8.noarch                  11/32
2024-03-29T08:52:36.118 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-pycparser-2.14-14.el8.noarch                 12/32
2024-03-29T08:52:36.548 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-cffi-1.11.5-6.el8.x86_64                     13/32
2024-03-29T08:52:36.806 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-cryptography-3.2.1-7.el8.x86_64              14/32
2024-03-29T08:52:37.026 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-pyOpenSSL-19.0.0-1.el8.noarch                15/32
2024-03-29T08:52:37.284 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-trustme-0.6.0-4.el8.noarch                   16/32
2024-03-29T08:52:37.510 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-cheroot-8.5.2-1.el8.noarch                   17/32
2024-03-29T08:52:37.866 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-bcrypt-3.1.6-2.el8.1.x86_64                  18/32
2024-03-29T08:52:38.074 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-werkzeug-0.12.2-4.el8.noarch                 19/32
2024-03-29T08:52:38.287 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-pytz-2017.2-11.el8.noarch                    20/32
2024-03-29T08:52:38.447 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-tempora-1.14.1-5.el8.noarch                  21/32
2024-03-29T08:52:38.715 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-portend-2.6-1.el8.noarch                     22/32
2024-03-29T08:52:38.959 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-cherrypy-18.4.0-1.el8.noarch                 23/32
2024-03-29T08:52:39.190 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-markupsafe-0.23-19.el8.x86_64                24/32
2024-03-29T08:52:39.592 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-mako-1.0.6-14.el8.noarch                     25/32
2024-03-29T08:52:39.923 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : python3-pecan-1.3.2-9.el8.noarch                     26/32
2024-03-29T08:52:40.321 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch         27/32
2024-03-29T08:52:40.511 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-mgr-2:16.2.15-0.el8.x86_64                      28/32
2024-03-29T08:52:42.143 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64                      28/32
2024-03-29T08:52:42.299 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-osd-2:16.2.15-0.el8.x86_64                      29/32
2024-03-29T08:52:42.797 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64                      29/32
2024-03-29T08:52:43.020 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-mon-2:16.2.15-0.el8.x86_64                      30/32
2024-03-29T08:52:43.272 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64                      30/32
2024-03-29T08:52:43.424 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-mds-2:16.2.15-0.el8.x86_64                      31/32
2024-03-29T08:52:43.464 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64                      31/32
2024-03-29T08:52:43.623 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-2:16.2.15-0.el8.x86_64                          32/32
2024-03-29T08:52:43.723 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-2:16.2.15-0.el8.x86_64                          32/32
2024-03-29T08:52:43.723 INFO:teuthology.orchestra.run.smithi171.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory
2024-03-29T08:52:43.724 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:44.255 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-2:16.2.15-0.el8.x86_64                           1/32
2024-03-29T08:52:44.255 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mds-2:16.2.15-0.el8.x86_64                       2/32
2024-03-29T08:52:44.255 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mgr-2:16.2.15-0.el8.x86_64                       3/32
2024-03-29T08:52:44.255 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mon-2:16.2.15-0.el8.x86_64                       4/32
2024-03-29T08:52:44.255 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-osd-2:16.2.15-0.el8.x86_64                       5/32
2024-03-29T08:52:44.255 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch          6/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-mako-1.0.6-14.el8.noarch                      7/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-markupsafe-0.23-19.el8.x86_64                 8/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-pyOpenSSL-19.0.0-1.el8.noarch                 9/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-pytz-2017.2-11.el8.noarch                    10/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-werkzeug-0.12.2-4.el8.noarch                 11/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-cffi-1.11.5-6.el8.x86_64                     12/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-cryptography-3.2.1-7.el8.x86_64              13/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-pycparser-2.14-14.el8.noarch                 14/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-bcrypt-3.1.6-2.el8.1.x86_64                  15/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-beautifulsoup4-4.6.3-2.el8.1.noarch          16/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-cheroot-8.5.2-1.el8.noarch                   17/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-cherrypy-18.4.0-1.el8.noarch                 18/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-jaraco-6.2-6.el8.noarch                      19/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-jaraco-functools-2.0-4.el8.noarch            20/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-logutils-0.3.5-11.el8.noarch                 21/32
2024-03-29T08:52:44.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-more-itertools-7.2.0-3.el8.noarch            22/32
2024-03-29T08:52:44.257 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-pecan-1.3.2-9.el8.noarch                     23/32
2024-03-29T08:52:44.257 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-portend-2.6-1.el8.noarch                     24/32
2024-03-29T08:52:44.257 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-simplegeneric-0.8.1-17.el8.noarch            25/32
2024-03-29T08:52:44.258 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-singledispatch-3.4.0.3-18.el8.noarch         26/32
2024-03-29T08:52:44.258 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-tempora-1.14.1-5.el8.noarch                  27/32
2024-03-29T08:52:44.258 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-trustme-0.6.0-4.el8.noarch                   28/32
2024-03-29T08:52:44.258 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-waitress-1.4.3-1.el8.noarch                  29/32
2024-03-29T08:52:44.258 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-webob-1.8.5-1.el8.1.noarch                   30/32
2024-03-29T08:52:44.258 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-webtest-2.0.33-1.el8.noarch                  31/32
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-zc-lockfile-2.0-2.el8.noarch                 32/32
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mds-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mgr-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mgr-modules-core-2:16.2.15-0.el8.noarch
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mon-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-osd-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-bcrypt-3.1.6-2.el8.1.x86_64
2024-03-29T08:52:45.121 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-beautifulsoup4-4.6.3-2.el8.1.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-cffi-1.11.5-6.el8.x86_64
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-cheroot-8.5.2-1.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-cherrypy-18.4.0-1.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-cryptography-3.2.1-7.el8.x86_64
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-jaraco-6.2-6.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-jaraco-functools-2.0-4.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-logutils-0.3.5-11.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-mako-1.0.6-14.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-markupsafe-0.23-19.el8.x86_64
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-more-itertools-7.2.0-3.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-pecan-1.3.2-9.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-portend-2.6-1.el8.noarch
2024-03-29T08:52:45.122 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-pyOpenSSL-19.0.0-1.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-pycparser-2.14-14.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-pytz-2017.2-11.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-simplegeneric-0.8.1-17.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-singledispatch-3.4.0.3-18.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-tempora-1.14.1-5.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-trustme-0.6.0-4.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-waitress-1.4.3-1.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-webob-1.8.5-1.el8.1.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-webtest-2.0.33-1.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-werkzeug-0.12.2-4.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-zc-lockfile-2.0-2.el8.noarch
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:45.123 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:52:45.709 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-base
2024-03-29T08:52:46.640 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:15 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:52:48.261 INFO:teuthology.orchestra.run.smithi171.stdout:Package ceph-base-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:52:48.315 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:52:48.316 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:52:48.316 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:52:48.442 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-immutable-object-cache
2024-03-29T08:52:49.354 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:18 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:52:51.089 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:52:51.090 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:51.090 INFO:teuthology.orchestra.run.smithi171.stdout: Package                         Arch       Version              Repo      Size
2024-03-29T08:52:51.090 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache     x86_64     2:16.2.15-0.el8      ceph     161 k
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:Install  1 Package
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 161 k
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 470 k
2024-03-29T08:52:51.091 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:52:51.144 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-immutable-object-cache-16.2.15-0.el8.x86_6 3.0 MB/s | 161 kB     00:00
2024-03-29T08:52:51.145 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:52:51.145 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                           2.9 MB/s | 161 kB     00:00
2024-03-29T08:52:51.145 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:52:51.158 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:52:51.159 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:52:51.213 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:52:51.216 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:52:51.334 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:52:51.539 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64     1/1
2024-03-29T08:52:52.190 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64     1/1
2024-03-29T08:52:52.649 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64     1/1
2024-03-29T08:52:52.649 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:52.649 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:52:52.649 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64
2024-03-29T08:52:52.649 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:52.649 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:52:52.891 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-mgr
2024-03-29T08:52:53.825 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:22 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:52:55.595 INFO:teuthology.orchestra.run.smithi171.stdout:Package ceph-mgr-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:52:55.646 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:52:55.648 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:52:55.648 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:52:56.407 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-fuse
2024-03-29T08:52:57.339 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:26 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:52:59.027 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout: Package           Architecture   Version                  Repository      Size
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse         x86_64         2:16.2.15-0.el8          ceph           911 k
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies:
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout: fuse              x86_64         2.9.7-19.el8             baseos          83 k
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:Install  2 Packages
2024-03-29T08:52:59.028 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:52:59.029 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 994 k
2024-03-29T08:52:59.029 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 2.8 M
2024-03-29T08:52:59.029 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:52:59.160 INFO:teuthology.orchestra.run.smithi171.stdout:(1/2): ceph-fuse-16.2.15-0.el8.x86_64.rpm        14 MB/s | 911 kB     00:00
2024-03-29T08:52:59.551 INFO:teuthology.orchestra.run.smithi171.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm             183 kB/s |  83 kB     00:00
2024-03-29T08:52:59.552 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:52:59.552 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                           1.9 MB/s | 994 kB     00:00
2024-03-29T08:52:59.575 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:52:59.600 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:52:59.600 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:52:59.706 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:52:59.710 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:52:59.922 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:53:00.199 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : fuse-2.9.7-19.el8.x86_64                               1/2
2024-03-29T08:53:00.370 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : ceph-fuse-2:16.2.15-0.el8.x86_64                       2/2
2024-03-29T08:53:00.973 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-fuse-2:16.2.15-0.el8.x86_64                       2/2
2024-03-29T08:53:00.973 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-fuse-2:16.2.15-0.el8.x86_64                       1/2
2024-03-29T08:53:01.415 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : fuse-2.9.7-19.el8.x86_64                               2/2
2024-03-29T08:53:01.415 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:01.415 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:53:01.415 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-fuse-2:16.2.15-0.el8.x86_64           fuse-2.9.7-19.el8.x86_64
2024-03-29T08:53:01.415 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:01.415 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:01.663 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install librados-devel
2024-03-29T08:53:02.593 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:31 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:04.288 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:04.288 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:04.288 INFO:teuthology.orchestra.run.smithi171.stdout: Package               Architecture  Version                  Repository   Size
2024-03-29T08:53:04.288 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel        x86_64        2:16.2.15-0.el8          ceph        131 k
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout:Install  1 Package
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:04.289 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 131 k
2024-03-29T08:53:04.290 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 432 k
2024-03-29T08:53:04.290 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:53:04.342 INFO:teuthology.orchestra.run.smithi171.stdout:librados-devel-16.2.15-0.el8.x86_64.rpm         2.5 MB/s | 131 kB     00:00
2024-03-29T08:53:04.343 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:53:04.343 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                           2.4 MB/s | 131 kB     00:00
2024-03-29T08:53:04.343 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:53:04.350 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:53:04.350 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:53:04.405 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:53:04.409 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:53:04.527 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:53:04.693 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : librados-devel-2:16.2.15-0.el8.x86_64                  1/1
2024-03-29T08:53:05.075 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librados-devel-2:16.2.15-0.el8.x86_64                  1/1
2024-03-29T08:53:05.496 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librados-devel-2:16.2.15-0.el8.x86_64                  1/1
2024-03-29T08:53:05.496 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:05.496 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:53:05.497 INFO:teuthology.orchestra.run.smithi171.stdout:  librados-devel-2:16.2.15-0.el8.x86_64
2024-03-29T08:53:05.497 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:05.497 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:05.762 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install libcephfs2
2024-03-29T08:53:06.698 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:35 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:08.401 INFO:teuthology.orchestra.run.smithi171.stdout:Package libcephfs2-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:08.452 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:08.454 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:08.454 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:08.588 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install libcephfs-devel
2024-03-29T08:53:09.510 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:38 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:11.209 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout: Package                Architecture  Version                 Repository   Size
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel        x86_64        2:16.2.15-0.el8         ceph         25 k
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:Install  1 Package
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 25 k
2024-03-29T08:53:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 107 k
2024-03-29T08:53:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:53:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:libcephfs-devel-16.2.15-0.el8.x86_64.rpm        558 kB/s |  25 kB     00:00
2024-03-29T08:53:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:53:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                           540 kB/s |  25 kB     00:00
2024-03-29T08:53:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:53:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:53:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:53:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:53:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:53:11.323 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:53:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : libcephfs-devel-2:16.2.15-0.el8.x86_64                 1/1
2024-03-29T08:53:11.838 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libcephfs-devel-2:16.2.15-0.el8.x86_64                 1/1
2024-03-29T08:53:12.204 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephfs-devel-2:16.2.15-0.el8.x86_64                 1/1
2024-03-29T08:53:12.204 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:12.204 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:53:12.204 INFO:teuthology.orchestra.run.smithi171.stdout:  libcephfs-devel-2:16.2.15-0.el8.x86_64
2024-03-29T08:53:12.204 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:12.204 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:13.017 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install librados2
2024-03-29T08:53:13.943 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:42 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:15.576 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:15.628 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:15.629 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:15.629 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:15.758 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install librbd1
2024-03-29T08:53:16.667 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:45 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:18.312 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:18.363 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:18.365 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:18.365 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:18.489 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-rados
2024-03-29T08:53:19.410 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:48 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:21.053 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-rados-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:21.105 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:21.106 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:21.106 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:21.235 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-rgw
2024-03-29T08:53:22.155 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:51 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:23.810 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-rgw-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:23.862 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:23.864 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:23.864 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:23.988 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-cephfs
2024-03-29T08:53:24.901 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:53 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:26.555 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-cephfs-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:26.606 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:26.608 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:26.608 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:26.737 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-rbd
2024-03-29T08:53:27.656 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:56 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:29.333 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-rbd-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:29.384 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:29.385 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:29.385 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:29.511 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install rbd-fuse
2024-03-29T08:53:30.430 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:59 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:32.112 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:32.112 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:32.112 INFO:teuthology.orchestra.run.smithi171.stdout: Package           Architecture    Version                  Repository     Size
2024-03-29T08:53:32.112 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:32.112 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:53:32.112 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse          x86_64          2:16.2.15-0.el8          ceph           88 k
2024-03-29T08:53:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:53:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:Install  1 Package
2024-03-29T08:53:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 88 k
2024-03-29T08:53:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 240 k
2024-03-29T08:53:32.114 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:53:32.161 INFO:teuthology.orchestra.run.smithi171.stdout:rbd-fuse-16.2.15-0.el8.x86_64.rpm               1.8 MB/s |  88 kB     00:00
2024-03-29T08:53:32.161 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:53:32.161 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                           1.8 MB/s |  88 kB     00:00
2024-03-29T08:53:32.162 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:53:32.174 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:53:32.174 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:53:32.227 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:53:32.230 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:53:32.339 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:53:32.496 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : rbd-fuse-2:16.2.15-0.el8.x86_64                        1/1
2024-03-29T08:53:32.905 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: rbd-fuse-2:16.2.15-0.el8.x86_64                        1/1
2024-03-29T08:53:33.555 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-fuse-2:16.2.15-0.el8.x86_64                        1/1
2024-03-29T08:53:33.555 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:33.555 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:53:33.555 INFO:teuthology.orchestra.run.smithi171.stdout:  rbd-fuse-2:16.2.15-0.el8.x86_64
2024-03-29T08:53:33.555 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:33.555 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:33.793 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install rbd-mirror
2024-03-29T08:53:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:02:03 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:36.424 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:36.425 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:36.425 INFO:teuthology.orchestra.run.smithi171.stdout: Package            Architecture   Version                   Repository    Size
2024-03-29T08:53:36.425 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:36.425 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror         x86_64         2:16.2.15-0.el8           ceph         3.7 M
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:Install  1 Package
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 3.7 M
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 15 M
2024-03-29T08:53:36.426 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:53:36.511 INFO:teuthology.orchestra.run.smithi171.stdout:rbd-mirror-16.2.15-0.el8.x86_64.rpm              44 MB/s | 3.7 MB     00:00
2024-03-29T08:53:36.511 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:53:36.512 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                            43 MB/s | 3.7 MB     00:00
2024-03-29T08:53:36.512 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:53:36.526 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:53:36.526 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:53:36.594 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:53:36.597 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:53:37.067 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:53:37.239 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : rbd-mirror-2:16.2.15-0.el8.x86_64                      1/1
2024-03-29T08:53:37.892 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64                      1/1
2024-03-29T08:53:38.287 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-mirror-2:16.2.15-0.el8.x86_64                      1/1
2024-03-29T08:53:38.287 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:38.287 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:53:38.287 INFO:teuthology.orchestra.run.smithi171.stdout:  rbd-mirror-2:16.2.15-0.el8.x86_64
2024-03-29T08:53:38.287 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:38.287 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:38.530 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install rbd-nbd
2024-03-29T08:53:39.465 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:02:08 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:41.229 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:41.229 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout: Package          Architecture    Version                   Repository     Size
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout:Installing:
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd          x86_64          2:16.2.15-0.el8           ceph          175 k
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout:Install  1 Package
2024-03-29T08:53:41.230 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:41.231 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 175 k
2024-03-29T08:53:41.231 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 523 k
2024-03-29T08:53:41.231 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T08:53:41.267 INFO:teuthology.orchestra.run.smithi171.stdout:rbd-nbd-16.2.15-0.el8.x86_64.rpm                4.8 MB/s | 175 kB     00:00
2024-03-29T08:53:41.267 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T08:53:41.268 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                           4.6 MB/s | 175 kB     00:00
2024-03-29T08:53:41.268 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T08:53:41.281 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T08:53:41.282 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T08:53:41.338 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T08:53:41.342 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T08:53:41.461 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T08:53:41.703 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : rbd-nbd-2:16.2.15-0.el8.x86_64                         1/1
2024-03-29T08:53:42.099 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: rbd-nbd-2:16.2.15-0.el8.x86_64                         1/1
2024-03-29T08:53:42.510 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-nbd-2:16.2.15-0.el8.x86_64                         1/1
2024-03-29T08:53:42.510 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:42.510 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T08:53:42.510 INFO:teuthology.orchestra.run.smithi171.stdout:  rbd-nbd-2:16.2.15-0.el8.x86_64
2024-03-29T08:53:42.510 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:42.510 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:42.756 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install librados2
2024-03-29T08:53:43.693 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:02:12 ago on Fri 29 Mar 2024 08:51:31 AM UTC.
2024-03-29T08:53:45.380 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.15-0.el8.x86_64 is already installed.
2024-03-29T08:53:45.432 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T08:53:45.434 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do.
2024-03-29T08:53:45.434 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T08:53:45.552 DEBUG:teuthology.parallel:result is None
2024-03-29T08:53:45.552 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2024-03-29T08:53:45.552 INFO:teuthology.packaging:ref: None
2024-03-29T08:53:45.552 INFO:teuthology.packaging:tag: None
2024-03-29T08:53:45.553 INFO:teuthology.packaging:branch: pacific
2024-03-29T08:53:45.553 INFO:teuthology.packaging:sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2
2024-03-29T08:53:45.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific
2024-03-29T08:53:45.768 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}'
2024-03-29T08:53:45.820 INFO:teuthology.orchestra.run.smithi171.stdout:16.2.15-0.el8
2024-03-29T08:53:45.821 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-0.el8
2024-03-29T08:53:45.821 INFO:teuthology.task.install:The correct ceph version 16.2.15-0 is installed.
2024-03-29T08:53:45.823 INFO:teuthology.task.install.util:Shipping valgrind.supp...
2024-03-29T08:53:45.823 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:45.823 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp
2024-03-29T08:53:45.889 INFO:teuthology.task.install.util:Shipping 'daemon-helper'...
2024-03-29T08:53:45.889 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:45.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper
2024-03-29T08:53:45.995 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper
2024-03-29T08:53:46.101 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'...
2024-03-29T08:53:46.101 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:46.101 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits
2024-03-29T08:53:46.168 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits
2024-03-29T08:53:46.274 INFO:teuthology.task.install.util:Shipping 'stdin-killer'...
2024-03-29T08:53:46.275 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:46.275 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer
2024-03-29T08:53:46.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer
2024-03-29T08:53:46.446 INFO:teuthology.run_tasks:Running task print...
2024-03-29T08:53:46.455 INFO:teuthology.task.print:**** done installing pacific
2024-03-29T08:53:46.456 INFO:teuthology.run_tasks:Running task ceph...
2024-03-29T08:53:46.520 INFO:tasks.ceph:Making ceph log dir writeable by non-root...
2024-03-29T08:53:46.520 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph
2024-03-29T08:53:46.586 INFO:tasks.ceph:Disabling ceph logrotate...
2024-03-29T08:53:46.586 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph
2024-03-29T08:53:46.652 INFO:tasks.ceph:Creating extra log directories...
2024-03-29T08:53:46.652 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger
2024-03-29T08:53:46.728 INFO:tasks.ceph:Creating ceph cluster ceph...
2024-03-29T08:53:46.728 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True}
2024-03-29T08:53:46.728 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161', 'branch': 'wip-vshankar-testing-20240326.105515-reef', 'description': 'fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7628161', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/pacific latest\n'}], 'name': 'vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240326.105515-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240326.105515-reef', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 7327, 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2', 'sleep_before_teardown': 0, 'subset': '990/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240326.105515-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d0e392d9aee635f2b65768c460c7a151ead7a5e2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2', 'targets': {'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhVHZfeYp5C9I6Dx1p4wqUvcyFVGjokI+WviqpJ+4RjSvLf8DskHjuKy8w87ofcjt8Jm2LCE+GTLz/ZRCRhQ6g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'print': '*** upgrading, no cephfs present'}, {'exec': {'mon.a': ['ceph fs dump']}}, {'install.upgrade': {'mon.a': None}}, {'print': '**** done install.upgrade'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph fs dump', 'ceph osd require-osd-release quincy', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-28_11:21:59', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'}
2024-03-29T08:53:46.729 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data
2024-03-29T08:53:46.773 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph
2024-03-29T08:53:46.879 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:46.879 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout
2024-03-29T08:53:46.923 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4']
2024-03-29T08:53:46.923 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:  File: /dev/vg_nvme/lv_1 -> ../dm-0
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d	Inode: 444         Links: 1
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-29 08:53:37.562768439 +0000
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-29 08:50:24.659687785 +0000
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-29 08:50:24.659687785 +0000
2024-03-29T08:53:47.008 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-29 08:50:24.630688331 +0000
2024-03-29T08:53:47.008 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1
2024-03-29T08:53:47.113 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in
2024-03-29T08:53:47.113 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out
2024-03-29T08:53:47.113 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000279956 s, 1.8 MB/s
2024-03-29T08:53:47.116 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1
2024-03-29T08:53:47.162 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:  File: /dev/vg_nvme/lv_2 -> ../dm-1
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d	Inode: 450         Links: 1
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-29 08:53:37.562768439 +0000
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-29 08:50:25.127678960 +0000
2024-03-29T08:53:47.206 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-29 08:50:25.127678960 +0000
2024-03-29T08:53:47.207 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-29 08:50:25.103679412 +0000
2024-03-29T08:53:47.207 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1
2024-03-29T08:53:47.309 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in
2024-03-29T08:53:47.309 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out
2024-03-29T08:53:47.309 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000308054 s, 1.7 MB/s
2024-03-29T08:53:47.311 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2
2024-03-29T08:53:47.358 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3
2024-03-29T08:53:47.402 INFO:teuthology.orchestra.run.smithi171.stdout:  File: /dev/vg_nvme/lv_3 -> ../dm-2
2024-03-29T08:53:47.402 INFO:teuthology.orchestra.run.smithi171.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-03-29T08:53:47.402 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d	Inode: 456         Links: 1
2024-03-29T08:53:47.402 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-03-29T08:53:47.402 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0
2024-03-29T08:53:47.402 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-29 08:53:37.562768439 +0000
2024-03-29T08:53:47.402 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-29 08:50:25.634669400 +0000
2024-03-29T08:53:47.403 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-29 08:50:25.634669400 +0000
2024-03-29T08:53:47.403 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-29 08:50:25.606669928 +0000
2024-03-29T08:53:47.403 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1
2024-03-29T08:53:47.505 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in
2024-03-29T08:53:47.505 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out
2024-03-29T08:53:47.505 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000288307 s, 1.8 MB/s
2024-03-29T08:53:47.508 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3
2024-03-29T08:53:47.554 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4
2024-03-29T08:53:47.639 INFO:teuthology.orchestra.run.smithi171.stdout:  File: /dev/vg_nvme/lv_4 -> ../dm-3
2024-03-29T08:53:47.639 INFO:teuthology.orchestra.run.smithi171.stdout:  Size: 7         	Blocks: 0          IO Block: 4096   symbolic link
2024-03-29T08:53:47.639 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d	Inode: 462         Links: 1
2024-03-29T08:53:47.639 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
2024-03-29T08:53:47.639 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0
2024-03-29T08:53:47.640 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-29 08:53:37.562768439 +0000
2024-03-29T08:53:47.640 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-29 08:50:26.119660255 +0000
2024-03-29T08:53:47.640 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-29 08:50:26.119660255 +0000
2024-03-29T08:53:47.640 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-29 08:50:26.091660783 +0000
2024-03-29T08:53:47.640 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1
2024-03-29T08:53:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in
2024-03-29T08:53:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out
2024-03-29T08:53:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000283638 s, 1.8 MB/s
2024-03-29T08:53:47.745 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4
2024-03-29T08:53:47.791 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}
2024-03-29T08:53:47.791 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}}
2024-03-29T08:53:47.791 INFO:tasks.ceph:Generating config...
2024-03-29T08:53:47.792 INFO:tasks.ceph:[global] mon warn on pool no app = False
2024-03-29T08:53:47.792 INFO:tasks.ceph:[global] ms bind msgr2 = False
2024-03-29T08:53:47.792 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False
2024-03-29T08:53:47.792 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False
2024-03-29T08:53:47.793 INFO:tasks.ceph:[global] mon pg warn min per osd = 0
2024-03-29T08:53:47.793 INFO:tasks.ceph:[client] client mount timeout = 600
2024-03-29T08:53:47.793 INFO:tasks.ceph:[client] debug client = 20
2024-03-29T08:53:47.793 INFO:tasks.ceph:[client] debug ms = 1
2024-03-29T08:53:47.793 INFO:tasks.ceph:[client] rados mon op timeout = 900
2024-03-29T08:53:47.793 INFO:tasks.ceph:[client] rados osd op timeout = 900
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] debug mds = 20
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] debug mds balancer = 20
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] debug ms = 1
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] mds debug frag = True
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] mds debug scatterstat = True
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] mds op complaint time = 180
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] mds verify scatter = True
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] osd op complaint time = 180
2024-03-29T08:53:47.793 INFO:tasks.ceph:[mds] rados mon op timeout = 900
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mds] rados osd op timeout = 900
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mgr] debug mgr = 20
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mgr] debug ms = 1
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mon] debug mon = 20
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mon] debug ms = 1
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mon] debug paxos = 20
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mon] mon op complaint time = 120
2024-03-29T08:53:47.794 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False
2024-03-29T08:53:47.794 INFO:tasks.ceph:[osd] bdev async discard = True
2024-03-29T08:53:47.794 INFO:tasks.ceph:[osd] bdev enable discard = True
2024-03-29T08:53:47.794 INFO:tasks.ceph:[osd] bluestore allocator = bitmap
2024-03-29T08:53:47.794 INFO:tasks.ceph:[osd] bluestore block size = 96636764160
2024-03-29T08:53:47.794 INFO:tasks.ceph:[osd] bluestore fsck on mount = True
2024-03-29T08:53:47.794 INFO:tasks.ceph:[osd] debug bluefs = 1/20
2024-03-29T08:53:47.794 INFO:tasks.ceph:[osd] debug bluestore = 1/20
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] debug ms = 1
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] debug osd = 20
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] debug rocksdb = 4/10
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] osd objectstore = bluestore
2024-03-29T08:53:47.795 INFO:tasks.ceph:[osd] osd op complaint time = 180
2024-03-29T08:53:47.795 INFO:tasks.ceph:Setting up mon.a...
2024-03-29T08:53:47.795 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring
2024-03-29T08:53:47.973 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.keyring
2024-03-29T08:53:47.978 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring
2024-03-29T08:53:48.069 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring
2024-03-29T08:53:48.136 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.171'), ('mon.b', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]'), ('mon.c', '[v2:172.21.15.171:3302,v1:172.21.15.171:6791]')]
2024-03-29T08:53:48.136 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790],[v2:172.21.15.171:3302,v1:172.21.15.171:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}}
2024-03-29T08:53:48.137 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:48.137 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf
2024-03-29T08:53:48.180 DEBUG:teuthology.orchestra.run.smithi171:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.171 --addv b '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --addv c '[v2:172.21.15.171:3302,v1:172.21.15.171:6791]' --print /home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:53:48.300 INFO:teuthology.orchestra.run.smithi171.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:53:48.300 INFO:teuthology.orchestra.run.smithi171.stdout:monmaptool: generated fsid 5d11de56-0552-4a0a-9c9b-c107a7eaf7f9
2024-03-29T08:53:48.300 INFO:teuthology.orchestra.run.smithi171.stdout:epoch 0
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:fsid 5d11de56-0552-4a0a-9c9b-c107a7eaf7f9
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:last_changed 2024-03-29T08:53:48.301833+0000
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:created 2024-03-29T08:53:48.301833+0000
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:min_mon_release 0 (unknown)
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:election_strategy: 1
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:0: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.a
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:1: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.b
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:2: [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] mon.c
2024-03-29T08:53:48.301 INFO:teuthology.orchestra.run.smithi171.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors)
2024-03-29T08:53:48.303 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf
2024-03-29T08:53:48.346 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5d11de56-0552-4a0a-9c9b-c107a7eaf7f9...
2024-03-29T08:53:48.347 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:[global]
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:	chdir = ""
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:	pid file = /var/run/ceph/$cluster-$name.pid
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:	auth supported = cephx
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:	filestore xattr use omap = true
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:	mon clock drift allowed = 1.000
2024-03-29T08:53:48.497 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	osd crush chooseleaf type = 0
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	auth debug = true
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	ms die on old message = true
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	ms die on bug = true
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	mon max pg per osd = 10000	# >= luminous
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	mon pg warn max object skew = 0
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	# disable pg_autoscaler by default for new pools
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	osd_pool_default_pg_autoscale_mode = off
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:	osd pool default size = 2
2024-03-29T08:53:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon osd allow primary affinity = true
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon osd allow pg remap = true
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon warn on legacy crush tunables = false
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon warn on crush straw calc version zero = false
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon warn on no sortbitwise = false
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon warn on osd down out interval zero = false
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon warn on too few osds = false
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon_warn_on_pool_pg_num_not_power_of_two = false
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon_warn_on_pool_no_redundancy = false
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	mon_allow_pool_size_one = true
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:	osd default data pool replay window = 5
2024-03-29T08:53:48.499 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	mon allow pool delete = true
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	mon cluster log file level = debug
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	debug asserts on shutdown = true
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	mon health detail to clog = false
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	mon host = "172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790],[v2:172.21.15.171:3302,v1:172.21.15.171:6791]"
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	mon warn on pool no app = False
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	ms bind msgr2 = False
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	bluestore warn on legacy statfs = False
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	bluestore warn on no per pool omap = False
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	mon pg warn min per osd = 0
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	fsid = 5d11de56-0552-4a0a-9c9b-c107a7eaf7f9
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:[osd]
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	osd journal size = 100
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.500 INFO:teuthology.orchestra.run.smithi171.stdout:	osd scrub load threshold = 5.0
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd scrub max interval = 600
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd mclock profile = high_recovery_ops
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd recover clone overlap = true
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd recovery max chunk = 1048576
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd debug shutdown = true
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd debug op order = true
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd debug verify stray on activate = true
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd open classes on start = true
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd debug pg log writeout = true
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd deep scrub update digest min age = 30
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:	osd map max advance = 10
2024-03-29T08:53:48.501 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	journal zero on create = true
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	filestore ondisk finisher threads = 3
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	filestore apply finisher threads = 3
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	bdev debug aio = true
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	osd debug misdirected ops = true
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	bdev async discard = True
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	bdev enable discard = True
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	bluestore allocator = bitmap
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	bluestore block size = 96636764160
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	bluestore fsck on mount = True
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	debug bluefs = 1/20
2024-03-29T08:53:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:	debug bluestore = 1/20
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	debug ms = 1
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	debug osd = 20
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	debug rocksdb = 4/10
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	mon osd backfillfull_ratio = 0.85
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	mon osd full ratio = 0.9
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	mon osd nearfull ratio = 0.8
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	osd failsafe full ratio = 0.95
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	osd objectstore = bluestore
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	osd op complaint time = 180
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr]
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	debug ms = 1
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	debug mgr = 20
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	debug mon = 20
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	debug auth = 20
2024-03-29T08:53:48.503 INFO:teuthology.orchestra.run.smithi171.stdout:	mon reweight min pgs per osd = 4
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mon reweight min bytes per osd = 10
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mgr/telemetry/nag = false
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:[mon]
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	debug ms = 1
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	debug mon = 20
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	debug paxos = 20
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	debug auth = 20
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mon data avail warn = 5
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mon mgr mkfs grace = 240
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mon reweight min pgs per osd = 4
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mon osd reporter subtree level = osd
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mon osd prime pg temp = true
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	mon reweight min bytes per osd = 10
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.504 INFO:teuthology.orchestra.run.smithi171.stdout:	# rotate auth tickets quickly to exercise renewal paths
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	auth mon ticket ttl = 660	# 11m
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	auth service ticket ttl = 240	# 4m
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	# don't complain about insecure global_id in the test suite
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	mon_warn_on_insecure_global_id_reclaim = false
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	mon_warn_on_insecure_global_id_reclaim_allowed = false
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	# 1m isn't quite enough
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	mon_down_mkfs_grace = 2m
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	mon_warn_on_filestore_osds = false
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	mon op complaint time = 120
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:	mon warn on osd down out interval zero = False
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:53:48.505 INFO:teuthology.orchestra.run.smithi171.stdout:[client]
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	rgw cache enabled = true
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	rgw enable ops log = true
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	rgw enable usage log = true
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	log file = /var/log/ceph/$cluster-$name.$pid.log
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	admin socket = /var/run/ceph/$cluster-$name.$pid.asok
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	client mount timeout = 600
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	debug client = 20
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	debug ms = 1
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	rados mon op timeout = 900
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	rados osd op timeout = 900
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a]
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b]
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c]
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:[mds]
2024-03-29T08:53:48.506 INFO:teuthology.orchestra.run.smithi171.stdout:	debug mds = 20
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	debug mds balancer = 20
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	debug ms = 1
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	mds debug frag = True
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	mds debug scatterstat = True
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	mds op complaint time = 180
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	mds verify scatter = True
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	osd op complaint time = 180
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	rados mon op timeout = 900
2024-03-29T08:53:48.507 INFO:teuthology.orchestra.run.smithi171.stdout:	rados osd op timeout = 900
2024-03-29T08:53:48.524 INFO:tasks.ceph:Creating admin key on mon.a...
2024-03-29T08:53:48.524 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring
2024-03-29T08:53:48.625 INFO:tasks.ceph:Copying monmap to all nodes...
2024-03-29T08:53:48.625 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:48.625 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout
2024-03-29T08:53:48.669 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:48.669 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout
2024-03-29T08:53:48.753 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:53:48.753 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:48.753 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring
2024-03-29T08:53:48.754 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring
2024-03-29T08:53:48.883 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:53:48.883 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:53:48.967 INFO:tasks.ceph:Setting up mon nodes...
2024-03-29T08:53:48.967 INFO:tasks.ceph:Setting up mgr nodes...
2024-03-29T08:53:48.968 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring
2024-03-29T08:53:49.119 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring
2024-03-29T08:53:49.124 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring
2024-03-29T08:53:49.238 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring
2024-03-29T08:53:49.243 INFO:tasks.ceph:Setting up mds nodes...
2024-03-29T08:53:49.243 INFO:tasks.ceph_client:Setting up client nodes...
2024-03-29T08:53:49.243 INFO:tasks.ceph:Running mkfs on osd nodes...
2024-03-29T08:53:49.243 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}}
2024-03-29T08:53:49.243 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-0
2024-03-29T08:53:49.311 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}
2024-03-29T08:53:49.312 INFO:tasks.ceph:role: osd.0
2024-03-29T08:53:49.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:53:49.312 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1      isize=2048   agcount=4, agsize=5859072 blks
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   attr=2, projid32bit=1
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       crc=1        finobt=1, sparse=1, rmapbt=0
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       reflink=1    bigtime=0 inobtcount=0
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:data     =                       bsize=4096   blocks=23436288, imaxpct=25
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sunit=0      swidth=0 blks
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:naming   =version 2              bsize=4096   ascii-ci=0, ftype=1
2024-03-29T08:53:49.385 INFO:teuthology.orchestra.run.smithi171.stdout:log      =internal log           bsize=4096   blocks=11443, version=2
2024-03-29T08:53:49.386 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   sunit=0 blks, lazy-count=1
2024-03-29T08:53:49.386 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none                   extsz=4096   blocks=0, rtextents=0
2024-03-29T08:53:49.822 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done.
2024-03-29T08:53:49.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime
2024-03-29T08:53:49.826 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0
2024-03-29T08:53:50.025 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0
2024-03-29T08:53:50.101 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-1
2024-03-29T08:53:50.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}
2024-03-29T08:53:50.168 INFO:tasks.ceph:role: osd.1
2024-03-29T08:53:50.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:53:50.168 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2
2024-03-29T08:53:50.241 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2      isize=2048   agcount=4, agsize=5859072 blks
2024-03-29T08:53:50.241 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   attr=2, projid32bit=1
2024-03-29T08:53:50.241 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       crc=1        finobt=1, sparse=1, rmapbt=0
2024-03-29T08:53:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       reflink=1    bigtime=0 inobtcount=0
2024-03-29T08:53:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:data     =                       bsize=4096   blocks=23436288, imaxpct=25
2024-03-29T08:53:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sunit=0      swidth=0 blks
2024-03-29T08:53:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:naming   =version 2              bsize=4096   ascii-ci=0, ftype=1
2024-03-29T08:53:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:log      =internal log           bsize=4096   blocks=11443, version=2
2024-03-29T08:53:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   sunit=0 blks, lazy-count=1
2024-03-29T08:53:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none                   extsz=4096   blocks=0, rtextents=0
2024-03-29T08:53:50.649 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done.
2024-03-29T08:53:50.652 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime
2024-03-29T08:53:50.653 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1
2024-03-29T08:53:50.788 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1
2024-03-29T08:53:50.862 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-2
2024-03-29T08:53:50.928 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}
2024-03-29T08:53:50.928 INFO:tasks.ceph:role: osd.2
2024-03-29T08:53:50.928 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:53:50.928 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3
2024-03-29T08:53:51.001 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3      isize=2048   agcount=4, agsize=5859072 blks
2024-03-29T08:53:51.001 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   attr=2, projid32bit=1
2024-03-29T08:53:51.001 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       crc=1        finobt=1, sparse=1, rmapbt=0
2024-03-29T08:53:51.001 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       reflink=1    bigtime=0 inobtcount=0
2024-03-29T08:53:51.001 INFO:teuthology.orchestra.run.smithi171.stdout:data     =                       bsize=4096   blocks=23436288, imaxpct=25
2024-03-29T08:53:51.002 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sunit=0      swidth=0 blks
2024-03-29T08:53:51.002 INFO:teuthology.orchestra.run.smithi171.stdout:naming   =version 2              bsize=4096   ascii-ci=0, ftype=1
2024-03-29T08:53:51.002 INFO:teuthology.orchestra.run.smithi171.stdout:log      =internal log           bsize=4096   blocks=11443, version=2
2024-03-29T08:53:51.002 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   sunit=0 blks, lazy-count=1
2024-03-29T08:53:51.002 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none                   extsz=4096   blocks=0, rtextents=0
2024-03-29T08:53:51.453 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done.
2024-03-29T08:53:51.457 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime
2024-03-29T08:53:51.457 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2
2024-03-29T08:53:51.642 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2
2024-03-29T08:53:51.715 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-3
2024-03-29T08:53:51.782 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}
2024-03-29T08:53:51.782 INFO:tasks.ceph:role: osd.3
2024-03-29T08:53:51.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:53:51.782 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4
2024-03-29T08:53:51.856 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4      isize=2048   agcount=4, agsize=5859072 blks
2024-03-29T08:53:51.856 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   attr=2, projid32bit=1
2024-03-29T08:53:51.856 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       crc=1        finobt=1, sparse=1, rmapbt=0
2024-03-29T08:53:51.856 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       reflink=1    bigtime=0 inobtcount=0
2024-03-29T08:53:51.857 INFO:teuthology.orchestra.run.smithi171.stdout:data     =                       bsize=4096   blocks=23436288, imaxpct=25
2024-03-29T08:53:51.857 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sunit=0      swidth=0 blks
2024-03-29T08:53:51.857 INFO:teuthology.orchestra.run.smithi171.stdout:naming   =version 2              bsize=4096   ascii-ci=0, ftype=1
2024-03-29T08:53:51.857 INFO:teuthology.orchestra.run.smithi171.stdout:log      =internal log           bsize=4096   blocks=11443, version=2
2024-03-29T08:53:51.857 INFO:teuthology.orchestra.run.smithi171.stdout:         =                       sectsz=512   sunit=0 blks, lazy-count=1
2024-03-29T08:53:51.857 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none                   extsz=4096   blocks=0, rtextents=0
2024-03-29T08:53:52.291 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done.
2024-03-29T08:53:52.295 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime
2024-03-29T08:53:52.295 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3
2024-03-29T08:53:52.442 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3
2024-03-29T08:53:52.514 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:53:52.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:52.630+0000 7f57ca046380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory
2024-03-29T08:53:52.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:52.630+0000 7f57ca046380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring
2024-03-29T08:53:52.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:52.630+0000 7f57ca046380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory
2024-03-29T08:53:52.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:52.630+0000 7f57ca046380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory
2024-03-29T08:53:52.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:52.630+0000 7f57ca046380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory
2024-03-29T08:53:52.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:52.633+0000 7f57ca046380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid
2024-03-29T08:53:55.756 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0
2024-03-29T08:53:55.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:53:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:55.928+0000 7f262dc0d380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory
2024-03-29T08:53:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:55.929+0000 7f262dc0d380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring
2024-03-29T08:53:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:55.929+0000 7f262dc0d380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory
2024-03-29T08:53:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:55.929+0000 7f262dc0d380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory
2024-03-29T08:53:55.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:55.929+0000 7f262dc0d380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory
2024-03-29T08:53:55.930 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:55.930+0000 7f262dc0d380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid
2024-03-29T08:53:59.063 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1
2024-03-29T08:53:59.136 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:53:59.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:59.233+0000 7f17fe3fa380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory
2024-03-29T08:53:59.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:59.233+0000 7f17fe3fa380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring
2024-03-29T08:53:59.234 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:59.234+0000 7f17fe3fa380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory
2024-03-29T08:53:59.234 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:59.234+0000 7f17fe3fa380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory
2024-03-29T08:53:59.234 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:59.234+0000 7f17fe3fa380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory
2024-03-29T08:53:59.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:53:59.235+0000 7f17fe3fa380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid
2024-03-29T08:54:02.358 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2
2024-03-29T08:54:02.427 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:54:02.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:02.523+0000 7f413c673380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory
2024-03-29T08:54:02.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:02.523+0000 7f413c673380 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring
2024-03-29T08:54:02.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:02.524+0000 7f413c673380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory
2024-03-29T08:54:02.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:02.524+0000 7f413c673380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory
2024-03-29T08:54:02.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:02.524+0000 7f413c673380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory
2024-03-29T08:54:02.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:02.525+0000 7f413c673380 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid
2024-03-29T08:54:05.646 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3
2024-03-29T08:54:05.716 INFO:tasks.ceph:Reading keys from all nodes...
2024-03-29T08:54:05.716 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:05.716 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout
2024-03-29T08:54:05.782 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:05.782 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout
2024-03-29T08:54:05.889 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:05.889 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout
2024-03-29T08:54:05.995 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:05.996 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout
2024-03-29T08:54:06.101 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:06.102 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout
2024-03-29T08:54:06.207 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:06.208 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout
2024-03-29T08:54:06.313 INFO:tasks.ceph:Adding keys to all mons...
2024-03-29T08:54:06.313 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x]
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:	key = AQCdgQZmx+kqBxAARWUrb88ln3lw1BfdOnsyGg==
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y]
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:	key = AQCdgQZmdWtDDhAAILDfJAWQ98HlNjgSlMdC8Q==
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0]
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:	key = AQCggQZmf52dJRAAnRlYdnqnqYa4M6afO8iUxQ==
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1]
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:	key = AQCjgQZmGtJrNxAAIAMauYc0OZFCUiOp+jo/sg==
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2]
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:	key = AQCngQZmzer5DRAALpzFB3XL8SwVrkcNphkKfw==
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3]
2024-03-29T08:54:06.417 INFO:teuthology.orchestra.run.smithi171.stdout:	key = AQCqgQZmkXhCHxAA7dzJC4Q/4Z+ysdlGrAVL3A==
2024-03-29T08:54:06.419 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *'
2024-03-29T08:54:06.557 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *'
2024-03-29T08:54:06.654 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *'
2024-03-29T08:54:06.752 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *'
2024-03-29T08:54:06.850 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *'
2024-03-29T08:54:06.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *'
2024-03-29T08:54:07.047 INFO:tasks.ceph:Running mkfs on mon nodes...
2024-03-29T08:54:07.047 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-a
2024-03-29T08:54:07.113 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring
2024-03-29T08:54:07.226 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a
2024-03-29T08:54:07.292 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b
2024-03-29T08:54:07.359 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring
2024-03-29T08:54:07.471 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b
2024-03-29T08:54:07.538 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c
2024-03-29T08:54:07.603 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring
2024-03-29T08:54:07.715 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c
2024-03-29T08:54:07.781 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap
2024-03-29T08:54:07.825 INFO:tasks.ceph:Starting mon daemons in cluster ceph...
2024-03-29T08:54:07.825 INFO:tasks.ceph.mon.a:Restarting daemon
2024-03-29T08:54:07.825 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a
2024-03-29T08:54:07.869 INFO:tasks.ceph.mon.a:Started
2024-03-29T08:54:07.870 INFO:tasks.ceph.mon.b:Restarting daemon
2024-03-29T08:54:07.870 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b
2024-03-29T08:54:07.873 INFO:tasks.ceph.mon.b:Started
2024-03-29T08:54:07.874 INFO:tasks.ceph.mon.c:Restarting daemon
2024-03-29T08:54:07.874 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c
2024-03-29T08:54:07.878 INFO:tasks.ceph.mon.c:Started
2024-03-29T08:54:07.878 INFO:tasks.ceph:Starting mgr daemons in cluster ceph...
2024-03-29T08:54:07.878 INFO:tasks.ceph.mgr.x:Restarting daemon
2024-03-29T08:54:07.878 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x
2024-03-29T08:54:07.882 INFO:tasks.ceph.mgr.x:Started
2024-03-29T08:54:07.882 INFO:tasks.ceph.mgr.y:Restarting daemon
2024-03-29T08:54:07.883 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y
2024-03-29T08:54:07.887 INFO:tasks.ceph.mgr.y:Started
2024-03-29T08:54:07.887 INFO:tasks.ceph:Setting crush tunables to default
2024-03-29T08:54:07.887 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd crush tunables default
2024-03-29T08:54:08.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.113+0000 7ffa3e000700  1  Processor -- start
2024-03-29T08:54:08.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.114+0000 7ffa3e000700  1 --  start start
2024-03-29T08:54:08.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.114+0000 7ffa3e000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.114+0000 7ffa3e000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.114+0000 7ffa3e000700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa381222f0 con 0x7ffa381214c0
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.114+0000 7ffa3e000700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3810b950 con 0x7ffa38128e30
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.114+0000 7ffa3e000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810bb10 con 0x7ffa38067390
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa37400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7ffa381214c0 0x7ffa38121be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45204/0 (socket says 172.21.15.171:45204)
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 learned_addr learned my addr 172.21.15.171:0/2590024381 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:08.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:08.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:08.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000
2024-03-29T08:54:08.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.115+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000
2024-03-29T08:54:08.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.316+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000
2024-03-29T08:54:08.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:08.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:08.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:08.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:08.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:08.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:08.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:08.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:08.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000
2024-03-29T08:54:08.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:08.717+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000
2024-03-29T08:54:09.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:09.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:09.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:09.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:09.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:09.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:09.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:09.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:09.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000
2024-03-29T08:54:09.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:09.518+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000
2024-03-29T08:54:11.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa38128940 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T08:54:11.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa38128940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:11.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa3812b220 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T08:54:11.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa3812b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 >> v1:172.21.15.171:6789/0 conn(0x7ffa381214c0 legacy=0x7ffa38121be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810bb10 con 0x7ffa14003530
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:11.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.115+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000
2024-03-29T08:54:11.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.316+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:11.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.316+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13
2024-03-29T08:54:11.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.316+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:11.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.316+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:11.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.316+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000
2024-03-29T08:54:11.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.717+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:11.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.718+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13
2024-03-29T08:54:11.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.718+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:11.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.718+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:11.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:11.718+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000
2024-03-29T08:54:12.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:12.519+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:12.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:12.519+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13
2024-03-29T08:54:12.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:12.519+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:12.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:12.519+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:12.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:12.519+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000
2024-03-29T08:54:14.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa38067790 con 0x7ffa381214c0
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810bb10 con 0x7ffa14003530
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1400ced0 con 0x7ffa38067390
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.115+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:14.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:14.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:14.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000
2024-03-29T08:54:14.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.116+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:14.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:14.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000
2024-03-29T08:54:14.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.317+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:14.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000
2024-03-29T08:54:14.719 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:14.718+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa37e00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa2fe00700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.519+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:15.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.520+0000 7ffa37e00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000
2024-03-29T08:54:15.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:15.520+0000 7ffa2fe00700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000
2024-03-29T08:54:17.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa1400b960 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa140059c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 >> v1:172.21.15.171:6789/0 conn(0x7ffa381214c0 legacy=0x7ffa14008160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.115+0000 7ffa35600700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.115+0000 7ffa35600700  1 -- 172.21.15.171:0/2590024381 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3810bb10 con 0x7ffa38128e30
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.116+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.116+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa1400c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.116+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa1400c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.116+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:17.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.116+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000
2024-03-29T08:54:17.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.317+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:17.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.317+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa1400c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13
2024-03-29T08:54:17.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.317+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa1400c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:17.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.317+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:17.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.317+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000
2024-03-29T08:54:17.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.718+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:17.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.718+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa1400c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13
2024-03-29T08:54:17.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.718+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 msgr2=0x7ffa1400c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed
2024-03-29T08:54:17.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.718+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2024-03-29T08:54:17.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:17.718+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000
2024-03-29T08:54:18.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.518+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> v2:172.21.15.171:3300/0 conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:18.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.518+0000 7ffa37400700  1 -- 172.21.15.171:0/2590024381 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1400d060 con 0x7ffa38128e30
2024-03-29T08:54:18.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.519+0000 7ffa37400700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa38128e30 0x7ffa1400c020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ffa28007fd0 tx=0x7ffa28009040).ready entity=mon.0 client_cookie=a59614a329f41728 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:18.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.519+0000 7ffa36a00700  1 -- 172.21.15.171:0/2590024381 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280025d0 con 0x7ffa38128e30
2024-03-29T08:54:18.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.519+0000 7ffa36a00700  1 -- 172.21.15.171:0/2590024381 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28002730 con 0x7ffa38128e30
2024-03-29T08:54:18.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.519+0000 7ffa36a00700  1 -- 172.21.15.171:0/2590024381 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28002ab0 con 0x7ffa38128e30
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 -- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa38128e30 msgr2=0x7ffa1400c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa38128e30 0x7ffa1400c020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ffa28007fd0 tx=0x7ffa28009040).stop
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 -- 172.21.15.171:0/2590024381 shutdown_connections
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa38128e30 0x7ffa1400c020 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa1400b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 --2- 172.21.15.171:0/2590024381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa140059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 -- 172.21.15.171:0/2590024381 >> 172.21.15.171:0/2590024381 conn(0x7ffa38094840 msgr2=0x7ffa38094c50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 -- 172.21.15.171:0/2590024381 shutdown_connections
2024-03-29T08:54:18.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.520+0000 7ffa3e000700  1 -- 172.21.15.171:0/2590024381 wait complete.
2024-03-29T08:54:18.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.523+0000 7ffa3e000700  1  Processor -- start
2024-03-29T08:54:18.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.523+0000 7ffa3e000700  1 --  start start
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.524+0000 7ffa3e000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa3810c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.524+0000 7ffa3e000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa3810cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.524+0000 7ffa3e000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa381214c0 0x7ffa3810d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.524+0000 7ffa3e000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810f6b0 con 0x7ffa381214c0
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.524+0000 7ffa3e000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810d650 con 0x7ffa14003530
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.524+0000 7ffa3e000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38124400 con 0x7ffa38067390
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa3810c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa2fe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa3810cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:18.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa381214c0 0x7ffa3810d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:18.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa3810c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:58850/0 (socket says 172.21.15.171:58850)
2024-03-29T08:54:18.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37400700  1 -- 172.21.15.171:0/3407708558 learned_addr learned my addr 172.21.15.171:0/3407708558 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37e00700  1 -- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 msgr2=0x7ffa3810cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37e00700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa3810cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37e00700  1 -- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 msgr2=0x7ffa3810c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37e00700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa3810c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37e00700  1 -- 172.21.15.171:0/3407708558 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38067790 con 0x7ffa381214c0
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37400700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa3810c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.525+0000 7ffa37e00700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa381214c0 0x7ffa3810d160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ffa30018440 tx=0x7ffa3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:18.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.526+0000 7ffa2f400700  1 -- 172.21.15.171:0/3407708558 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300223f0 con 0x7ffa381214c0
2024-03-29T08:54:18.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.526+0000 7ffa2f400700  1 -- 172.21.15.171:0/3407708558 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa30022550 con 0x7ffa381214c0
2024-03-29T08:54:18.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.526+0000 7ffa2f400700  1 -- 172.21.15.171:0/3407708558 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300228d0 con 0x7ffa381214c0
2024-03-29T08:54:18.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.526+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3810e430 con 0x7ffa381214c0
2024-03-29T08:54:18.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.526+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3810db70 con 0x7ffa381214c0
2024-03-29T08:54:18.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.526+0000 7ffa2f400700  1 -- 172.21.15.171:0/3407708558 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ffa30003040 con 0x7ffa381214c0
2024-03-29T08:54:18.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.526+0000 7ffa2f400700  1 -- 172.21.15.171:0/3407708558 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffa3002cd70 con 0x7ffa381214c0
2024-03-29T08:54:18.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.528+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa38065c20 con 0x7ffa381214c0
2024-03-29T08:54:18.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.531+0000 7ffa2f400700  1 -- 172.21.15.171:0/3407708558 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ffa3002c3f0 con 0x7ffa381214c0
2024-03-29T08:54:18.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.634+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffa3810c160 con 0x7ffa381214c0
2024-03-29T08:54:18.638 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.638+0000 7ffa2f400700  1 -- 172.21.15.171:0/3407708558 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffa3002c590 con 0x7ffa381214c0
2024-03-29T08:54:18.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.639+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa381214c0 msgr2=0x7ffa3810d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:18.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.639+0000 7ffa3e000700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa381214c0 0x7ffa3810d160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ffa30018440 tx=0x7ffa3000b040).stop
2024-03-29T08:54:18.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.639+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 shutdown_connections
2024-03-29T08:54:18.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.639+0000 7ffa3e000700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa381214c0 0x7ffa3810d160 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.639+0000 7ffa3e000700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa14003530 0x7ffa3810c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.639+0000 7ffa3e000700  1 --2- 172.21.15.171:0/3407708558 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffa38067390 0x7ffa3810cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:18.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.639+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 >> 172.21.15.171:0/3407708558 conn(0x7ffa38094840 msgr2=0x7ffa381230a0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:18.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.640+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 shutdown_connections
2024-03-29T08:54:18.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:18.640+0000 7ffa3e000700  1 -- 172.21.15.171:0/3407708558 wait complete.
2024-03-29T08:54:18.641 INFO:teuthology.orchestra.run.smithi171.stderr:adjusted tunables profile to default
2024-03-29T08:54:18.657 INFO:tasks.ceph:check_enable_crimson: False
2024-03-29T08:54:18.657 INFO:tasks.ceph:Starting osd daemons in cluster ceph...
2024-03-29T08:54:18.657 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:18.658 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout
2024-03-29T08:54:18.677 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:18.677+0000 7f04882e0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member
2024-03-29T08:54:18.678 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:18.677+0000 7f5badc94680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member
2024-03-29T08:54:18.729 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:18.729 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout
2024-03-29T08:54:18.770 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:18.770+0000 7f5badc94680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member
2024-03-29T08:54:18.771 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:18.770+0000 7f04882e0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member
2024-03-29T08:54:18.837 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:18.837 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout
2024-03-29T08:54:18.863 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:18.863+0000 7f04882e0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member
2024-03-29T08:54:18.867 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:18.864+0000 7f5badc94680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member
2024-03-29T08:54:18.932 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:18.932 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout
2024-03-29T08:54:19.046 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new cd8f3f88-2404-4aef-9bc1-bbb395180f89 0
2024-03-29T08:54:19.054 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:19.053+0000 7f04882e0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member
2024-03-29T08:54:19.059 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:19.059+0000 7f5badc94680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member
2024-03-29T08:54:19.228 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.228+0000 7f4a27200700  1  Processor -- start
2024-03-29T08:54:19.229 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.228+0000 7f4a27200700  1 --  start start
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a27200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f4a20125a90 0x7f4a20125e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a27200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20069530 0x7f4a20126360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a27200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a20122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a27200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a20068920 con 0x7f4a20125a90
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a27200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20067fb0 con 0x7f4a20069530
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a27200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20069150 con 0x7f4a201225f0
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a25200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a20122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a1f400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20069530 0x7f4a20126360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a25200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a20122aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:34428/0 (socket says 172.21.15.171:34428)
2024-03-29T08:54:19.230 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a1f400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20069530 0x7f4a20126360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:58858/0 (socket says 172.21.15.171:58858)
2024-03-29T08:54:19.231 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a25200700  1 -- 172.21.15.171:0/404168432 learned_addr learned my addr 172.21.15.171:0/404168432 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:19.231 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.229+0000 7f4a1fe00700  1 --2- 172.21.15.171:0/404168432 >> v2:172.21.15.171:3300/0 conn(0x7f4a20125a90 0x7f4a20125e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1f400700  1 -- 172.21.15.171:0/404168432 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 msgr2=0x7f4a20122aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1f400700  1 --2- 172.21.15.171:0/404168432 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a20122aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1f400700  1 -- 172.21.15.171:0/404168432 >> v2:172.21.15.171:3300/0 conn(0x7f4a20125a90 msgr2=0x7f4a20125e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1f400700  1 --2- 172.21.15.171:0/404168432 >> v2:172.21.15.171:3300/0 conn(0x7f4a20125a90 0x7f4a20125e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1f400700  1 -- 172.21.15.171:0/404168432 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20069d10 con 0x7f4a20069530
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1f400700  1 --2- 172.21.15.171:0/404168432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20069530 0x7f4a20126360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4a0c009790 tx=0x7f4a0c009060).ready entity=mon.1 client_cookie=5ff68b79e6a5284c server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1ea00700  1 -- 172.21.15.171:0/404168432 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0090d0 con 0x7f4a20069530
2024-03-29T08:54:19.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1ea00700  1 -- 172.21.15.171:0/404168432 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00d4a0 con 0x7f4a20069530
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.230+0000 7f4a1ea00700  1 -- 172.21.15.171:0/404168432 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00d820 con 0x7f4a20069530
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 -- 172.21.15.171:0/404168432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20069530 msgr2=0x7f4a20126360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 --2- 172.21.15.171:0/404168432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20069530 0x7f4a20126360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4a0c009790 tx=0x7f4a0c009060).stop
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 -- 172.21.15.171:0/404168432 shutdown_connections
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 --2- 172.21.15.171:0/404168432 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a20122aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 --2- 172.21.15.171:0/404168432 >> v2:172.21.15.171:3300/0 conn(0x7f4a20125a90 0x7f4a20125e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 --2- 172.21.15.171:0/404168432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20069530 0x7f4a20126360 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 -- 172.21.15.171:0/404168432 >> 172.21.15.171:0/404168432 conn(0x7f4a200994d0 msgr2=0x7f4a20064d50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 -- 172.21.15.171:0/404168432 shutdown_connections
2024-03-29T08:54:19.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.231+0000 7f4a27200700  1 -- 172.21.15.171:0/404168432 wait complete.
2024-03-29T08:54:19.234 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.233+0000 7f4a27200700  1  Processor -- start
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.233+0000 7f4a27200700  1 --  start start
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a27200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a20069530 0x7f4a201353f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a27200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a201358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a27200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20125a90 0x7f4a20110e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a27200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a201143a0 con 0x7f4a20069530
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a27200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20114770 con 0x7f4a20125a90
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a27200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20112a90 con 0x7f4a201225f0
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a1fe00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a20069530 0x7f4a201353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a25200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20125a90 0x7f4a20110e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a1f400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a201358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a1fe00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a20069530 0x7f4a201353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39156/0 (socket says 172.21.15.171:39156)
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a25200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20125a90 0x7f4a20110e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:58860/0 (socket says 172.21.15.171:58860)
2024-03-29T08:54:19.235 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a1fe00700  1 -- 172.21.15.171:0/1083179522 learned_addr learned my addr 172.21.15.171:0/1083179522 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:19.236 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a25200700  1 -- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 msgr2=0x7f4a201358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.236 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a25200700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a201358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.234+0000 7f4a25200700  1 -- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a20069530 msgr2=0x7f4a201353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a25200700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a20069530 0x7f4a201353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a25200700  1 -- 172.21.15.171:0/1083179522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c0092a0 con 0x7f4a20125a90
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a1fe00700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a20069530 0x7f4a201353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a25200700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20125a90 0x7f4a20110e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4a18009e50 tx=0x7f4a1800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a17e00700  1 -- 172.21.15.171:0/1083179522 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18009c30 con 0x7f4a20125a90
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a17e00700  1 -- 172.21.15.171:0/1083179522 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800f040 con 0x7f4a20125a90
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a20113bc0 con 0x7f4a20125a90
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a17e00700  1 -- 172.21.15.171:0/1083179522 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800cac0 con 0x7f4a20125a90
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a20135f90 con 0x7f4a20125a90
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.235+0000 7f4a17e00700  1 -- 172.21.15.171:0/1083179522 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f4a18014670 con 0x7f4a20125a90
2024-03-29T08:54:19.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.236+0000 7f4a17e00700  1 -- 172.21.15.171:0/1083179522 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4a18007400 con 0x7f4a20125a90
2024-03-29T08:54:19.238 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.236+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a20066470 con 0x7f4a20125a90
2024-03-29T08:54:19.240 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.239+0000 7f4a17e00700  1 -- 172.21.15.171:0/1083179522 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f4a18022060 con 0x7f4a20125a90
2024-03-29T08:54:19.261 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:19.261+0000 7f04882e0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member
2024-03-29T08:54:19.264 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:19.264+0000 7f5badc94680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member
2024-03-29T08:54:19.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.325+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cd8f3f88-2404-4aef-9bc1-bbb395180f89", "id": 0} v 0) v1 -- 0x7f4a20046ce0 con 0x7f4a20125a90
2024-03-29T08:54:19.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.329+0000 7f4a17e00700  1 -- 172.21.15.171:0/1083179522 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd8f3f88-2404-4aef-9bc1-bbb395180f89", "id": 0}]=0  v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a18014ab0 con 0x7f4a20125a90
2024-03-29T08:54:19.329 INFO:teuthology.orchestra.run.smithi171.stdout:0
2024-03-29T08:54:19.330 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20125a90 msgr2=0x7f4a20110e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20125a90 0x7f4a20110e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4a18009e50 tx=0x7f4a1800b040).stop
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 shutdown_connections
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a20125a90 0x7f4a20110e80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a20069530 0x7f4a201353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 --2- 172.21.15.171:0/1083179522 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4a201225f0 0x7f4a201358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 >> 172.21.15.171:0/1083179522 conn(0x7f4a200994d0 msgr2=0x7f4a20096750 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 shutdown_connections
2024-03-29T08:54:19.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.330+0000 7f4a27200700  1 -- 172.21.15.171:0/1083179522 wait complete.
2024-03-29T08:54:19.350 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new f2edc853-e433-4c25-a9a7-0c412db5d352 1
2024-03-29T08:54:19.581 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.581+0000 7fe4e6e00700  1  Processor -- start
2024-03-29T08:54:19.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.581+0000 7fe4e6e00700  1 --  start start
2024-03-29T08:54:19.582 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.581+0000 7fe4e6e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e0125a90 0x7fe4e0125e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4e6e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe4e0069530 0x7fe4e0126360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4e6e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e01225f0 0x7fe4e0122a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4e6e00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e0068920 con 0x7fe4e0069530
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4e6e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0067fb0 con 0x7fe4e01225f0
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4e6e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0069150 con 0x7fe4e0125a90
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe4e0069530 0x7fe4e0126360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4e4e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e01225f0 0x7fe4e0122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe4e0069530 0x7fe4e0126360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39164/0 (socket says 172.21.15.171:39164)
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 -- 172.21.15.171:0/1250449236 learned_addr learned my addr 172.21.15.171:0/1250449236 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:19.583 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4dfe00700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e0125a90 0x7fe4e0125e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.584 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 -- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e0125a90 msgr2=0x7fe4e0125e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:19.584 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e0125a90 0x7fe4e0125e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 -- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e01225f0 msgr2=0x7fe4e0122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e01225f0 0x7fe4e0122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.582+0000 7fe4df400700  1 -- 172.21.15.171:0/1250449236 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0069d10 con 0x7fe4e0069530
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.583+0000 7fe4df400700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0069530 0x7fe4e0126360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fe4cc009830 tx=0x7fe4cc0090f0).ready entity=mon.0 client_cookie=7bed523ec3b1ca93 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.583+0000 7fe4dea00700  1 -- 172.21.15.171:0/1250449236 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00f510 con 0x7fe4e0069530
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.583+0000 7fe4dea00700  1 -- 172.21.15.171:0/1250449236 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc00f670 con 0x7fe4e0069530
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.583+0000 7fe4dea00700  1 -- 172.21.15.171:0/1250449236 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00fa10 con 0x7fe4e0069530
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 -- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0069530 msgr2=0x7fe4e0126360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0069530 0x7fe4e0126360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fe4cc009830 tx=0x7fe4cc0090f0).stop
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 -- 172.21.15.171:0/1250449236 shutdown_connections
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e01225f0 0x7fe4e0122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e0125a90 0x7fe4e0125e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/1250449236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0069530 0x7fe4e0126360 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.585 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 -- 172.21.15.171:0/1250449236 >> 172.21.15.171:0/1250449236 conn(0x7fe4e00994d0 msgr2=0x7fe4e0064d50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:19.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 -- 172.21.15.171:0/1250449236 shutdown_connections
2024-03-29T08:54:19.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.584+0000 7fe4e6e00700  1 -- 172.21.15.171:0/1250449236 wait complete.
2024-03-29T08:54:19.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.586+0000 7fe4e6e00700  1  Processor -- start
2024-03-29T08:54:19.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.586+0000 7fe4e6e00700  1 --  start start
2024-03-29T08:54:19.588 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4e6e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e0069530 0x7fe4e0135440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4e6e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e01225f0 0x7fe4e0135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4e6e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0125a90 0x7fe4e0110ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4e6e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0124e90 con 0x7fe4e0125a90
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4e6e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0114300 con 0x7fe4e0069530
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4e6e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e01146d0 con 0x7fe4e01225f0
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4dfe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e0069530 0x7fe4e0135440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4dfe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e0069530 0x7fe4e0135440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:58880/0 (socket says 172.21.15.171:58880)
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.587+0000 7fe4dfe00700  1 -- 172.21.15.171:0/2363752049 learned_addr learned my addr 172.21.15.171:0/2363752049 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4df400700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e01225f0 0x7fe4e0135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4e4e00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0125a90 0x7fe4e0110ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4dfe00700  1 -- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e01225f0 msgr2=0x7fe4e0135930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4dfe00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e01225f0 0x7fe4e0135930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4dfe00700  1 -- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0125a90 msgr2=0x7fe4e0110ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4dfe00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0125a90 0x7fe4e0110ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4dfe00700  1 -- 172.21.15.171:0/2363752049 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009370 con 0x7fe4e0069530
2024-03-29T08:54:19.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.588+0000 7fe4dfe00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e0069530 0x7fe4e0135440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe4d000e8d0 tx=0x7fe4d0006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.589+0000 7fe4d7e00700  1 -- 172.21.15.171:0/2363752049 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0009450 con 0x7fe4e0069530
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.589+0000 7fe4d7e00700  1 -- 172.21.15.171:0/2363752049 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d0012600 con 0x7fe4e0069530
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.589+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e01131b0 con 0x7fe4e0069530
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.589+0000 7fe4d7e00700  1 -- 172.21.15.171:0/2363752049 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0012980 con 0x7fe4e0069530
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.589+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e0135fe0 con 0x7fe4e0069530
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.589+0000 7fe4d7e00700  1 -- 172.21.15.171:0/2363752049 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe4d001b400 con 0x7fe4e0069530
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.589+0000 7fe4d7e00700  1 -- 172.21.15.171:0/2363752049 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fe4d001a770 con 0x7fe4e0069530
2024-03-29T08:54:19.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.590+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e0112ac0 con 0x7fe4e0069530
2024-03-29T08:54:19.593 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.593+0000 7fe4d7e00700  1 -- 172.21.15.171:0/2363752049 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fe4d003ae50 con 0x7fe4e0069530
2024-03-29T08:54:19.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.677+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f2edc853-e433-4c25-a9a7-0c412db5d352", "id": 1} v 0) v1 -- 0x7fe4e0113a80 con 0x7fe4e0069530
2024-03-29T08:54:19.681 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.681+0000 7fe4d7e00700  1 -- 172.21.15.171:0/2363752049 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2edc853-e433-4c25-a9a7-0c412db5d352", "id": 1}]=0  v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe4e0113a80 con 0x7fe4e0069530
2024-03-29T08:54:19.681 INFO:teuthology.orchestra.run.smithi171.stdout:1
2024-03-29T08:54:19.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.682+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e0069530 msgr2=0x7fe4e0135440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.682+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e0069530 0x7fe4e0135440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe4d000e8d0 tx=0x7fe4d0006f40).stop
2024-03-29T08:54:19.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.682+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 shutdown_connections
2024-03-29T08:54:19.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.682+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e0125a90 0x7fe4e0110ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.682+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e0069530 0x7fe4e0135440 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.683+0000 7fe4e6e00700  1 --2- 172.21.15.171:0/2363752049 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e01225f0 0x7fe4e0135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.683+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 >> 172.21.15.171:0/2363752049 conn(0x7fe4e00994d0 msgr2=0x7fe4e0096750 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:19.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.683+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 shutdown_connections
2024-03-29T08:54:19.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.683+0000 7fe4e6e00700  1 -- 172.21.15.171:0/2363752049 wait complete.
2024-03-29T08:54:19.707 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new c1f904d8-4070-4c18-b06a-fd252f0b0378 2
2024-03-29T08:54:19.809 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:19.808+0000 7f04882e0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member
2024-03-29T08:54:19.810 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:19.810+0000 7f5badc94680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member
2024-03-29T08:54:19.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.890+0000 7ff505a00700  1  Processor -- start
2024-03-29T08:54:19.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.890+0000 7ff505a00700  1 --  start start
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff505a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500069530 0x7ff500126580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff505a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff50012ae20 0x7ff50012d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff505a00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff500069150 con 0x7ff500125a90
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff505a00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff500068920 con 0x7ff50012ae20
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff505a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff500067fb0 con 0x7ff500069530
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff4fe000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500069530 0x7ff500126580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff4fea00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7ff500125a90 0x7ff500125e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:51106/0 (socket says 172.21.15.171:51106)
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff4fea00700  1 -- 172.21.15.171:0/3722907787 learned_addr learned my addr 172.21.15.171:0/3722907787 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:19.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.891+0000 7ff4ff400700  1 --2- 172.21.15.171:0/3722907787 >> v2:172.21.15.171:3300/0 conn(0x7ff50012ae20 0x7ff50012d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fe000700  1 -- 172.21.15.171:0/3722907787 >> v2:172.21.15.171:3300/0 conn(0x7ff50012ae20 msgr2=0x7ff50012d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fe000700  1 --2- 172.21.15.171:0/3722907787 >> v2:172.21.15.171:3300/0 conn(0x7ff50012ae20 0x7ff50012d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fe000700  1 -- 172.21.15.171:0/3722907787 >> v1:172.21.15.171:6789/0 conn(0x7ff500125a90 legacy=0x7ff500125e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fe000700  1 -- 172.21.15.171:0/3722907787 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500069d10 con 0x7ff500069530
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fd600700  1 -- 172.21.15.171:0/3722907787 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748025419 0 0) 0x7ff500069150 con 0x7ff500125a90
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fe000700  1 --2- 172.21.15.171:0/3722907787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500069530 0x7ff500126580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff4ec009790 tx=0x7ff4ec009060).ready entity=mon.2 client_cookie=1a495965a1f3661a server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fd600700  1 -- 172.21.15.171:0/3722907787 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0090d0 con 0x7ff500069530
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fd600700  1 -- 172.21.15.171:0/3722907787 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00f510 con 0x7ff500069530
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.892+0000 7ff4fd600700  1 -- 172.21.15.171:0/3722907787 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00f890 con 0x7ff500069530
2024-03-29T08:54:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 -- 172.21.15.171:0/3722907787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500069530 msgr2=0x7ff500126580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 --2- 172.21.15.171:0/3722907787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500069530 0x7ff500126580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff4ec009790 tx=0x7ff4ec009060).stop
2024-03-29T08:54:19.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 -- 172.21.15.171:0/3722907787 shutdown_connections
2024-03-29T08:54:19.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 --2- 172.21.15.171:0/3722907787 >> v2:172.21.15.171:3300/0 conn(0x7ff50012ae20 0x7ff50012d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 --2- 172.21.15.171:0/3722907787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500069530 0x7ff500126580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 -- 172.21.15.171:0/3722907787 >> 172.21.15.171:0/3722907787 conn(0x7ff5000994d0 msgr2=0x7ff500064d50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:19.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 -- 172.21.15.171:0/3722907787 shutdown_connections
2024-03-29T08:54:19.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.893+0000 7ff505a00700  1 -- 172.21.15.171:0/3722907787 wait complete.
2024-03-29T08:54:19.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.894+0000 7ff505a00700  1  Processor -- start
2024-03-29T08:54:19.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.895+0000 7ff505a00700  1 --  start start
2024-03-29T08:54:19.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff505a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff500069530 0x7ff500126b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff505a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500125a90 0x7ff500127040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff505a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff50012ae20 0x7ff500127530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff505a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001295a0 con 0x7ff50012ae20
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff505a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001298b0 con 0x7ff500069530
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff505a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff500129c00 con 0x7ff500125a90
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500125a90 0x7ff500127040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff500069530 0x7ff500126b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500125a90 0x7ff500127040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:34466/0 (socket says 172.21.15.171:34466)
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 -- 172.21.15.171:0/3346004195 learned_addr learned my addr 172.21.15.171:0/3346004195 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:19.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4ff400700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff50012ae20 0x7ff500127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:19.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 -- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff500069530 msgr2=0x7ff500126b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff500069530 0x7ff500126b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 -- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff50012ae20 msgr2=0x7ff500127530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff50012ae20 0x7ff500127530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.896+0000 7ff4fe000700  1 -- 172.21.15.171:0/3346004195 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0092a0 con 0x7ff500125a90
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.897+0000 7ff4fe000700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500125a90 0x7ff500127040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4ec011000 tx=0x7ff4ec017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.897+0000 7ff4f6a00700  1 -- 172.21.15.171:0/3346004195 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00f890 con 0x7ff500125a90
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.897+0000 7ff4f6a00700  1 -- 172.21.15.171:0/3346004195 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec006990 con 0x7ff500125a90
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.897+0000 7ff4f6a00700  1 -- 172.21.15.171:0/3346004195 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00fea0 con 0x7ff500125a90
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.897+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff500122cc0 con 0x7ff500125a90
2024-03-29T08:54:19.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.897+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff500127a20 con 0x7ff500125a90
2024-03-29T08:54:19.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.897+0000 7ff4f6a00700  1 -- 172.21.15.171:0/3346004195 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff4ec01b880 con 0x7ff500125a90
2024-03-29T08:54:19.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.898+0000 7ff4f6a00700  1 -- 172.21.15.171:0/3346004195 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7ff4ec0245e0 con 0x7ff500125a90
2024-03-29T08:54:19.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.898+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500128f40 con 0x7ff500125a90
2024-03-29T08:54:19.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.901+0000 7ff4f6a00700  1 -- 172.21.15.171:0/3346004195 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff500128f40 con 0x7ff500125a90
2024-03-29T08:54:19.938 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:19.938+0000 7f04882e0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member
2024-03-29T08:54:19.940 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:19.939+0000 7f5badc94680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member
2024-03-29T08:54:19.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.986+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd new", "uuid": "c1f904d8-4070-4c18-b06a-fd252f0b0378", "id": 2} v 0) v1 -- 0x7ff500127c40 con 0x7ff500125a90
2024-03-29T08:54:19.990 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.990+0000 7ff4f6a00700  1 -- 172.21.15.171:0/3346004195 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1f904d8-4070-4c18-b06a-fd252f0b0378", "id": 2}]=0  v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4ec029060 con 0x7ff500125a90
2024-03-29T08:54:19.991 INFO:teuthology.orchestra.run.smithi171.stdout:2
2024-03-29T08:54:19.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500125a90 msgr2=0x7ff500127040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:19.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500125a90 0x7ff500127040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4ec011000 tx=0x7ff4ec017000).stop
2024-03-29T08:54:19.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 shutdown_connections
2024-03-29T08:54:19.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff50012ae20 0x7ff500127530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff500069530 0x7ff500126b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 --2- 172.21.15.171:0/3346004195 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff500125a90 0x7ff500127040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:19.993 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 >> 172.21.15.171:0/3346004195 conn(0x7ff5000994d0 msgr2=0x7ff5001250c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:19.993 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 shutdown_connections
2024-03-29T08:54:19.993 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:19.991+0000 7ff505a00700  1 -- 172.21.15.171:0/3346004195 wait complete.
2024-03-29T08:54:20.010 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 809786b2-3806-4467-bd9d-01455bdcd876 3
2024-03-29T08:54:20.037 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:20.037+0000 7f04882e0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member
2024-03-29T08:54:20.038 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:20.037+0000 7f5badc94680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member
2024-03-29T08:54:20.196 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.196+0000 7fe9e1e00700  1  Processor -- start
2024-03-29T08:54:20.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.196+0000 7fe9e1e00700  1 --  start start
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9e1e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc125a90 0x7fe9dc125e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9e1e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe9dc12ae20 0x7fe9dc12d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9e1e00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc069150 con 0x7fe9dc069530
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9e1e00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc068920 con 0x7fe9dc12ae20
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9e1e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc067fb0 con 0x7fe9dc125a90
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9daa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc125a90 0x7fe9dc125e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9daa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc125a90 0x7fe9dc125e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:58902/0 (socket says 172.21.15.171:58902)
2024-03-29T08:54:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9daa00700  1 -- 172.21.15.171:0/797157270 learned_addr learned my addr 172.21.15.171:0/797157270 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9da000700  1 --1- 172.21.15.171:0/797157270 >> v1:172.21.15.171:6789/0 conn(0x7fe9dc069530 0x7fe9dc126360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:51116/0 (socket says 172.21.15.171:51116)
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.197+0000 7fe9db400700  1 --2- 172.21.15.171:0/797157270 >> v2:172.21.15.171:3300/0 conn(0x7fe9dc12ae20 0x7fe9dc12d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9daa00700  1 -- 172.21.15.171:0/797157270 >> v2:172.21.15.171:3300/0 conn(0x7fe9dc12ae20 msgr2=0x7fe9dc12d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9d9600700  1 -- 172.21.15.171:0/797157270 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942243352 0 0) 0x7fe9dc069150 con 0x7fe9dc069530
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9daa00700  1 --2- 172.21.15.171:0/797157270 >> v2:172.21.15.171:3300/0 conn(0x7fe9dc12ae20 0x7fe9dc12d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9daa00700  1 -- 172.21.15.171:0/797157270 >> v1:172.21.15.171:6789/0 conn(0x7fe9dc069530 legacy=0x7fe9dc126360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9daa00700  1 -- 172.21.15.171:0/797157270 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc069d10 con 0x7fe9dc125a90
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9db400700  1 --2- 172.21.15.171:0/797157270 >> v2:172.21.15.171:3300/0 conn(0x7fe9dc12ae20 0x7fe9dc12d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9daa00700  1 --2- 172.21.15.171:0/797157270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc125a90 0x7fe9dc125e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe9cc009840 tx=0x7fe9cc009060).ready entity=mon.1 client_cookie=5b570d75730e68c1 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9d9600700  1 -- 172.21.15.171:0/797157270 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc005880 con 0x7fe9dc125a90
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9d9600700  1 -- 172.21.15.171:0/797157270 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0059e0 con 0x7fe9dc125a90
2024-03-29T08:54:20.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.198+0000 7fe9d9600700  1 -- 172.21.15.171:0/797157270 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc005d60 con 0x7fe9dc125a90
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.199+0000 7fe9e1e00700  1 -- 172.21.15.171:0/797157270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc125a90 msgr2=0x7fe9dc125e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.199+0000 7fe9e1e00700  1 --2- 172.21.15.171:0/797157270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc125a90 0x7fe9dc125e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe9cc009840 tx=0x7fe9cc009060).stop
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.199+0000 7fe9e1e00700  1 -- 172.21.15.171:0/797157270 shutdown_connections
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.199+0000 7fe9e1e00700  1 --2- 172.21.15.171:0/797157270 >> v2:172.21.15.171:3300/0 conn(0x7fe9dc12ae20 0x7fe9dc12d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.199+0000 7fe9e1e00700  1 --2- 172.21.15.171:0/797157270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc125a90 0x7fe9dc125e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.199+0000 7fe9e1e00700  1 -- 172.21.15.171:0/797157270 >> 172.21.15.171:0/797157270 conn(0x7fe9dc0994d0 msgr2=0x7fe9dc064d50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.199+0000 7fe9e1e00700  1 -- 172.21.15.171:0/797157270 shutdown_connections
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.200+0000 7fe9e1e00700  1 -- 172.21.15.171:0/797157270 wait complete.
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.201+0000 7fe9e1e00700  1  Processor -- start
2024-03-29T08:54:20.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.201+0000 7fe9e1e00700  1 --  start start
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9e1e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9dc069530 0x7fe9dc126b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9e1e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe9dc125a90 0x7fe9dc127040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9e1e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc12ae20 0x7fe9dc127530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9e1e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc127c90 con 0x7fe9dc069530
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9e1e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1252a0 con 0x7fe9dc12ae20
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9e1e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc129610 con 0x7fe9dc125a90
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9daa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9dc069530 0x7fe9dc126b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9da000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe9dc125a90 0x7fe9dc127040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9db400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc12ae20 0x7fe9dc127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9db400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc12ae20 0x7fe9dc127530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:58908/0 (socket says 172.21.15.171:58908)
2024-03-29T08:54:20.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.202+0000 7fe9db400700  1 -- 172.21.15.171:0/177935726 learned_addr learned my addr 172.21.15.171:0/177935726 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9daa00700  1 -- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe9dc125a90 msgr2=0x7fe9dc127040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9daa00700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe9dc125a90 0x7fe9dc127040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9daa00700  1 -- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc12ae20 msgr2=0x7fe9dc127530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9daa00700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc12ae20 0x7fe9dc127530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9daa00700  1 -- 172.21.15.171:0/177935726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4009a20 con 0x7fe9dc069530
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9db400700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc12ae20 0x7fe9dc127530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9daa00700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9dc069530 0x7fe9dc126b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fe9cc009840 tx=0x7fe9cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.203+0000 7fe9d3400700  1 -- 172.21.15.171:0/177935726 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc006940 con 0x7fe9dc069530
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.204+0000 7fe9d3400700  1 -- 172.21.15.171:0/177935726 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00b580 con 0x7fe9dc069530
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.204+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc009300 con 0x7fe9dc069530
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.204+0000 7fe9d3400700  1 -- 172.21.15.171:0/177935726 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00b940 con 0x7fe9dc069530
2024-03-29T08:54:20.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.204+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc122fc0 con 0x7fe9dc069530
2024-03-29T08:54:20.207 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.204+0000 7fe9d3400700  1 -- 172.21.15.171:0/177935726 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe9cc018070 con 0x7fe9dc069530
2024-03-29T08:54:20.207 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.204+0000 7fe9d3400700  1 -- 172.21.15.171:0/177935726 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fe9cc025c70 con 0x7fe9dc069530
2024-03-29T08:54:20.207 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.205+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc128d90 con 0x7fe9dc069530
2024-03-29T08:54:20.208 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.208+0000 7fe9d3400700  1 -- 172.21.15.171:0/177935726 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fe9dc128d90 con 0x7fe9dc069530
2024-03-29T08:54:20.213 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:20.213+0000 7f04882e0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member
2024-03-29T08:54:20.214 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:20.214+0000 7f5badc94680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member
2024-03-29T08:54:20.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.295+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "809786b2-3806-4467-bd9d-01455bdcd876", "id": 3} v 0) v1 -- 0x7fe9dc129af0 con 0x7fe9dc069530
2024-03-29T08:54:20.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.297+0000 7fe9d3400700  1 -- 172.21.15.171:0/177935726 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "809786b2-3806-4467-bd9d-01455bdcd876", "id": 3}]=0  v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe9cc016070 con 0x7fe9dc069530
2024-03-29T08:54:20.298 INFO:teuthology.orchestra.run.smithi171.stdout:3
2024-03-29T08:54:20.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9dc069530 msgr2=0x7fe9dc126b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9dc069530 0x7fe9dc126b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fe9cc009840 tx=0x7fe9cc016000).stop
2024-03-29T08:54:20.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 shutdown_connections
2024-03-29T08:54:20.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9dc12ae20 0x7fe9dc127530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9dc069530 0x7fe9dc126b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 --2- 172.21.15.171:0/177935726 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe9dc125a90 0x7fe9dc127040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 >> 172.21.15.171:0/177935726 conn(0x7fe9dc0994d0 msgr2=0x7fe9dc123f50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:20.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 shutdown_connections
2024-03-29T08:54:20.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.299+0000 7fe9e1e00700  1 -- 172.21.15.171:0/177935726 wait complete.
2024-03-29T08:54:20.316 INFO:tasks.ceph.osd.0:Restarting daemon
2024-03-29T08:54:20.316 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0
2024-03-29T08:54:20.317 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:20.316+0000 7f04882e0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member
2024-03-29T08:54:20.320 INFO:tasks.ceph.osd.0:Started
2024-03-29T08:54:20.320 INFO:tasks.ceph.osd.1:Restarting daemon
2024-03-29T08:54:20.321 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1
2024-03-29T08:54:20.321 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:20.318+0000 7f5badc94680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member
2024-03-29T08:54:20.324 INFO:tasks.ceph.osd.1:Started
2024-03-29T08:54:20.324 INFO:tasks.ceph.osd.2:Restarting daemon
2024-03-29T08:54:20.324 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2
2024-03-29T08:54:20.328 INFO:tasks.ceph.osd.2:Started
2024-03-29T08:54:20.328 INFO:tasks.ceph.osd.3:Restarting daemon
2024-03-29T08:54:20.329 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3
2024-03-29T08:54:20.333 INFO:tasks.ceph.osd.3:Started
2024-03-29T08:54:20.334 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.598+0000 7ff4bec00700  1  Processor -- start
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.598+0000 7ff4bec00700  1 --  start start
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4bec00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b8066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4bec00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff4b8067300 0x7ff4b8125530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4bec00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b80676e0 0x7ff4b8125a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4bec00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b80694e0 con 0x7ff4b8067300
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4bec00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8068e70 con 0x7ff4b8066a30
2024-03-29T08:54:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4bec00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8063e80 con 0x7ff4b80676e0
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4b7400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff4b8067300 0x7ff4b8125530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4bcc00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b80676e0 0x7ff4b8125a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4b7e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b8066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4b7400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff4b8067300 0x7ff4b8125530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39252/0 (socket says 172.21.15.171:39252)
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.599+0000 7ff4b7400700  1 -- 172.21.15.171:0/1101134884 learned_addr learned my addr 172.21.15.171:0/1101134884 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b7400700  1 -- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b80676e0 msgr2=0x7ff4b8125a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b7400700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b80676e0 0x7ff4b8125a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b7400700  1 -- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 msgr2=0x7ff4b8066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b7400700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b8066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b7400700  1 -- 172.21.15.171:0/1101134884 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8063cb0 con 0x7ff4b8067300
2024-03-29T08:54:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b7e00700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b8066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b7400700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b8067300 0x7ff4b8125530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff4a4009830 tx=0x7ff4a40090f0).ready entity=mon.0 client_cookie=24517e7c3348ac65 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b6a00700  1 -- 172.21.15.171:0/1101134884 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400f510 con 0x7ff4b8067300
2024-03-29T08:54:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b6a00700  1 -- 172.21.15.171:0/1101134884 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400f670 con 0x7ff4b8067300
2024-03-29T08:54:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.600+0000 7ff4b6a00700  1 -- 172.21.15.171:0/1101134884 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400fa10 con 0x7ff4b8067300
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 -- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b8067300 msgr2=0x7ff4b8125530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b8067300 0x7ff4b8125530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff4a4009830 tx=0x7ff4a40090f0).stop
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 -- 172.21.15.171:0/1101134884 shutdown_connections
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b80676e0 0x7ff4b8125a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b8066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 --2- 172.21.15.171:0/1101134884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b8067300 0x7ff4b8125530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 -- 172.21.15.171:0/1101134884 >> 172.21.15.171:0/1101134884 conn(0x7ff4b80992c0 msgr2=0x7ff4b8064c50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 -- 172.21.15.171:0/1101134884 shutdown_connections
2024-03-29T08:54:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.601+0000 7ff4bec00700  1 -- 172.21.15.171:0/1101134884 wait complete.
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.603+0000 7ff4bec00700  1  Processor -- start
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.603+0000 7ff4bec00700  1 --  start start
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.603+0000 7ff4bec00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b81356c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.603+0000 7ff4bec00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b8067300 0x7ff4b8135bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4bec00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b80676e0 0x7ff4b8111a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4bec00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8125680 con 0x7ff4b80676e0
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4bec00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8114cb0 con 0x7ff4b8066a30
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4bec00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8113bc0 con 0x7ff4b8067300
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b81356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b81356c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:58960/0 (socket says 172.21.15.171:58960)
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7e00700  1 -- 172.21.15.171:0/582781125 learned_addr learned my addr 172.21.15.171:0/582781125 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7400700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b8067300 0x7ff4b8135bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4bcc00700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b80676e0 0x7ff4b8111a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7400700  1 -- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 msgr2=0x7ff4b81356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7400700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b81356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7400700  1 -- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b80676e0 msgr2=0x7ff4b8111a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7400700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b80676e0 0x7ff4b8111a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4b7400700  1 -- 172.21.15.171:0/582781125 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009250 con 0x7ff4b8067300
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.604+0000 7ff4bcc00700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b80676e0 0x7ff4b8111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.605+0000 7ff4b7400700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b8067300 0x7ff4b8135bb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff4b8064170 tx=0x7ff4a4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.605+0000 7ff4afe00700  1 -- 172.21.15.171:0/582781125 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4000bc0 con 0x7ff4b8067300
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.605+0000 7ff4afe00700  1 -- 172.21.15.171:0/582781125 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400f7e0 con 0x7ff4b8067300
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.605+0000 7ff4afe00700  1 -- 172.21.15.171:0/582781125 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4000d20 con 0x7ff4b8067300
2024-03-29T08:54:20.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.605+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a4009370 con 0x7ff4b8067300
2024-03-29T08:54:20.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.605+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b8113310 con 0x7ff4b8067300
2024-03-29T08:54:20.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.606+0000 7ff4afe00700  1 -- 172.21.15.171:0/582781125 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff4a4021070 con 0x7ff4b8067300
2024-03-29T08:54:20.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.606+0000 7ff4afe00700  1 -- 172.21.15.171:0/582781125 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7ff4a401a900 con 0x7ff4b8067300
2024-03-29T08:54:20.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.606+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8115240 con 0x7ff4b8067300
2024-03-29T08:54:20.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.609+0000 7ff4afe00700  1 -- 172.21.15.171:0/582781125 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff4a4024a20 con 0x7ff4b8067300
2024-03-29T08:54:20.680 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.680+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4b8124490 con 0x7ff4b8067300
2024-03-29T08:54:20.681 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.680+0000 7ff4afe00700  1 -- 172.21.15.171:0/582781125 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7ff4a401a3f0 con 0x7ff4b8067300
2024-03-29T08:54:20.681 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:20.681 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":6,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T08:54:20.297263+0000","last_up_change":"0.000000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T08:54:20.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.681+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b8067300 msgr2=0x7ff4b8135bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:20.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b8067300 0x7ff4b8135bb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff4b8064170 tx=0x7ff4a4015000).stop
2024-03-29T08:54:20.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 shutdown_connections
2024-03-29T08:54:20.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4b80676e0 0x7ff4b8111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4b8066a30 0x7ff4b81356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 --2- 172.21.15.171:0/582781125 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff4b8067300 0x7ff4b8135bb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:20.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 >> 172.21.15.171:0/582781125 conn(0x7ff4b80992c0 msgr2=0x7ff4b8097250 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:20.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 shutdown_connections
2024-03-29T08:54:20.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:20.682+0000 7ff4bec00700  1 -- 172.21.15.171:0/582781125 wait complete.
2024-03-29T08:54:20.707 INFO:tasks.ceph.ceph_manager.ceph:[]
2024-03-29T08:54:20.707 INFO:tasks.ceph:Waiting for OSDs to come up
2024-03-29T08:54:20.867 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:20.866+0000 7f04882e0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member
2024-03-29T08:54:20.867 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:20.866+0000 7f5badc94680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member
2024-03-29T08:54:20.976 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:20.976+0000 7f5badc94680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member
2024-03-29T08:54:20.977 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:20.977+0000 7f04882e0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member
2024-03-29T08:54:21.038 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T08:54:21.038+0000 7f344651d380 -1 Falling back to public interface
2024-03-29T08:54:21.080 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T08:54:21.080+0000 7fbf84f4e380 -1 Falling back to public interface
2024-03-29T08:54:21.085 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T08:54:21.084+0000 7f12e321e380 -1 Falling back to public interface
2024-03-29T08:54:21.085 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T08:54:21.084+0000 7f3181dfd380 -1 Falling back to public interface
2024-03-29T08:54:21.109 DEBUG:teuthology.orchestra.run.smithi171:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json
2024-03-29T08:54:21.279 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.279+0000 7f26d2600700  1  Processor -- start
2024-03-29T08:54:21.280 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.279+0000 7f26d2600700  1 --  start start
2024-03-29T08:54:21.280 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.279+0000 7f26d2600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc0932a0 0x7f26cc093680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26d2600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f26cc093b70 0x7f26cc11efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26d2600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc094840 con 0x7f26cc11f4b0
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26d2600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc094a70 con 0x7f26cc093b70
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26d2600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0958d0 con 0x7f26cc0932a0
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26cbe00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f26cc11f4b0 0x7f26cc12cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:51150/0 (socket says 172.21.15.171:51150)
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26cbe00700  1 -- 172.21.15.171:0/675773068 learned_addr learned my addr 172.21.15.171:0/675773068 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26caa00700  1 --2- 172.21.15.171:0/675773068 >> v2:172.21.15.171:3300/0 conn(0x7f26cc093b70 0x7f26cc11efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:21.281 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26cb400700  1 --2- 172.21.15.171:0/675773068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc0932a0 0x7f26cc093680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26cb400700  1 -- 172.21.15.171:0/675773068 >> v2:172.21.15.171:3300/0 conn(0x7f26cc093b70 msgr2=0x7f26cc11efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.280+0000 7f26ca000700  1 -- 172.21.15.171:0/675773068 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693192048 0 0) 0x7f26cc094840 con 0x7f26cc11f4b0
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26cb400700  1 --2- 172.21.15.171:0/675773068 >> v2:172.21.15.171:3300/0 conn(0x7f26cc093b70 0x7f26cc11efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26cb400700  1 -- 172.21.15.171:0/675773068 >> v1:172.21.15.171:6789/0 conn(0x7f26cc11f4b0 legacy=0x7f26cc12cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26cb400700  1 -- 172.21.15.171:0/675773068 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc095b90 con 0x7f26cc0932a0
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26caa00700  1 --2- 172.21.15.171:0/675773068 >> v2:172.21.15.171:3300/0 conn(0x7f26cc093b70 0x7f26cc11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26cb400700  1 --2- 172.21.15.171:0/675773068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc0932a0 0x7f26cc093680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f26bc009760 tx=0x7f26bc009060).ready entity=mon.1 client_cookie=50a2fc14361c7317 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26ca000700  1 -- 172.21.15.171:0/675773068 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0090d0 con 0x7f26cc0932a0
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26ca000700  1 -- 172.21.15.171:0/675773068 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00f510 con 0x7f26cc0932a0
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.281+0000 7f26ca000700  1 -- 172.21.15.171:0/675773068 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00f890 con 0x7f26cc0932a0
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 -- 172.21.15.171:0/675773068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc0932a0 msgr2=0x7f26cc093680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:21.283 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 --2- 172.21.15.171:0/675773068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc0932a0 0x7f26cc093680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f26bc009760 tx=0x7f26bc009060).stop
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 -- 172.21.15.171:0/675773068 shutdown_connections
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 --2- 172.21.15.171:0/675773068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc0932a0 0x7f26cc093680 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 --2- 172.21.15.171:0/675773068 >> v2:172.21.15.171:3300/0 conn(0x7f26cc093b70 0x7f26cc11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 -- 172.21.15.171:0/675773068 >> 172.21.15.171:0/675773068 conn(0x7f26cc098dd0 msgr2=0x7f26cc0640c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 -- 172.21.15.171:0/675773068 shutdown_connections
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.282+0000 7f26d2600700  1 -- 172.21.15.171:0/675773068 wait complete.
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.284+0000 7f26d2600700  1  Processor -- start
2024-03-29T08:54:21.284 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.284+0000 7f26d2600700  1 --  start start
2024-03-29T08:54:21.287 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26d2600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26cc0932a0 0x7f26cc112dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:21.287 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26d2600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f26cc093b70 0x7f26cc1132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:21.287 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26d2600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc11f4b0 0x7f26cc1137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:21.287 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26d2600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc113c90 con 0x7f26cc0932a0
2024-03-29T08:54:21.287 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26d2600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc114a20 con 0x7f26cc11f4b0
2024-03-29T08:54:21.287 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26d2600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc115a70 con 0x7f26cc093b70
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26cb400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26cc0932a0 0x7f26cc112dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26cb400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26cc0932a0 0x7f26cc112dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39278/0 (socket says 172.21.15.171:39278)
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26cbe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc11f4b0 0x7f26cc1137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.285+0000 7f26cb400700  1 -- 172.21.15.171:0/426042691 learned_addr learned my addr 172.21.15.171:0/426042691 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26caa00700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f26cc093b70 0x7f26cc1132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26cb400700  1 -- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f26cc093b70 msgr2=0x7f26cc1132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26cb400700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f26cc093b70 0x7f26cc1132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26cb400700  1 -- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc11f4b0 msgr2=0x7f26cc1137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26cb400700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc11f4b0 0x7f26cc1137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26cb400700  1 -- 172.21.15.171:0/426042691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80092a0 con 0x7f26cc0932a0
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26cbe00700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc11f4b0 0x7f26cc1137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26caa00700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f26cc093b70 0x7f26cc1132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26cb400700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26cc0932a0 0x7f26cc112dc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f26bc009e00 tx=0x7f26bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:21.288 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26c3400700  1 -- 172.21.15.171:0/426042691 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00f890 con 0x7f26cc0932a0
2024-03-29T08:54:21.289 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26c3400700  1 -- 172.21.15.171:0/426042691 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc006930 con 0x7f26cc0932a0
2024-03-29T08:54:21.289 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.286+0000 7f26c3400700  1 -- 172.21.15.171:0/426042691 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00fea0 con 0x7f26cc0932a0
2024-03-29T08:54:21.289 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.287+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc0092a0 con 0x7f26cc0932a0
2024-03-29T08:54:21.289 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.287+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc115c70 con 0x7f26cc0932a0
2024-03-29T08:54:21.289 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.287+0000 7f26c3400700  1 -- 172.21.15.171:0/426042691 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f26bc01b880 con 0x7f26cc0932a0
2024-03-29T08:54:21.289 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.287+0000 7f26c3400700  1 -- 172.21.15.171:0/426042691 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f26bc01bb30 con 0x7f26cc0932a0
2024-03-29T08:54:21.289 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.288+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc114870 con 0x7f26cc0932a0
2024-03-29T08:54:21.292 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.292+0000 7f26c3400700  1 -- 172.21.15.171:0/426042691 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f26bc029060 con 0x7f26cc0932a0
2024-03-29T08:54:21.368 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.368+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26cc05a310 con 0x7f26cc0932a0
2024-03-29T08:54:21.369 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.368+0000 7f26c3400700  1 -- 172.21.15.171:0/426042691 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f26bc01f070 con 0x7f26cc0932a0
2024-03-29T08:54:21.369 INFO:teuthology.misc.health.smithi171.stdout:
2024-03-29T08:54:21.369 INFO:teuthology.misc.health.smithi171.stdout:{"epoch":6,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T08:54:20.297263+0000","last_up_change":"0.000000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26cc0932a0 msgr2=0x7f26cc112dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26cc0932a0 0x7f26cc112dc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f26bc009e00 tx=0x7f26bc017000).stop
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 shutdown_connections
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26cc11f4b0 0x7f26cc1137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26cc0932a0 0x7f26cc112dc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 --2- 172.21.15.171:0/426042691 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f26cc093b70 0x7f26cc1132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 >> 172.21.15.171:0/426042691 conn(0x7f26cc098dd0 msgr2=0x7f26cc097960 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 shutdown_connections
2024-03-29T08:54:21.371 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:21.370+0000 7f26d2600700  1 -- 172.21.15.171:0/426042691 wait complete.
2024-03-29T08:54:21.390 DEBUG:teuthology.misc:0 of 4 OSDs are up
2024-03-29T08:54:21.395 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:21.395+0000 7f04882e0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member
2024-03-29T08:54:21.397 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:21.397+0000 7f5badc94680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member
2024-03-29T08:54:21.494 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:21.494+0000 7f04882e0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member
2024-03-29T08:54:21.496 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:21.495+0000 7f5badc94680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member
2024-03-29T08:54:21.696 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:21.696+0000 7f04882e0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member
2024-03-29T08:54:21.698 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:21.697+0000 7f5badc94680 -1 mgr[py] Module status has missing NOTIFY_TYPES member
2024-03-29T08:54:21.785 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:21.785+0000 7f04882e0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member
2024-03-29T08:54:21.786 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:21.785+0000 7f5badc94680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member
2024-03-29T08:54:22.079 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:22.078+0000 7f5badc94680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member
2024-03-29T08:54:22.079 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:22.079+0000 7f04882e0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member
2024-03-29T08:54:22.213 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:22.212+0000 7f5badc94680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member
2024-03-29T08:54:22.213 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:22.212+0000 7f04882e0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member
2024-03-29T08:54:22.400 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:22.399+0000 7f04882e0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member
2024-03-29T08:54:22.400 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:22.400+0000 7f5badc94680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member
2024-03-29T08:54:22.490 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T08:54:22.490+0000 7f04882e0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member
2024-03-29T08:54:22.490 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:22.490+0000 7f5badc94680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member
2024-03-29T08:54:23.504 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:23.503+0000 7f5b82c00700 -1 mgr.server handle_report got status from non-daemon mon.b
2024-03-29T08:54:23.504 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T08:54:23.504+0000 7f5b82c00700 -1 mgr.server handle_report got status from non-daemon mon.c
2024-03-29T08:54:24.783 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T08:54:24.783+0000 7f344651d380 -1 osd.0 0 log_to_monitors {default=true}
2024-03-29T08:54:24.858 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T08:54:24.857+0000 7f3181dfd380 -1 osd.3 0 log_to_monitors {default=true}
2024-03-29T08:54:24.899 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T08:54:24.899+0000 7fbf84f4e380 -1 osd.1 0 log_to_monitors {default=true}
2024-03-29T08:54:24.922 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T08:54:24.922+0000 7f12e321e380 -1 osd.2 0 log_to_monitors {default=true}
2024-03-29T08:54:26.512 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T08:54:26.512+0000 7f3438800700 -1 osd.0 0 waiting for initial osdmap
2024-03-29T08:54:26.514 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T08:54:26.513+0000 7f12d5600700 -1 osd.2 0 waiting for initial osdmap
2024-03-29T08:54:26.516 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T08:54:26.515+0000 7f3174000700 -1 osd.3 0 waiting for initial osdmap
2024-03-29T08:54:26.516 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T08:54:26.515+0000 7fbf77200700 -1 osd.1 0 waiting for initial osdmap
2024-03-29T08:54:26.524 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T08:54:26.524+0000 7f12d0e00700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T08:54:26.524 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T08:54:26.524+0000 7f316f800700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T08:54:26.527 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T08:54:26.527+0000 7f3434000700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T08:54:26.528 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T08:54:26.528+0000 7fbf72a00700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T08:54:27.794 DEBUG:teuthology.orchestra.run.smithi171:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json
2024-03-29T08:54:27.958 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.957+0000 7f95f5c00700  1  Processor -- start
2024-03-29T08:54:27.958 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.958+0000 7f95f5c00700  1 --  start start
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.958+0000 7f95f5c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f95f00932a0 0x7f95f0093680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.958+0000 7f95f5c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f0093b70 0x7f95f011efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.958+0000 7f95f5c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f0094840 con 0x7f95f011f4b0
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.958+0000 7f95f5c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f0094a70 con 0x7f95f00932a0
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.958+0000 7f95f5c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00958d0 con 0x7f95f0093b70
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95ee000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f0093b70 0x7f95f011efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95eea00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f95f00932a0 0x7f95f0093680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95ef400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f95f011f4b0 0x7f95f012cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60572/0 (socket says 172.21.15.171:60572)
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95ee000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f0093b70 0x7f95f011efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47676/0 (socket says 172.21.15.171:47676)
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95ef400700  1 -- 172.21.15.171:0/3293129694 learned_addr learned my addr 172.21.15.171:0/3293129694 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95eea00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f95f00932a0 0x7f95f0093680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:46976/0 (socket says 172.21.15.171:46976)
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95eea00700  1 -- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f0093b70 msgr2=0x7f95f011efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:27.961 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95eea00700  1 --2- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f0093b70 0x7f95f011efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95eea00700  1 -- 172.21.15.171:0/3293129694 >> v1:172.21.15.171:6789/0 conn(0x7f95f011f4b0 legacy=0x7f95f012cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95eea00700  1 -- 172.21.15.171:0/3293129694 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0095b90 con 0x7f95f00932a0
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95ed600700  1 -- 172.21.15.171:0/3293129694 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342566358 0 0) 0x7f95f0094840 con 0x7f95f011f4b0
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95ee000700  1 --2- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f0093b70 0x7f95f011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95eea00700  1 --2- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f00932a0 0x7f95f0093680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f95e0009760 tx=0x7f95e0009060).ready entity=mon.0 client_cookie=c11bc40307578870 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.959+0000 7f95ed600700  1 -- 172.21.15.171:0/3293129694 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00090d0 con 0x7f95f00932a0
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95ed600700  1 -- 172.21.15.171:0/3293129694 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e000f510 con 0x7f95f00932a0
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95ed600700  1 -- 172.21.15.171:0/3293129694 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000f890 con 0x7f95f00932a0
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 -- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f00932a0 msgr2=0x7f95f0093680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 --2- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f00932a0 0x7f95f0093680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f95e0009760 tx=0x7f95e0009060).stop
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 -- 172.21.15.171:0/3293129694 shutdown_connections
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 --2- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f00932a0 0x7f95f0093680 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 --2- 172.21.15.171:0/3293129694 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f0093b70 0x7f95f011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:27.962 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 -- 172.21.15.171:0/3293129694 >> 172.21.15.171:0/3293129694 conn(0x7f95f0098dd0 msgr2=0x7f95f00640c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:27.963 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 -- 172.21.15.171:0/3293129694 shutdown_connections
2024-03-29T08:54:27.963 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.960+0000 7f95f5c00700  1 -- 172.21.15.171:0/3293129694 wait complete.
2024-03-29T08:54:27.964 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.961+0000 7f95f5c00700  1  Processor -- start
2024-03-29T08:54:27.964 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95f5c00700  1 --  start start
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95f5c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95f00932a0 0x7f95f0134d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95f5c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f0093b70 0x7f95f0135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95f5c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f011f4b0 0x7f95f0112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95f5c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f011f060 con 0x7f95f0093b70
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95f5c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f01164c0 con 0x7f95f00932a0
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95f5c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0115910 con 0x7f95f011f4b0
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95eea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95f00932a0 0x7f95f0134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95eea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95f00932a0 0x7f95f0134d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53192/0 (socket says 172.21.15.171:53192)
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95eea00700  1 -- 172.21.15.171:0/2544101994 learned_addr learned my addr 172.21.15.171:0/2544101994 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95ee000700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f0093b70 0x7f95f0135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.962+0000 7f95ef400700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f011f4b0 0x7f95f0112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95ef400700  1 -- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95f00932a0 msgr2=0x7f95f0134d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95ef400700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95f00932a0 0x7f95f0134d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:27.965 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95ef400700  1 -- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f0093b70 msgr2=0x7f95f0135220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95ef400700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f0093b70 0x7f95f0135220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95ef400700  1 -- 172.21.15.171:0/2544101994 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc0092a0 con 0x7f95f011f4b0
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95eea00700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95f00932a0 0x7f95f0134d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95ee000700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f0093b70 0x7f95f0135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95ef400700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f011f4b0 0x7f95f0112c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f95e8002230 tx=0x7f95e8007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95e6a00700  1 -- 172.21.15.171:0/2544101994 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8005d30 con 0x7f95f011f4b0
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95e6a00700  1 -- 172.21.15.171:0/2544101994 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8007110 con 0x7f95f011f4b0
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e00092a0 con 0x7f95f011f4b0
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95e6a00700  1 -- 172.21.15.171:0/2544101994 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80074d0 con 0x7f95f011f4b0
2024-03-29T08:54:27.966 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.963+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f0135710 con 0x7f95f011f4b0
2024-03-29T08:54:27.967 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.965+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f005a310 con 0x7f95f011f4b0
2024-03-29T08:54:27.967 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.965+0000 7f95e6a00700  1 -- 172.21.15.171:0/2544101994 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f95e8013410 con 0x7f95f011f4b0
2024-03-29T08:54:27.967 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.965+0000 7f95e6a00700  1 -- 172.21.15.171:0/2544101994 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f95e8054de0 con 0x7f95f011f4b0
2024-03-29T08:54:27.970 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:27.971+0000 7f95e6a00700  1 -- 172.21.15.171:0/2544101994 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f95e8035a40 con 0x7f95f011f4b0
2024-03-29T08:54:28.119 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.118+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f0135960 con 0x7f95f011f4b0
2024-03-29T08:54:28.120 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.119+0000 7f95e6a00700  1 -- 172.21.15.171:0/2544101994 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v9) v1 ==== 74+0+4936 (secure 0 0 0) 0x7f95e8039230 con 0x7f95f011f4b0
2024-03-29T08:54:28.120 INFO:teuthology.misc.health.smithi171.stdout:
2024-03-29T08:54:28.120 INFO:teuthology.misc.health.smithi171.stdout:{"epoch":9,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T08:54:27.513354+0000","last_up_change":"2024-03-29T08:54:27.513354+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":39169}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":39169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":39169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":39169}]},"public_addr":"172.21.15.171:6800/39169","cluster_addr":"172.21.15.171:6801/39169","heartbeat_back_addr":"172.21.15.171:6803/39169","heartbeat_front_addr":"172.21.15.171:6802/39169","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":39170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":39170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":39170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":39170}]},"public_addr":"172.21.15.171:6804/39170","cluster_addr":"172.21.15.171:6805/39170","heartbeat_back_addr":"172.21.15.171:6807/39170","heartbeat_front_addr":"172.21.15.171:6806/39170","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":39179}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":39179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":39179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":39179}]},"public_addr":"172.21.15.171:6809/39179","cluster_addr":"172.21.15.171:6811/39179","heartbeat_back_addr":"172.21.15.171:6815/39179","heartbeat_front_addr":"172.21.15.171:6814/39179","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":39186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":39186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":39186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":39186}]},"public_addr":"172.21.15.171:6808/39186","cluster_addr":"172.21.15.171:6810/39186","heartbeat_back_addr":"172.21.15.171:6813/39186","heartbeat_front_addr":"172.21.15.171:6812/39186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T08:54:28.122 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 >> v1:172.21.15.171:6816/38531 conn(0x7f95d0041b80 legacy=0x7f95d0044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.122 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f011f4b0 msgr2=0x7f95f0112c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.122 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f011f4b0 0x7f95f0112c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f95e8002230 tx=0x7f95e8007eb0).stop
2024-03-29T08:54:28.122 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 shutdown_connections
2024-03-29T08:54:28.122 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f95f011f4b0 0x7f95f0112c60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.122 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95f00932a0 0x7f95f0134d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.122 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 --2- 172.21.15.171:0/2544101994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95f0093b70 0x7f95f0135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.123 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 >> 172.21.15.171:0/2544101994 conn(0x7f95f0098dd0 msgr2=0x7f95f0097960 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:28.123 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 shutdown_connections
2024-03-29T08:54:28.123 INFO:teuthology.misc.health.smithi171.stderr:2024-03-29T08:54:28.122+0000 7f95f5c00700  1 -- 172.21.15.171:0/2544101994 wait complete.
2024-03-29T08:54:28.136 DEBUG:teuthology.misc:4 of 4 OSDs are up
2024-03-29T08:54:28.137 INFO:tasks.ceph:Creating RBD pool
2024-03-29T08:54:28.137 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd pool create rbd 8
2024-03-29T08:54:28.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.314+0000 7f7706200700  1  Processor -- start
2024-03-29T08:54:28.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.315+0000 7f7706200700  1 --  start start
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.315+0000 7f7706200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125390 0x7f7700125770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.315+0000 7f7706200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f7700125c60 0x7f7700121f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.315+0000 7f7706200700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000684b0 con 0x7f7700122420
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.315+0000 7f7706200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000680e0 con 0x7f7700125c60
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.315+0000 7f7706200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7700069540 con 0x7f7700125390
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f7700125c60 0x7f7700121f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76ff400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125390 0x7f7700125770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f7700125c60 0x7f7700121f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47002/0 (socket says 172.21.15.171:47002)
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76ff400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125390 0x7f7700125770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47708/0 (socket says 172.21.15.171:47708)
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 -- 172.21.15.171:0/822490589 learned_addr learned my addr 172.21.15.171:0/822490589 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76ffe00700  1 --1- 172.21.15.171:0/822490589 >> v1:172.21.15.171:6789/0 conn(0x7f7700122420 0x7f770012c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60578/0 (socket says 172.21.15.171:60578)
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 -- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125390 msgr2=0x7f7700125770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:28.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 --2- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125390 0x7f7700125770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 -- 172.21.15.171:0/822490589 >> v1:172.21.15.171:6789/0 conn(0x7f7700122420 legacy=0x7f770012c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 -- 172.21.15.171:0/822490589 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700069890 con 0x7f7700125c60
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76fea00700  1 -- 172.21.15.171:0/822490589 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48964897 0 0) 0x7f77000684b0 con 0x7f7700122420
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76ff400700  1 --2- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125390 0x7f7700125770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76f7e00700  1 --2- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700125c60 0x7f7700121f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f76e8009830 tx=0x7f76e80090f0).ready entity=mon.0 client_cookie=e6530d1593b7871b server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.316+0000 7f76fea00700  1 -- 172.21.15.171:0/822490589 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800b580 con 0x7f7700125c60
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f76fea00700  1 -- 172.21.15.171:0/822490589 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e800b6e0 con 0x7f7700125c60
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f76fea00700  1 -- 172.21.15.171:0/822490589 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800ba60 con 0x7f7700125c60
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 -- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700125c60 msgr2=0x7f7700121f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 --2- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700125c60 0x7f7700121f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f76e8009830 tx=0x7f76e80090f0).stop
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 -- 172.21.15.171:0/822490589 shutdown_connections
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 --2- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125390 0x7f7700125770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 --2- 172.21.15.171:0/822490589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700125c60 0x7f7700121f30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 -- 172.21.15.171:0/822490589 >> 172.21.15.171:0/822490589 conn(0x7f7700096860 msgr2=0x7f7700098c80 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:28.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 -- 172.21.15.171:0/822490589 shutdown_connections
2024-03-29T08:54:28.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.317+0000 7f7706200700  1 -- 172.21.15.171:0/822490589 wait complete.
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.318+0000 7f7706200700  1  Processor -- start
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f7706200700  1 --  start start
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f7706200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700122420 0x7f7700134ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f7706200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7700125390 0x7f7700135190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f7706200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125c60 0x7f7700112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f7706200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001217f0 con 0x7f7700122420
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f7706200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77001160e0 con 0x7f7700125390
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f7706200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7700115760 con 0x7f7700125c60
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f76ff400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700122420 0x7f7700134ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f76f7e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7700125390 0x7f7700135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f76ff400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700122420 0x7f7700134ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47010/0 (socket says 172.21.15.171:47010)
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f76ff400700  1 -- 172.21.15.171:0/1606580483 learned_addr learned my addr 172.21.15.171:0/1606580483 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.319+0000 7f76ffe00700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125c60 0x7f7700112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76ff400700  1 -- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125c60 msgr2=0x7f7700112ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76ff400700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125c60 0x7f7700112ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76ff400700  1 -- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7700125390 msgr2=0x7f7700135190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76ff400700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7700125390 0x7f7700135190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76ff400700  1 -- 172.21.15.171:0/1606580483 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0009240 con 0x7f7700122420
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76ff400700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700122420 0x7f7700134ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f76f000ea50 tx=0x7f76f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76f7400700  1 -- 172.21.15.171:0/1606580483 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000ee90 con 0x7f7700122420
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76f7400700  1 -- 172.21.15.171:0/1606580483 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00095f0 con 0x7f7700122420
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f76f7400700  1 -- 172.21.15.171:0/1606580483 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000ca60 con 0x7f7700122420
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e8009370 con 0x7f7700122420
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.320+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700135680 con 0x7f7700122420
2024-03-29T08:54:28.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.321+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7700135900 con 0x7f7700122420
2024-03-29T08:54:28.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.322+0000 7f76f7400700  1 -- 172.21.15.171:0/1606580483 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f76f001b400 con 0x7f7700122420
2024-03-29T08:54:28.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.322+0000 7f76f7400700  1 -- 172.21.15.171:0/1606580483 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f76f00553e0 con 0x7f7700122420
2024-03-29T08:54:28.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.327+0000 7f76f7400700  1 -- 172.21.15.171:0/1606580483 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f76f0035fc0 con 0x7f7700122420
2024-03-29T08:54:28.474 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.473+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f77001163c0 con 0x7f7700122420
2024-03-29T08:54:28.536 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.535+0000 7f76f7400700  1 -- 172.21.15.171:0/1606580483 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f76f0016070 con 0x7f7700122420
2024-03-29T08:54:28.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.539+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 >> v1:172.21.15.171:6816/38531 conn(0x7f76dc041b80 legacy=0x7f76dc044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.540+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700122420 msgr2=0x7f7700134ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.540+0000 7f7706200700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700122420 0x7f7700134ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f76f000ea50 tx=0x7f76f0009060).stop
2024-03-29T08:54:28.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.540+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 shutdown_connections
2024-03-29T08:54:28.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.540+0000 7f7706200700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f7700125c60 0x7f7700112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.540+0000 7f7706200700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7700122420 0x7f7700134ca0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.540+0000 7f7706200700  1 --2- 172.21.15.171:0/1606580483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7700125390 0x7f7700135190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.540+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 >> 172.21.15.171:0/1606580483 conn(0x7f7700096860 msgr2=0x7f7700097210 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:28.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.541+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 shutdown_connections
2024-03-29T08:54:28.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.541+0000 7f7706200700  1 -- 172.21.15.171:0/1606580483 wait complete.
2024-03-29T08:54:28.544 INFO:teuthology.orchestra.run.smithi171.stderr:pool 'rbd' created
2024-03-29T08:54:28.559 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it
2024-03-29T08:54:28.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.738+0000 7ff427c00700  1  Processor -- start
2024-03-29T08:54:28.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.738+0000 7ff427c00700  1 --  start start
2024-03-29T08:54:28.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff427c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff420069530 0x7ff420126580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff427c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff42012ae20 0x7ff42012d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff427c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff420069150 con 0x7ff420125a90
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff427c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff420068920 con 0x7ff420069530
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff427c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff420067fb0 con 0x7ff42012ae20
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff41fe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff420069530 0x7ff420126580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff425c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff42012ae20 0x7ff42012d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff41fe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff420069530 0x7ff420126580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47012/0 (socket says 172.21.15.171:47012)
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff425c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff42012ae20 0x7ff42012d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47730/0 (socket says 172.21.15.171:47730)
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff425c00700  1 -- 172.21.15.171:0/2299966695 learned_addr learned my addr 172.21.15.171:0/2299966695 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.739+0000 7ff425200700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7ff420125a90 0x7ff420125e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60592/0 (socket says 172.21.15.171:60592)
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff425c00700  1 -- 172.21.15.171:0/2299966695 >> v2:172.21.15.171:3300/0 conn(0x7ff420069530 msgr2=0x7ff420126580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff425c00700  1 --2- 172.21.15.171:0/2299966695 >> v2:172.21.15.171:3300/0 conn(0x7ff420069530 0x7ff420126580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff425c00700  1 -- 172.21.15.171:0/2299966695 >> v1:172.21.15.171:6789/0 conn(0x7ff420125a90 legacy=0x7ff420125e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff425c00700  1 -- 172.21.15.171:0/2299966695 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420069d10 con 0x7ff42012ae20
2024-03-29T08:54:28.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff425c00700  1 --2- 172.21.15.171:0/2299966695 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff42012ae20 0x7ff42012d210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff418009f80 tx=0x7ff418009840).ready entity=mon.2 client_cookie=41297ce690e95791 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:28.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff41f400700  1 -- 172.21.15.171:0/2299966695 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800e070 con 0x7ff42012ae20
2024-03-29T08:54:28.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff41f400700  1 -- 172.21.15.171:0/2299966695 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800ba00 con 0x7ff42012ae20
2024-03-29T08:54:28.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff41f400700  1 -- 172.21.15.171:0/2299966695 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800bd80 con 0x7ff42012ae20
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff427c00700  1 -- 172.21.15.171:0/2299966695 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff42012ae20 msgr2=0x7ff42012d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.740+0000 7ff427c00700  1 --2- 172.21.15.171:0/2299966695 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff42012ae20 0x7ff42012d210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff418009f80 tx=0x7ff418009840).stop
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.741+0000 7ff427c00700  1 -- 172.21.15.171:0/2299966695 shutdown_connections
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.741+0000 7ff427c00700  1 --2- 172.21.15.171:0/2299966695 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff42012ae20 0x7ff42012d210 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.741+0000 7ff427c00700  1 --2- 172.21.15.171:0/2299966695 >> v2:172.21.15.171:3300/0 conn(0x7ff420069530 0x7ff420126580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.741+0000 7ff427c00700  1 -- 172.21.15.171:0/2299966695 >> 172.21.15.171:0/2299966695 conn(0x7ff4200994d0 msgr2=0x7ff420064d50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.741+0000 7ff427c00700  1 -- 172.21.15.171:0/2299966695 shutdown_connections
2024-03-29T08:54:28.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.741+0000 7ff427c00700  1 -- 172.21.15.171:0/2299966695 wait complete.
2024-03-29T08:54:28.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.743+0000 7ff427c00700  1  Processor -- start
2024-03-29T08:54:28.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.743+0000 7ff427c00700  1 --  start start
2024-03-29T08:54:28.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff427c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff420069530 0x7ff420129110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff427c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff420125a90 0x7ff420129600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff427c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff42012ae20 0x7ff420135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff427c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff420110b20 con 0x7ff42012ae20
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff427c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42012a350 con 0x7ff420069530
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff427c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff42012d220 con 0x7ff420125a90
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff425200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff420069530 0x7ff420129110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff420125a90 0x7ff420129600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff420125a90 0x7ff420129600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47736/0 (socket says 172.21.15.171:47736)
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 -- 172.21.15.171:0/599665238 learned_addr learned my addr 172.21.15.171:0/599665238 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff425c00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff42012ae20 0x7ff420135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 -- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff420069530 msgr2=0x7ff420129110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff420069530 0x7ff420129110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 -- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff42012ae20 msgr2=0x7ff420135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:28.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff42012ae20 0x7ff420135040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff41fe00700  1 -- 172.21.15.171:0/599665238 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418009ae0 con 0x7ff420125a90
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.744+0000 7ff425c00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff42012ae20 0x7ff420135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.745+0000 7ff41fe00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff420125a90 0x7ff420129600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff40c00e900 tx=0x7ff40c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.745+0000 7ff41cc00700  1 -- 172.21.15.171:0/599665238 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c009510 con 0x7ff420125a90
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.745+0000 7ff41cc00700  1 -- 172.21.15.171:0/599665238 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c00c670 con 0x7ff420125a90
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.745+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42012a000 con 0x7ff420125a90
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.745+0000 7ff41cc00700  1 -- 172.21.15.171:0/599665238 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00c9f0 con 0x7ff420125a90
2024-03-29T08:54:28.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.745+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420129af0 con 0x7ff420125a90
2024-03-29T08:54:28.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.746+0000 7ff41cc00700  1 -- 172.21.15.171:0/599665238 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7ff40c01b400 con 0x7ff420125a90
2024-03-29T08:54:28.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.746+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff420066470 con 0x7ff420125a90
2024-03-29T08:54:28.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.747+0000 7ff41cc00700  1 -- 172.21.15.171:0/599665238 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2803+0+0 (secure 0 0 0) 0x7ff40c0556c0 con 0x7ff420125a90
2024-03-29T08:54:28.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.751+0000 7ff41cc00700  1 -- 172.21.15.171:0/599665238 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7ff40c035fc0 con 0x7ff420125a90
2024-03-29T08:54:28.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:28.900+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff42012d820 con 0x7ff420125a90
2024-03-29T08:54:29.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.541+0000 7ff41cc00700  1 -- 172.21.15.171:0/599665238 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff40c016030 con 0x7ff420125a90
2024-03-29T08:54:29.545 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.545+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 >> v1:172.21.15.171:6816/38531 conn(0x7ff400041b80 legacy=0x7ff400044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.545 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.545+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff420125a90 msgr2=0x7ff420129600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.545 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.545+0000 7ff427c00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff420125a90 0x7ff420129600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff40c00e900 tx=0x7ff40c009060).stop
2024-03-29T08:54:29.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.546+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 shutdown_connections
2024-03-29T08:54:29.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.546+0000 7ff427c00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff42012ae20 0x7ff420135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.546+0000 7ff427c00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff420069530 0x7ff420129110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.546+0000 7ff427c00700  1 --2- 172.21.15.171:0/599665238 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff420125a90 0x7ff420129600 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.546+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 >> 172.21.15.171:0/599665238 conn(0x7ff4200994d0 msgr2=0x7ff420124020 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:29.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.546+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 shutdown_connections
2024-03-29T08:54:29.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.546+0000 7ff427c00700  1 -- 172.21.15.171:0/599665238 wait complete.
2024-03-29T08:54:29.548 INFO:teuthology.orchestra.run.smithi171.stderr:enabled application 'rbd' on pool 'rbd'
2024-03-29T08:54:29.567 INFO:tasks.ceph:Starting mds daemons in cluster ceph...
2024-03-29T08:54:29.568 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean...
2024-03-29T08:54:29.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available
2024-03-29T08:54:29.568 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json
2024-03-29T08:54:29.569 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting
2024-03-29T08:54:29.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.754+0000 7f0d74600700  1  Processor -- start
2024-03-29T08:54:29.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.754+0000 7f0d74600700  1 --  start start
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d74600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c066a30 0x7f0d6c066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d74600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f0d6c067300 0x7f0d6c125530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d74600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c063cb0 con 0x7f0d6c0676e0
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d74600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0694e0 con 0x7f0d6c067300
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d74600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c068e70 con 0x7f0d6c066a30
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d71c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c066a30 0x7f0d6c066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d71c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c066a30 0x7f0d6c066e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47748/0 (socket says 172.21.15.171:47748)
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d71c00700  1 -- 172.21.15.171:0/3773370819 learned_addr learned my addr 172.21.15.171:0/3773370819 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.755+0000 7f0d71200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f0d6c067300 0x7f0d6c125530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d6be00700  1 -- 172.21.15.171:0/3773370819 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788656420 0 0) 0x7f0d6c063cb0 con 0x7f0d6c0676e0
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d71c00700  1 -- 172.21.15.171:0/3773370819 >> v2:172.21.15.171:3300/0 conn(0x7f0d6c067300 msgr2=0x7f0d6c125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d71c00700  1 --2- 172.21.15.171:0/3773370819 >> v2:172.21.15.171:3300/0 conn(0x7f0d6c067300 0x7f0d6c125530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d71c00700  1 -- 172.21.15.171:0/3773370819 >> v1:172.21.15.171:6789/0 conn(0x7f0d6c0676e0 legacy=0x7f0d6c125a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d71c00700  1 -- 172.21.15.171:0/3773370819 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c069bf0 con 0x7f0d6c066a30
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d71200700  1 --2- 172.21.15.171:0/3773370819 >> v2:172.21.15.171:3300/0 conn(0x7f0d6c067300 0x7f0d6c125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d71c00700  1 --2- 172.21.15.171:0/3773370819 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c066a30 0x7f0d6c066e10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d60009840 tx=0x7f0d60009060).ready entity=mon.2 client_cookie=822a47a7c2e5bdfa server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d6be00700  1 -- 172.21.15.171:0/3773370819 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60005880 con 0x7f0d6c066a30
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d6be00700  1 -- 172.21.15.171:0/3773370819 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600059e0 con 0x7f0d6c066a30
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.756+0000 7f0d6be00700  1 -- 172.21.15.171:0/3773370819 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60005d60 con 0x7f0d6c066a30
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 -- 172.21.15.171:0/3773370819 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c066a30 msgr2=0x7f0d6c066e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 --2- 172.21.15.171:0/3773370819 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c066a30 0x7f0d6c066e10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d60009840 tx=0x7f0d60009060).stop
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 -- 172.21.15.171:0/3773370819 shutdown_connections
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 --2- 172.21.15.171:0/3773370819 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c066a30 0x7f0d6c066e10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 --2- 172.21.15.171:0/3773370819 >> v2:172.21.15.171:3300/0 conn(0x7f0d6c067300 0x7f0d6c125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 -- 172.21.15.171:0/3773370819 >> 172.21.15.171:0/3773370819 conn(0x7f0d6c0992c0 msgr2=0x7f0d6c064c50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:29.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 -- 172.21.15.171:0/3773370819 shutdown_connections
2024-03-29T08:54:29.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.757+0000 7f0d74600700  1 -- 172.21.15.171:0/3773370819 wait complete.
2024-03-29T08:54:29.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.758+0000 7f0d74600700  1  Processor -- start
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d74600700  1 --  start start
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d74600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d6c066a30 0x7f0d6c128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d74600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c067300 0x7f0d6c129010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d74600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d6c0676e0 0x7f0d6c129500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d74600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1253e0 con 0x7f0d6c0676e0
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d74600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c12a670 con 0x7f0d6c066a30
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d74600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c12c590 con 0x7f0d6c067300
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d71c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d6c066a30 0x7f0d6c128b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d71c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d6c066a30 0x7f0d6c128b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53228/0 (socket says 172.21.15.171:53228)
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d71c00700  1 -- 172.21.15.171:0/1923669009 learned_addr learned my addr 172.21.15.171:0/1923669009 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d71200700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c067300 0x7f0d6c129010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.759+0000 7f0d72600700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d6c0676e0 0x7f0d6c129500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d71c00700  1 -- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c067300 msgr2=0x7f0d6c129010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d71c00700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c067300 0x7f0d6c129010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d71c00700  1 -- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d6c0676e0 msgr2=0x7f0d6c129500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d71c00700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d6c0676e0 0x7f0d6c129500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d71c00700  1 -- 172.21.15.171:0/1923669009 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d580092a0 con 0x7f0d6c066a30
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d71c00700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d6c066a30 0x7f0d6c128b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d60009fd0 tx=0x7f0d60016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d69600700  1 -- 172.21.15.171:0/1923669009 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60005880 con 0x7f0d6c066a30
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d69600700  1 -- 172.21.15.171:0/1923669009 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000b580 con 0x7f0d6c066a30
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d60009300 con 0x7f0d6c066a30
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d69600700  1 -- 172.21.15.171:0/1923669009 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000b940 con 0x7f0d6c066a30
2024-03-29T08:54:29.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.760+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c12d300 con 0x7f0d6c066a30
2024-03-29T08:54:29.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.761+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c12c330 con 0x7f0d6c066a30
2024-03-29T08:54:29.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.762+0000 7f0d69600700  1 -- 172.21.15.171:0/1923669009 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f0d60018070 con 0x7f0d6c066a30
2024-03-29T08:54:29.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.762+0000 7f0d69600700  1 -- 172.21.15.171:0/1923669009 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f0d60056100 con 0x7f0d6c066a30
2024-03-29T08:54:29.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.767+0000 7f0d69600700  1 -- 172.21.15.171:0/1923669009 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f0d6c12c330 con 0x7f0d6c066a30
2024-03-29T08:54:29.941 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.942+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0d6c12c330 con 0x7f0d6c066a30
2024-03-29T08:54:29.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.944+0000 7f0d69600700  1 -- 172.21.15.171:0/1923669009 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0  v4) v1 ==== 74+0+97489 (secure 0 0 0) 0x7f0d6c12c330 con 0x7f0d6c066a30
2024-03-29T08:54:29.945 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:29.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 >> v1:172.21.15.171:6816/38531 conn(0x7f0d4c041b80 legacy=0x7f0d4c044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d6c066a30 msgr2=0x7f0d6c128b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:29.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d6c066a30 0x7f0d6c128b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d60009fd0 tx=0x7f0d60016000).stop
2024-03-29T08:54:29.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 shutdown_connections
2024-03-29T08:54:29.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d6c0676e0 0x7f0d6c129500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d6c066a30 0x7f0d6c128b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 --2- 172.21.15.171:0/1923669009 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0d6c067300 0x7f0d6c129010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:29.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 >> 172.21.15.171:0/1923669009 conn(0x7f0d6c0992c0 msgr2=0x7f0d6c11f550 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:29.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 shutdown_connections
2024-03-29T08:54:29.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:29.946+0000 7f0d74600700  1 -- 172.21.15.171:0/1923669009 wait complete.
2024-03-29T08:54:29.963 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":4,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6816","nonce":38531}]},"active_addr":"172.21.15.171:6816/38531","active_change":"2024-03-29T08:54:22.493438+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":4094087308}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":4287724647}]}]}
2024-03-29T08:54:29.965 INFO:tasks.ceph.ceph_manager.ceph:mgr available!
2024-03-29T08:54:29.965 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up
2024-03-29T08:54:29.965 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.149+0000 7fdbcaa00700  1  Processor -- start
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.149+0000 7fdbcaa00700  1 --  start start
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.149+0000 7fdbcaa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc4065030 0x7fdbc4065410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.149+0000 7fdbcaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc412afe0 0x7fdbc412d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.149+0000 7fdbcaa00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc4066f10 con 0x7fdbc4065900
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.149+0000 7fdbcaa00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc405fb90 con 0x7fdbc4065030
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.149+0000 7fdbcaa00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4066810 con 0x7fdbc412afe0
2024-03-29T08:54:30.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc8a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc412afe0 0x7fdbc412d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc3400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fdbc4065900 0x7fdbc41298c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60620/0 (socket says 172.21.15.171:60620)
2024-03-29T08:54:30.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc3400700  1 -- 172.21.15.171:0/2236062254 learned_addr learned my addr 172.21.15.171:0/2236062254 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:30.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc3e00700  1 --2- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc4065030 0x7fdbc4065410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc8a00700  1 -- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc4065030 msgr2=0x7fdbc4065410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:30.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc8a00700  1 --2- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc4065030 0x7fdbc4065410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc2a00700  1 -- 172.21.15.171:0/2236062254 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195920393 0 0) 0x7fdbc4066f10 con 0x7fdbc4065900
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc8a00700  1 -- 172.21.15.171:0/2236062254 >> v1:172.21.15.171:6789/0 conn(0x7fdbc4065900 legacy=0x7fdbc41298c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc8a00700  1 -- 172.21.15.171:0/2236062254 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40660e0 con 0x7fdbc412afe0
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc3e00700  1 --2- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc4065030 0x7fdbc4065410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.150+0000 7fdbc8a00700  1 --2- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc412afe0 0x7fdbc412d3d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdbbc009e90 tx=0x7fdbbc009780).ready entity=mon.2 client_cookie=49d57eeb97aa84e8 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbc2a00700  1 -- 172.21.15.171:0/2236062254 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00e070 con 0x7fdbc412afe0
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbc2a00700  1 -- 172.21.15.171:0/2236062254 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc00bb00 con 0x7fdbc412afe0
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbc2a00700  1 -- 172.21.15.171:0/2236062254 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00be80 con 0x7fdbc412afe0
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 -- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc412afe0 msgr2=0x7fdbc412d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 --2- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc412afe0 0x7fdbc412d3d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdbbc009e90 tx=0x7fdbbc009780).stop
2024-03-29T08:54:30.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 -- 172.21.15.171:0/2236062254 shutdown_connections
2024-03-29T08:54:30.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 --2- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc412afe0 0x7fdbc412d3d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 --2- 172.21.15.171:0/2236062254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc4065030 0x7fdbc4065410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 -- 172.21.15.171:0/2236062254 >> 172.21.15.171:0/2236062254 conn(0x7fdbc4094870 msgr2=0x7fdbc4094c80 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 -- 172.21.15.171:0/2236062254 shutdown_connections
2024-03-29T08:54:30.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.151+0000 7fdbcaa00700  1 -- 172.21.15.171:0/2236062254 wait complete.
2024-03-29T08:54:30.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1  Processor -- start
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1 --  start start
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc4065030 0x7fdbc411a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc4065900 0x7fdbc411a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc412afe0 0x7fdbc411acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc411d150 con 0x7fdbc4065030
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc411d9c0 con 0x7fdbc412afe0
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.153+0000 7fdbcaa00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc411b350 con 0x7fdbc4065900
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc4065900 0x7fdbc411a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc4065030 0x7fdbc411a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc8a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc412afe0 0x7fdbc411acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc4065900 0x7fdbc411a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47772/0 (socket says 172.21.15.171:47772)
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 -- 172.21.15.171:0/315479369 learned_addr learned my addr 172.21.15.171:0/315479369 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:30.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc4065030 0x7fdbc411a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47048/0 (socket says 172.21.15.171:47048)
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 -- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc412afe0 msgr2=0x7fdbc411acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc412afe0 0x7fdbc411acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 -- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc4065030 msgr2=0x7fdbc411a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc4065030 0x7fdbc411a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 -- 172.21.15.171:0/315479369 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009250 con 0x7fdbc4065900
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc8a00700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc412afe0 0x7fdbc411acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3e00700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc4065030 0x7fdbc411a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbc3400700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc4065900 0x7fdbc411a7c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdbb000c510 tx=0x7fdbb0007bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbbbe00700  1 -- 172.21.15.171:0/315479369 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00070d0 con 0x7fdbc4065900
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbbbe00700  1 -- 172.21.15.171:0/315479369 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0007250 con 0x7fdbc4065900
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbbbe00700  1 -- 172.21.15.171:0/315479369 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0007610 con 0x7fdbc4065900
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.154+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc009a20 con 0x7fdbc4065900
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.155+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc411cdf0 con 0x7fdbc4065900
2024-03-29T08:54:30.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.156+0000 7fdbbbe00700  1 -- 172.21.15.171:0/315479369 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7fdbb0005bc0 con 0x7fdbc4065900
2024-03-29T08:54:30.161 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.156+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc411bb70 con 0x7fdbc4065900
2024-03-29T08:54:30.161 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.156+0000 7fdbbbe00700  1 -- 172.21.15.171:0/315479369 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fdbb00549c0 con 0x7fdbc4065900
2024-03-29T08:54:30.161 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.160+0000 7fdbbbe00700  1 -- 172.21.15.171:0/315479369 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7fdbb0035590 con 0x7fdbc4065900
2024-03-29T08:54:30.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.308+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbc4095390 con 0x7fdbc4065900
2024-03-29T08:54:30.308 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.309+0000 7fdbbbe00700  1 -- 172.21.15.171:0/315479369 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v11) v1 ==== 74+0+8150 (secure 0 0 0) 0x7fdbb0023ff0 con 0x7fdbc4065900
2024-03-29T08:54:30.309 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:30.309 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":11,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T08:54:29.535704+0000","last_up_change":"2024-03-29T08:54:27.513354+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-29T08:54:27.580138+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":39169}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":39169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":39169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":39169}]},"public_addr":"172.21.15.171:6800/39169","cluster_addr":"172.21.15.171:6801/39169","heartbeat_back_addr":"172.21.15.171:6803/39169","heartbeat_front_addr":"172.21.15.171:6802/39169","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":39170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":39170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":39170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":39170}]},"public_addr":"172.21.15.171:6804/39170","cluster_addr":"172.21.15.171:6805/39170","heartbeat_back_addr":"172.21.15.171:6807/39170","heartbeat_front_addr":"172.21.15.171:6806/39170","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":39179}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":39179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":39179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":39179}]},"public_addr":"172.21.15.171:6809/39179","cluster_addr":"172.21.15.171:6811/39179","heartbeat_back_addr":"172.21.15.171:6815/39179","heartbeat_front_addr":"172.21.15.171:6814/39179","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":39186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":39186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":39186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":39186}]},"public_addr":"172.21.15.171:6808/39186","cluster_addr":"172.21.15.171:6810/39186","heartbeat_back_addr":"172.21.15.171:6813/39186","heartbeat_front_addr":"172.21.15.171:6812/39186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 >> v1:172.21.15.171:6816/38531 conn(0x7fdba4041b80 legacy=0x7fdba4044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc4065900 msgr2=0x7fdbc411a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc4065900 0x7fdbc411a7c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdbb000c510 tx=0x7fdbb0007bf0).stop
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 shutdown_connections
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbc412afe0 0x7fdbc411acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc4065030 0x7fdbc411a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 --2- 172.21.15.171:0/315479369 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdbc4065900 0x7fdbc411a7c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 >> 172.21.15.171:0/315479369 conn(0x7fdbc4094870 msgr2=0x7fdbc40686b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 shutdown_connections
2024-03-29T08:54:30.311 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.311+0000 7fdbcaa00700  1 -- 172.21.15.171:0/315479369 wait complete.
2024-03-29T08:54:30.328 INFO:tasks.ceph.ceph_manager.ceph:all up!
2024-03-29T08:54:30.329 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T08:54:30.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.512+0000 7fe525800700  1  Processor -- start
2024-03-29T08:54:30.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.512+0000 7fe525800700  1 --  start start
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe525800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe520066a30 0x7fe520066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe525800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5200676e0 0x7fe520125c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe525800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe520063cb0 con 0x7fe520067300
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe525800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200694e0 con 0x7fe5200676e0
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe525800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe520068e70 con 0x7fe520066a30
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe51ea00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe520066a30 0x7fe520066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe51e000700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fe520067300 0x7fe520125530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60626/0 (socket says 172.21.15.171:60626)
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe51e000700  1 -- 172.21.15.171:0/3404032376 learned_addr learned my addr 172.21.15.171:0/3404032376 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.513+0000 7fe51f400700  1 --2- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5200676e0 0x7fe520125c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51ea00700  1 -- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5200676e0 msgr2=0x7fe520125c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:30.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51ea00700  1 --2- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5200676e0 0x7fe520125c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51d600700  1 -- 172.21.15.171:0/3404032376 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091054566 0 0) 0x7fe520063cb0 con 0x7fe520067300
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51ea00700  1 -- 172.21.15.171:0/3404032376 >> v1:172.21.15.171:6789/0 conn(0x7fe520067300 legacy=0x7fe520125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51ea00700  1 -- 172.21.15.171:0/3404032376 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520069bf0 con 0x7fe520066a30
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51f400700  1 --2- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5200676e0 0x7fe520125c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51ea00700  1 --2- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe520066a30 0x7fe520066e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe510009790 tx=0x7fe510006f40).ready entity=mon.2 client_cookie=adabd7a1230676df server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51d600700  1 -- 172.21.15.171:0/3404032376 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510005880 con 0x7fe520066a30
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51d600700  1 -- 172.21.15.171:0/3404032376 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5100059e0 con 0x7fe520066a30
2024-03-29T08:54:30.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.514+0000 7fe51d600700  1 -- 172.21.15.171:0/3404032376 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510005d60 con 0x7fe520066a30
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 -- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe520066a30 msgr2=0x7fe520066e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 --2- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe520066a30 0x7fe520066e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe510009790 tx=0x7fe510006f40).stop
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 -- 172.21.15.171:0/3404032376 shutdown_connections
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 --2- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe520066a30 0x7fe520066e10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 --2- 172.21.15.171:0/3404032376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5200676e0 0x7fe520125c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 -- 172.21.15.171:0/3404032376 >> 172.21.15.171:0/3404032376 conn(0x7fe5200992c0 msgr2=0x7fe520064c50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 -- 172.21.15.171:0/3404032376 shutdown_connections
2024-03-29T08:54:30.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.515+0000 7fe525800700  1 -- 172.21.15.171:0/3404032376 wait complete.
2024-03-29T08:54:30.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.517+0000 7fe525800700  1  Processor -- start
2024-03-29T08:54:30.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.517+0000 7fe525800700  1 --  start start
2024-03-29T08:54:30.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe525800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe520066a30 0x7fe520114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe525800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe520067300 0x7fe5201148f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe525800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe5200676e0 0x7fe520114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe525800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe520117ac0 con 0x7fe520067300
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe525800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe520117140 con 0x7fe520066a30
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe525800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe520117cf0 con 0x7fe5200676e0
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe51ea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe520066a30 0x7fe520114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe51ea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe520066a30 0x7fe520114400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53266/0 (socket says 172.21.15.171:53266)
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe51ea00700  1 -- 172.21.15.171:0/1971703418 learned_addr learned my addr 172.21.15.171:0/1971703418 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe51f400700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe5200676e0 0x7fe520114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe51e000700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe520067300 0x7fe5201148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe51ea00700  1 -- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe5200676e0 msgr2=0x7fe520114de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.518+0000 7fe51ea00700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe5200676e0 0x7fe520114de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe51ea00700  1 -- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe520067300 msgr2=0x7fe5201148f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe51ea00700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe520067300 0x7fe5201148f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe51ea00700  1 -- 172.21.15.171:0/1971703418 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009a20 con 0x7fe520066a30
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe51ea00700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe520066a30 0x7fe520114400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe520069a50 tx=0x7fe510015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe516a00700  1 -- 172.21.15.171:0/1971703418 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51000f510 con 0x7fe520066a30
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe516a00700  1 -- 172.21.15.171:0/1971703418 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51000f690 con 0x7fe520066a30
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe510009250 con 0x7fe520066a30
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe516a00700  1 -- 172.21.15.171:0/1971703418 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51000fa50 con 0x7fe520066a30
2024-03-29T08:54:30.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.519+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe520115f80 con 0x7fe520066a30
2024-03-29T08:54:30.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.520+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe520117420 con 0x7fe520066a30
2024-03-29T08:54:30.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.520+0000 7fe516a00700  1 -- 172.21.15.171:0/1971703418 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7fe51001d440 con 0x7fe520066a30
2024-03-29T08:54:30.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.521+0000 7fe516a00700  1 -- 172.21.15.171:0/1971703418 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe510056160 con 0x7fe520066a30
2024-03-29T08:54:30.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.525+0000 7fe516a00700  1 -- 172.21.15.171:0/1971703418 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7fe510029d70 con 0x7fe520066a30
2024-03-29T08:54:30.675 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.675+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe520066370 con 0x7fe520066a30
2024-03-29T08:54:30.675 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.676+0000 7fe516a00700  1 -- 172.21.15.171:0/1971703418 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v12) v1 ==== 74+0+8124 (secure 0 0 0) 0x7fe51002dfd0 con 0x7fe520066a30
2024-03-29T08:54:30.676 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:30.676 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":12,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T08:54:30.539782+0000","last_up_change":"2024-03-29T08:54:27.513354+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":39169}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":39169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":39169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":39169}]},"public_addr":"172.21.15.171:6800/39169","cluster_addr":"172.21.15.171:6801/39169","heartbeat_back_addr":"172.21.15.171:6803/39169","heartbeat_front_addr":"172.21.15.171:6802/39169","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":39170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":39170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":39170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":39170}]},"public_addr":"172.21.15.171:6804/39170","cluster_addr":"172.21.15.171:6805/39170","heartbeat_back_addr":"172.21.15.171:6807/39170","heartbeat_front_addr":"172.21.15.171:6806/39170","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":39179}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":39179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":39179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":39179}]},"public_addr":"172.21.15.171:6809/39179","cluster_addr":"172.21.15.171:6811/39179","heartbeat_back_addr":"172.21.15.171:6815/39179","heartbeat_front_addr":"172.21.15.171:6814/39179","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":39186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":39186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":39186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":39186}]},"public_addr":"172.21.15.171:6808/39186","cluster_addr":"172.21.15.171:6810/39186","heartbeat_back_addr":"172.21.15.171:6813/39186","heartbeat_front_addr":"172.21.15.171:6812/39186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 >> v1:172.21.15.171:6816/38531 conn(0x7fe500041b80 legacy=0x7fe500044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe520066a30 msgr2=0x7fe520114400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe520066a30 0x7fe520114400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe520069a50 tx=0x7fe510015000).stop
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 shutdown_connections
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe5200676e0 0x7fe520114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe520066a30 0x7fe520114400 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 --2- 172.21.15.171:0/1971703418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe520067300 0x7fe5201148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 >> 172.21.15.171:0/1971703418 conn(0x7fe5200992c0 msgr2=0x7fe520097e30 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 shutdown_connections
2024-03-29T08:54:30.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.678+0000 7fe525800700  1 -- 172.21.15.171:0/1971703418 wait complete.
2024-03-29T08:54:30.695 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats
2024-03-29T08:54:30.695 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats
2024-03-29T08:54:30.696 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats
2024-03-29T08:54:30.696 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats
2024-03-29T08:54:30.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.898+0000 7ff932000700  1  Processor -- start
2024-03-29T08:54:30.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.898+0000 7ff932000700  1 --  start start
2024-03-29T08:54:30.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.899+0000 7ff932000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c12a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.899+0000 7ff932000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c12d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff932000700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c069b40 con 0x7ff92c0664c0
2024-03-29T08:54:30.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff932000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c069550 con 0x7ff92c12aeb0
2024-03-29T08:54:30.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff932000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c068990 con 0x7ff92c1285d0
2024-03-29T08:54:30.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff92b400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7ff92c0664c0 0x7ff92c0668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60630/0 (socket says 172.21.15.171:60630)
2024-03-29T08:54:30.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff92b400700  1 -- 172.21.15.171:0/1405594276 learned_addr learned my addr 172.21.15.171:0/1405594276 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:30.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff92aa00700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c12a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff92be00700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c12d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.900+0000 7ff92a000700  1 -- 172.21.15.171:0/1405594276 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073563369 0 0) 0x7ff92c069b40 con 0x7ff92c0664c0
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92a000700  1 -- 172.21.15.171:0/1405594276 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9100033f0 con 0x7ff92c0664c0
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92be00700  1 -- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 msgr2=0x7ff92c12a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92be00700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c12a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92be00700  1 -- 172.21.15.171:0/1405594276 >> v1:172.21.15.171:6789/0 conn(0x7ff92c0664c0 legacy=0x7ff92c0668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92a000700  1 -- 172.21.15.171:0/1405594276 <== mon.0 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222121494 0 0) 0x7ff9100033f0 con 0x7ff92c0664c0
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92be00700  1 -- 172.21.15.171:0/1405594276 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c068430 con 0x7ff92c12aeb0
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92aa00700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c12a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92be00700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c12d2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff924009e90 tx=0x7ff924009780).ready entity=mon.1 client_cookie=c60be8aed785e993 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92a000700  1 -- 172.21.15.171:0/1405594276 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92400e070 con 0x7ff92c12aeb0
2024-03-29T08:54:30.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92a000700  1 -- 172.21.15.171:0/1405594276 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92400b7a0 con 0x7ff92c12aeb0
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.901+0000 7ff92a000700  1 -- 172.21.15.171:0/1405594276 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c004d60 con 0x7ff92c12aeb0
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 -- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 msgr2=0x7ff92c12d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c12d2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff924009e90 tx=0x7ff924009780).stop
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 -- 172.21.15.171:0/1405594276 shutdown_connections
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c12d2a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 --2- 172.21.15.171:0/1405594276 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c12a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 -- 172.21.15.171:0/1405594276 >> 172.21.15.171:0/1405594276 conn(0x7ff92c098a40 msgr2=0x7ff92c098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 -- 172.21.15.171:0/1405594276 shutdown_connections
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.902+0000 7ff932000700  1 -- 172.21.15.171:0/1405594276 wait complete.
2024-03-29T08:54:30.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.904+0000 7ff932000700  1  Processor -- start
2024-03-29T08:54:30.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.904+0000 7ff932000700  1 --  start start
2024-03-29T08:54:30.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.905+0000 7ff932000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff92c0664c0 0x7ff92c134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.905+0000 7ff932000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c134fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.905+0000 7ff932000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c125d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.905+0000 7ff932000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c110060 con 0x7ff92c0664c0
2024-03-29T08:54:30.905 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.905+0000 7ff932000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c1102b0 con 0x7ff92c12aeb0
2024-03-29T08:54:30.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.905+0000 7ff932000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c1278b0 con 0x7ff92c1285d0
2024-03-29T08:54:30.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff92c0664c0 0x7ff92c134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff92c0664c0 0x7ff92c134ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47054/0 (socket says 172.21.15.171:47054)
2024-03-29T08:54:30.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 -- 172.21.15.171:0/555860107 learned_addr learned my addr 172.21.15.171:0/555860107 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:30.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92aa00700  1 --2- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c134fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92be00700  1 --2- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 -- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 msgr2=0x7ff92c134fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 --2- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff92c1285d0 0x7ff92c134fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 -- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 msgr2=0x7ff92c125d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 --2- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff92c12aeb0 0x7ff92c125d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.906+0000 7ff92b400700  1 -- 172.21.15.171:0/555860107 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180092a0 con 0x7ff92c0664c0
2024-03-29T08:54:30.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.907+0000 7ff92b400700  1 --2- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff92c0664c0 0x7ff92c134ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff91c00cbe0 tx=0x7ff91c00a3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.907+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c007b30 con 0x7ff92c0664c0
2024-03-29T08:54:30.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.907+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c007c90 con 0x7ff92c0664c0
2024-03-29T08:54:30.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.907+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c015670 con 0x7ff92c0664c0
2024-03-29T08:54:30.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.907+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924009a20 con 0x7ff92c0664c0
2024-03-29T08:54:30.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.907+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c135660 con 0x7ff92c0664c0
2024-03-29T08:54:30.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.908+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff92c065c60 con 0x7ff92c0664c0
2024-03-29T08:54:30.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.909+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7ff91c015a60 con 0x7ff92c0664c0
2024-03-29T08:54:30.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.910+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7ff91c055910 con 0x7ff92c0664c0
2024-03-29T08:54:30.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.910+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 --> v1:172.21.15.171:6800/39169 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff90c04c020 con 0x7ff90c048330
2024-03-29T08:54:30.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.910+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff91c05a220 con 0x7ff92c0664c0
2024-03-29T08:54:30.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.912+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== osd.0 v1:172.21.15.171:6800/39169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7ff90c04c020 con 0x7ff90c048330
2024-03-29T08:54:30.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.919+0000 7f960b200700  1  Processor -- start
2024-03-29T08:54:30.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.920+0000 7f960b200700  1 --  start start
2024-03-29T08:54:30.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.920+0000 7f960b200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f96040664c0 0x7f96040668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.920+0000 7f960b200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96041259c0 0x7f960412d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.920+0000 7f960b200700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9604069b40 con 0x7f9604066d90
2024-03-29T08:54:30.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.920+0000 7f960b200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9604069550 con 0x7f96040664c0
2024-03-29T08:54:30.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.920+0000 7f960b200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604068990 con 0x7f96041259c0
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9603400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f9604066d90 0x7f96041252b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60640/0 (socket says 172.21.15.171:60640)
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9609200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96041259c0 0x7f960412d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9603400700  1 -- 172.21.15.171:0/3722570093 learned_addr learned my addr 172.21.15.171:0/3722570093 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9603e00700  1 --2- 172.21.15.171:0/3722570093 >> v2:172.21.15.171:3300/0 conn(0x7f96040664c0 0x7f96040668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9609200700  1 -- 172.21.15.171:0/3722570093 >> v2:172.21.15.171:3300/0 conn(0x7f96040664c0 msgr2=0x7f96040668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9609200700  1 --2- 172.21.15.171:0/3722570093 >> v2:172.21.15.171:3300/0 conn(0x7f96040664c0 0x7f96040668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9609200700  1 -- 172.21.15.171:0/3722570093 >> v1:172.21.15.171:6789/0 conn(0x7f9604066d90 legacy=0x7f96041252b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9609200700  1 -- 172.21.15.171:0/3722570093 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604068430 con 0x7f96041259c0
2024-03-29T08:54:30.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.921+0000 7f9602a00700  1 -- 172.21.15.171:0/3722570093 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894593060 0 0) 0x7f9604069b40 con 0x7f9604066d90
2024-03-29T08:54:30.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.922+0000 7f9609200700  1 --2- 172.21.15.171:0/3722570093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96041259c0 0x7f960412d600 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f95fc009e60 tx=0x7f95fc009780).ready entity=mon.1 client_cookie=cffe9e23ea89883f server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.922+0000 7f9602a00700  1 -- 172.21.15.171:0/3722570093 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00e070 con 0x7f96041259c0
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.922+0000 7f9602a00700  1 -- 172.21.15.171:0/3722570093 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00bb60 con 0x7f96041259c0
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.922+0000 7f9602a00700  1 -- 172.21.15.171:0/3722570093 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc012410 con 0x7f96041259c0
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.922+0000 7f960b200700  1 -- 172.21.15.171:0/3722570093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96041259c0 msgr2=0x7f960412d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.922+0000 7f960b200700  1 --2- 172.21.15.171:0/3722570093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96041259c0 0x7f960412d600 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f95fc009e60 tx=0x7f95fc009780).stop
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.923+0000 7f960b200700  1 -- 172.21.15.171:0/3722570093 shutdown_connections
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.923+0000 7f960b200700  1 --2- 172.21.15.171:0/3722570093 >> v2:172.21.15.171:3300/0 conn(0x7f96040664c0 0x7f96040668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.923+0000 7f960b200700  1 --2- 172.21.15.171:0/3722570093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96041259c0 0x7f960412d600 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.923+0000 7f960b200700  1 -- 172.21.15.171:0/3722570093 >> 172.21.15.171:0/3722570093 conn(0x7f9604098a40 msgr2=0x7f9604098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.923+0000 7f960b200700  1 -- 172.21.15.171:0/3722570093 shutdown_connections
2024-03-29T08:54:30.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.923+0000 7f960b200700  1 -- 172.21.15.171:0/3722570093 wait complete.
2024-03-29T08:54:30.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.924+0000 7f960b200700  1  Processor -- start
2024-03-29T08:54:30.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.924+0000 7f960b200700  1 --  start start
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f960b200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96040664c0 0x7f9604110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f960b200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9604066d90 0x7f9604111330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f960b200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96041259c0 0x7f9604111820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f960b200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96041120c0 con 0x7f96041259c0
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f960b200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604114570 con 0x7f9604066d90
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f960b200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f960411f980 con 0x7f96040664c0
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f9603e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96040664c0 0x7f9604110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f9603e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96040664c0 0x7f9604110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47814/0 (socket says 172.21.15.171:47814)
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f9603e00700  1 -- 172.21.15.171:0/7836513 learned_addr learned my addr 172.21.15.171:0/7836513 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f9603400700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9604066d90 0x7f9604111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.925+0000 7f9609200700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96041259c0 0x7f9604111820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9609200700  1 -- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96040664c0 msgr2=0x7f9604110e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9609200700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96040664c0 0x7f9604110e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9609200700  1 -- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9604066d90 msgr2=0x7f9604111330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9609200700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9604066d90 0x7f9604111330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9609200700  1 -- 172.21.15.171:0/7836513 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc009a20 con 0x7f96041259c0
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9603e00700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96040664c0 0x7f9604110e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9603400700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9604066d90 0x7f9604111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.926+0000 7f9609200700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96041259c0 0x7f9604111820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f95fc014000 tx=0x7f9604099630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.927+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc012410 con 0x7f96041259c0
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.927+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc01d630 con 0x7f96041259c0
2024-03-29T08:54:30.927 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.927+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9604112900 con 0x7f96041259c0
2024-03-29T08:54:30.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.927+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc01d9b0 con 0x7f96041259c0
2024-03-29T08:54:30.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.927+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9604134840 con 0x7f96041259c0
2024-03-29T08:54:30.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.928+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9604111d10 con 0x7f96041259c0
2024-03-29T08:54:30.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.929+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f95fc01dd20 con 0x7f96041259c0
2024-03-29T08:54:30.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.929+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f95fc056ea0 con 0x7f96041259c0
2024-03-29T08:54:30.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.930+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 --> v1:172.21.15.171:6808/39186 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95e404bfa0 con 0x7f95e40482b0
2024-03-29T08:54:30.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.930+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95fc0594c0 con 0x7f96041259c0
2024-03-29T08:54:30.930 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.931+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 --> v1:172.21.15.171:6800/39169 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff92c10f9e0 con 0x7ff90c048330
2024-03-29T08:54:30.931 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.931+0000 7ff923400700  1 -- 172.21.15.171:0/555860107 <== osd.0 v1:172.21.15.171:6800/39169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7ff92c10f9e0 con 0x7ff90c048330
2024-03-29T08:54:30.931 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== osd.3 v1:172.21.15.171:6808/39186 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f95e404bfa0 con 0x7f95e40482b0
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 >> v1:172.21.15.171:6800/39169 conn(0x7ff90c048330 legacy=0x7ff90c04a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 >> v1:172.21.15.171:6816/38531 conn(0x7ff90c041b80 legacy=0x7ff90c044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff92c0664c0 msgr2=0x7ff92c134ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7ff932000700  1 --2- 172.21.15.171:0/555860107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff92c0664c0 0x7ff92c134ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff91c00cbe0 tx=0x7ff91c00a3b0).stop
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7ff92be00700  1 -- 172.21.15.171:0/555860107 reap_dead start
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 shutdown_connections
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.932+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 >> 172.21.15.171:0/555860107 conn(0x7ff92c098a40 msgr2=0x7ff92c096440 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.933+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 shutdown_connections
2024-03-29T08:54:30.932 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.933+0000 7ff932000700  1 -- 172.21.15.171:0/555860107 wait complete.
2024-03-29T08:54:30.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.947+0000 7f8c60c00700  1  Processor -- start
2024-03-29T08:54:30.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.947+0000 7f8c60c00700  1 --  start start
2024-03-29T08:54:30.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.948+0000 7f8c60c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c05e230 0x7f8c5c08c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.948+0000 7f16ac400700  1  Processor -- start
2024-03-29T08:54:30.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.948+0000 7f8c60c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f8c5c08cb60 0x7f8c5c12d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.948+0000 7f8c60c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c08d3e0 con 0x7f8c5c08c720
2024-03-29T08:54:30.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.948+0000 7f8c60c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5c08bed0 con 0x7f8c5c08cb60
2024-03-29T08:54:30.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.948+0000 7f8c60c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c08dcb0 con 0x7f8c5c05e230
2024-03-29T08:54:30.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.948+0000 7f16ac400700  1 --  start start
2024-03-29T08:54:30.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c59400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f8c5c08c720 0x7f8c5c129e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60646/0 (socket says 172.21.15.171:60646)
2024-03-29T08:54:30.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c59400700  1 -- 172.21.15.171:0/1923005498 learned_addr learned my addr 172.21.15.171:0/1923005498 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c5a800700  1 --2- 172.21.15.171:0/1923005498 >> v2:172.21.15.171:3300/0 conn(0x7f8c5c08cb60 0x7f8c5c12d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c58a00700  1 -- 172.21.15.171:0/1923005498 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774957704 0 0) 0x7f8c5c08d3e0 con 0x7f8c5c08c720
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c58a00700  1 -- 172.21.15.171:0/1923005498 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c400033f0 con 0x7f8c5c08c720
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c5a800700  1 -- 172.21.15.171:0/1923005498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c05e230 msgr2=0x7f8c5c08c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c5a800700  1 --2- 172.21.15.171:0/1923005498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c05e230 0x7f8c5c08c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c5a800700  1 -- 172.21.15.171:0/1923005498 >> v1:172.21.15.171:6789/0 conn(0x7f8c5c08c720 legacy=0x7f8c5c129e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.949+0000 7f8c5a800700  1 -- 172.21.15.171:0/1923005498 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c08baf0 con 0x7f8c5c08cb60
2024-03-29T08:54:30.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f8c5a800700  1 --2- 172.21.15.171:0/1923005498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08cb60 0x7f8c5c12d560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8c54009e90 tx=0x7f8c54009780).ready entity=mon.0 client_cookie=70dc76e4f0934935 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16ac400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40664c0 0x7f16a40668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16ac400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f16a41259c0 0x7f16a412d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16ac400700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a4069b40 con 0x7f16a4066d90
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16ac400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a4069550 con 0x7f16a41259c0
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16ac400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4068990 con 0x7f16a40664c0
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16aa400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f16a41259c0 0x7f16a412d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16aa400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f16a41259c0 0x7f16a412d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47100/0 (socket says 172.21.15.171:47100)
2024-03-29T08:54:30.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16aa400700  1 -- 172.21.15.171:0/1023234898 learned_addr learned my addr 172.21.15.171:0/1023234898 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:30.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f8c58a00700  1 -- 172.21.15.171:0/1923005498 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400e070 con 0x7f8c5c08cb60
2024-03-29T08:54:30.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f8c58a00700  1 -- 172.21.15.171:0/1923005498 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5400bb20 con 0x7f8c5c08cb60
2024-03-29T08:54:30.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f8c58a00700  1 -- 172.21.15.171:0/1923005498 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400bea0 con 0x7f8c5c08cb60
2024-03-29T08:54:30.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16aa400700  1 -- 172.21.15.171:0/1023234898 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40664c0 msgr2=0x7f16a40668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:30.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16aa400700  1 --2- 172.21.15.171:0/1023234898 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40664c0 0x7f16a40668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop
2024-03-29T08:54:30.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.950+0000 7f16aa400700  1 -- 172.21.15.171:0/1023234898 >> v1:172.21.15.171:6789/0 conn(0x7f16a4066d90 legacy=0x7f16a41252b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T08:54:30.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f16aa400700  1 -- 172.21.15.171:0/1023234898 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a4068430 con 0x7f16a41259c0
2024-03-29T08:54:30.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 -- 172.21.15.171:0/1923005498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08cb60 msgr2=0x7f8c5c12d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 --2- 172.21.15.171:0/1923005498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08cb60 0x7f8c5c12d560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8c54009e90 tx=0x7f8c54009780).stop
2024-03-29T08:54:30.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f16aa400700  1 --2- 172.21.15.171:0/1023234898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a41259c0 0x7f16a412d600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f169c006fd0 tx=0x7f169c0090f0).ready entity=mon.0 client_cookie=e421a6ff2a71d7 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 -- 172.21.15.171:0/1923005498 shutdown_connections
2024-03-29T08:54:30.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 --2- 172.21.15.171:0/1923005498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08cb60 0x7f8c5c12d560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 --2- 172.21.15.171:0/1923005498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c05e230 0x7f8c5c08c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop
2024-03-29T08:54:30.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 -- 172.21.15.171:0/1923005498 >> 172.21.15.171:0/1923005498 conn(0x7f8c5c091b80 msgr2=0x7f8c5c091f90 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 -- 172.21.15.171:0/1923005498 shutdown_connections
2024-03-29T08:54:30.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f8c60c00700  1 -- 172.21.15.171:0/1923005498 wait complete.
2024-03-29T08:54:30.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f16a3e00700  1 -- 172.21.15.171:0/1023234898 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00b600 con 0x7f16a41259c0
2024-03-29T08:54:30.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f16a3e00700  1 -- 172.21.15.171:0/1023234898 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00b760 con 0x7f16a41259c0
2024-03-29T08:54:30.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.951+0000 7f16a3e00700  1 -- 172.21.15.171:0/1023234898 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00bae0 con 0x7f16a41259c0
2024-03-29T08:54:30.957 INFO:teuthology.orchestra.run.smithi171.stdout:38654705666
2024-03-29T08:54:30.958 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T08:54:30.958 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.952+0000 7f16ac400700  1 -- 172.21.15.171:0/1023234898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a41259c0 msgr2=0x7f16a412d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.952+0000 7f16ac400700  1 --2- 172.21.15.171:0/1023234898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a41259c0 0x7f16a412d600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f169c006fd0 tx=0x7f169c0090f0).stop
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f16ac400700  1 -- 172.21.15.171:0/1023234898 shutdown_connections
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f16ac400700  1 --2- 172.21.15.171:0/1023234898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a41259c0 0x7f16a412d600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f16ac400700  1 --2- 172.21.15.171:0/1023234898 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40664c0 0x7f16a40668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f16ac400700  1 -- 172.21.15.171:0/1023234898 >> 172.21.15.171:0/1023234898 conn(0x7f16a4098a40 msgr2=0x7f16a4098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f16ac400700  1 -- 172.21.15.171:0/1023234898 shutdown_connections
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f8c60c00700  1  Processor -- start
2024-03-29T08:54:30.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f16ac400700  1 -- 172.21.15.171:0/1023234898 wait complete.
2024-03-29T08:54:30.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.953+0000 7f8c60c00700  1 --  start start
2024-03-29T08:54:30.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 --> v1:172.21.15.171:6808/39186 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9604065c60 con 0x7f95e40482b0
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c60c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f8c5c05e230 0x7f8c5c11d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c60c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08c720 0x7f8c5c134d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c60c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c08cb60 0x7f8c5c135260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c60c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c11bc50 con 0x7f8c5c08c720
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c60c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c11df30 con 0x7f8c5c08cb60
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c60c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c11e0a0 con 0x7f8c5c05e230
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c59400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08c720 0x7f8c5c134d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c59400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08c720 0x7f8c5c134d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47108/0 (socket says 172.21.15.171:47108)
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c59400700  1 -- 172.21.15.171:0/3945857528 learned_addr learned my addr 172.21.15.171:0/3945857528 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c59e00700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f8c5c05e230 0x7f8c5c11d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f8c5a800700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c08cb60 0x7f8c5c135260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f16ac400700  1  Processor -- start
2024-03-29T08:54:30.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c59400700  1 -- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f8c5c05e230 msgr2=0x7f8c5c11d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c59400700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f8c5c05e230 0x7f8c5c11d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c59400700  1 -- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c08cb60 msgr2=0x7f8c5c135260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.954+0000 7f95fbe00700  1 -- 172.21.15.171:0/7836513 <== osd.3 v1:172.21.15.171:6808/39186 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7f9604065c60 con 0x7f95e40482b0
2024-03-29T08:54:30.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 >> v1:172.21.15.171:6808/39186 conn(0x7f95e40482b0 legacy=0x7f95e404a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f16ac400700  1 --  start start
2024-03-29T08:54:30.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c59400700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c08cb60 0x7f8c5c135260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c59400700  1 -- 172.21.15.171:0/3945857528 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c54009a20 con 0x7f8c5c08c720
2024-03-29T08:54:30.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c59e00700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f8c5c05e230 0x7f8c5c11d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:30.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c5a800700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c08cb60 0x7f8c5c135260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:30.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 >> v1:172.21.15.171:6816/38531 conn(0x7f95e4041b80 legacy=0x7f95e4044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96041259c0 msgr2=0x7f9604111820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f960b200700  1 --2- 172.21.15.171:0/7836513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96041259c0 0x7f9604111820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f95fc014000 tx=0x7f9604099630).stop
2024-03-29T08:54:30.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f8c59400700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08c720 0x7f8c5c134d70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8c4800c4c0 tx=0x7f8c48007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f9609200700  1 -- 172.21.15.171:0/7836513 reap_dead start
2024-03-29T08:54:30.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 shutdown_connections
2024-03-29T08:54:30.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.955+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 >> 172.21.15.171:0/7836513 conn(0x7f9604098a40 msgr2=0x7f96041282c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16ac400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40664c0 0x7f16a4117c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16ac400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f16a4066d90 0x7f16a4118110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16ac400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a41259c0 0x7f16a4118600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:30.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16ac400700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a411f150 con 0x7f16a40664c0
2024-03-29T08:54:30.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16ac400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a411b0a0 con 0x7f16a41259c0
2024-03-29T08:54:30.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16ac400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a411b470 con 0x7f16a4066d90
2024-03-29T08:54:30.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 shutdown_connections
2024-03-29T08:54:30.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480072e0 con 0x7f8c5c08c720
2024-03-29T08:54:30.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48007440 con 0x7f8c5c08c720
2024-03-29T08:54:30.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480057a0 con 0x7f8c5c08c720
2024-03-29T08:54:30.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f960b200700  1 -- 172.21.15.171:0/7836513 wait complete.
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16a9a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40664c0 0x7f16a4117c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16a9a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40664c0 0x7f16a4117c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47122/0 (socket says 172.21.15.171:47122)
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16a9a00700  1 -- 172.21.15.171:0/2113218535 learned_addr learned my addr 172.21.15.171:0/2113218535 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16aa400700  1 --2- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a41259c0 0x7f16a4118600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.956+0000 7f16a9000700  1 --2- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f16a4066d90 0x7f16a4118110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16a9a00700  1 -- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f16a4066d90 msgr2=0x7f16a4118110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16a9a00700  1 --2- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f16a4066d90 0x7f16a4118110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16a9a00700  1 -- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a41259c0 msgr2=0x7f16a4118600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c135810 con 0x7f8c5c08c720
2024-03-29T08:54:30.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c11aa10 con 0x7f8c5c08c720
2024-03-29T08:54:30.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16a9a00700  1 --2- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a41259c0 0x7f16a4118600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:30.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16a9a00700  1 -- 172.21.15.171:0/2113218535 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c009370 con 0x7f16a40664c0
2024-03-29T08:54:30.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16aa400700  1 --2- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a41259c0 0x7f16a4118600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:30.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16a9a00700  1 --2- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40664c0 0x7f16a4117c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f169400bc30 tx=0x7f1694009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:30.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400c6f0 con 0x7f16a40664c0
2024-03-29T08:54:30.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.957+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a41197f0 con 0x7f16a40664c0
2024-03-29T08:54:30.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.958+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a4118af0 con 0x7f16a40664c0
2024-03-29T08:54:30.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.958+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c5c0906b0 con 0x7f8c5c08c720
2024-03-29T08:54:30.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.958+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694010070 con 0x7f16a40664c0
2024-03-29T08:54:30.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.958+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400c850 con 0x7f16a40664c0
2024-03-29T08:54:30.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.959+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f167c000fc0 con 0x7f16a40664c0
2024-03-29T08:54:30.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.959+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f169400c9b0 con 0x7f16a40664c0
2024-03-29T08:54:30.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.959+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f8c48005bd0 con 0x7f8c5c08c720
2024-03-29T08:54:30.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.960+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f8c480552d0 con 0x7f8c5c08c720
2024-03-29T08:54:30.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.960+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f16940548b0 con 0x7f16a40664c0
2024-03-29T08:54:30.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.960+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 --> v1:172.21.15.171:6804/39170 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c3c04c070 con 0x7f8c3c048380
2024-03-29T08:54:30.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.960+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c480555c0 con 0x7f8c5c08c720
2024-03-29T08:54:30.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.960+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 --> v1:172.21.15.171:6809/39179 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f168404bfa0 con 0x7f16840482b0
2024-03-29T08:54:30.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.960+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1694059220 con 0x7f16a40664c0
2024-03-29T08:54:30.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.962+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== osd.1 v1:172.21.15.171:6804/39170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f8c3c04c070 con 0x7f8c3c048380
2024-03-29T08:54:30.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.962+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== osd.2 v1:172.21.15.171:6809/39179 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f168404bfa0 con 0x7f16840482b0
2024-03-29T08:54:30.977 INFO:teuthology.orchestra.run.smithi171.stdout:38654705666
2024-03-29T08:54:30.978 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T08:54:30.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.977+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 --> v1:172.21.15.171:6804/39170 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c5c08aa60 con 0x7f8c3c048380
2024-03-29T08:54:30.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.977+0000 7f8c52000700  1 -- 172.21.15.171:0/3945857528 <== osd.1 v1:172.21.15.171:6804/39170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2217796425) 0x7f8c5c08aa60 con 0x7f8c3c048380
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.978+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 >> v1:172.21.15.171:6804/39170 conn(0x7f8c3c048380 legacy=0x7f8c3c04a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.978+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 >> v1:172.21.15.171:6816/38531 conn(0x7f8c3c041bd0 legacy=0x7f8c3c044090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.978+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08c720 msgr2=0x7f8c5c134d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.978+0000 7f8c60c00700  1 --2- 172.21.15.171:0/3945857528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c08c720 0x7f8c5c134d70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8c4800c4c0 tx=0x7f8c48007c50).stop
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.978+0000 7f8c5a800700  1 -- 172.21.15.171:0/3945857528 reap_dead start
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.978+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 shutdown_connections
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.978+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 >> 172.21.15.171:0/3945857528 conn(0x7f8c5c091b80 msgr2=0x7f8c5c089a40 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.979+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 shutdown_connections
2024-03-29T08:54:30.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.979+0000 7f8c60c00700  1 -- 172.21.15.171:0/3945857528 wait complete.
2024-03-29T08:54:30.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.979+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 --> v1:172.21.15.171:6809/39179 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f167c002b10 con 0x7f16840482b0
2024-03-29T08:54:30.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.980+0000 7f16a1600700  1 -- 172.21.15.171:0/2113218535 <== osd.2 v1:172.21.15.171:6809/39179 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7f167c002b10 con 0x7f16840482b0
2024-03-29T08:54:30.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.980+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 >> v1:172.21.15.171:6809/39179 conn(0x7f16840482b0 legacy=0x7f168404a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.980+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 >> v1:172.21.15.171:6816/38531 conn(0x7f1684041b80 legacy=0x7f1684044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.980+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40664c0 msgr2=0x7f16a4117c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:30.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.980+0000 7f16ac400700  1 --2- 172.21.15.171:0/2113218535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40664c0 0x7f16a4117c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f169400bc30 tx=0x7f1694009840).stop
2024-03-29T08:54:30.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.980+0000 7f16aa400700  1 -- 172.21.15.171:0/2113218535 reap_dead start
2024-03-29T08:54:30.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.981+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 shutdown_connections
2024-03-29T08:54:30.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.981+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 >> 172.21.15.171:0/2113218535 conn(0x7f16a4098a40 msgr2=0x7f16a4096490 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:30.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.981+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 shutdown_connections
2024-03-29T08:54:30.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:30.981+0000 7f16ac400700  1 -- 172.21.15.171:0/2113218535 wait complete.
2024-03-29T08:54:30.999 INFO:teuthology.orchestra.run.smithi171.stdout:38654705667
2024-03-29T08:54:30.999 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T08:54:31.001 INFO:teuthology.orchestra.run.smithi171.stdout:38654705666
2024-03-29T08:54:31.001 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T08:54:31.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.174+0000 7f964e200700  1  Processor -- start
2024-03-29T08:54:31.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.175+0000 7f964e200700  1 --  start start
2024-03-29T08:54:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.175+0000 7f964e200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f96481285d0 0x7f964812a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.175+0000 7f964e200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964812d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.175+0000 7f964e200700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9648069b40 con 0x7f96480664c0
2024-03-29T08:54:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.175+0000 7f964e200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9648069550 con 0x7f96481285d0
2024-03-29T08:54:31.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.175+0000 7f964e200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9648068990 con 0x7f964812aeb0
2024-03-29T08:54:31.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.176+0000 7f9647400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f96480664c0 0x7f96480668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60650/0 (socket says 172.21.15.171:60650)
2024-03-29T08:54:31.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.176+0000 7f9647e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964812d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.176+0000 7f9647400700  1 -- 172.21.15.171:0/1753169358 learned_addr learned my addr 172.21.15.171:0/1753169358 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:31.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.176+0000 7f9646a00700  1 --2- 172.21.15.171:0/1753169358 >> v2:172.21.15.171:3300/0 conn(0x7f96481285d0 0x7f964812a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.176+0000 7f9647e00700  1 -- 172.21.15.171:0/1753169358 >> v2:172.21.15.171:3300/0 conn(0x7f96481285d0 msgr2=0x7f964812a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:31.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.176+0000 7f9647e00700  1 --2- 172.21.15.171:0/1753169358 >> v2:172.21.15.171:3300/0 conn(0x7f96481285d0 0x7f964812a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.176+0000 7f9647e00700  1 -- 172.21.15.171:0/1753169358 >> v1:172.21.15.171:6789/0 conn(0x7f96480664c0 legacy=0x7f96480668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.177+0000 7f9647e00700  1 -- 172.21.15.171:0/1753169358 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648068430 con 0x7f964812aeb0
2024-03-29T08:54:31.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.177+0000 7f9647e00700  1 --2- 172.21.15.171:0/1753169358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964812d2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9640009e60 tx=0x7f9640009780).ready entity=mon.1 client_cookie=4859ed246e598add server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.177+0000 7f9646000700  1 -- 172.21.15.171:0/1753169358 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000e070 con 0x7f964812aeb0
2024-03-29T08:54:31.178 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.177+0000 7f9646000700  1 -- 172.21.15.171:0/1753169358 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000bb60 con 0x7f964812aeb0
2024-03-29T08:54:31.178 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.177+0000 7f9646000700  1 -- 172.21.15.171:0/1753169358 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640012410 con 0x7f964812aeb0
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 -- 172.21.15.171:0/1753169358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 msgr2=0x7f964812d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 --2- 172.21.15.171:0/1753169358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964812d2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9640009e60 tx=0x7f9640009780).stop
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 -- 172.21.15.171:0/1753169358 shutdown_connections
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 --2- 172.21.15.171:0/1753169358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964812d2a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 --2- 172.21.15.171:0/1753169358 >> v2:172.21.15.171:3300/0 conn(0x7f96481285d0 0x7f964812a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 -- 172.21.15.171:0/1753169358 >> 172.21.15.171:0/1753169358 conn(0x7f9648098a40 msgr2=0x7f9648098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 -- 172.21.15.171:0/1753169358 shutdown_connections
2024-03-29T08:54:31.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.178+0000 7f964e200700  1 -- 172.21.15.171:0/1753169358 wait complete.
2024-03-29T08:54:31.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.180+0000 7f964e200700  1  Processor -- start
2024-03-29T08:54:31.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.180+0000 7f964e200700  1 --  start start
2024-03-29T08:54:31.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.181+0000 7f964e200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96480664c0 0x7f964810f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.181+0000 7f964e200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96481285d0 0x7f964810f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.181+0000 7f964e200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.181+0000 7f964e200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648112680 con 0x7f96481285d0
2024-03-29T08:54:31.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.181+0000 7f964e200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9648112a50 con 0x7f964812aeb0
2024-03-29T08:54:31.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.181+0000 7f964e200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f964811f980 con 0x7f96480664c0
2024-03-29T08:54:31.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96481285d0 0x7f964810f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96481285d0 0x7f964810f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47146/0 (socket says 172.21.15.171:47146)
2024-03-29T08:54:31.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 -- 172.21.15.171:0/697529109 learned_addr learned my addr 172.21.15.171:0/697529109 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:31.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9647400700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96480664c0 0x7f964810f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9647e00700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 -- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96480664c0 msgr2=0x7f964810f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96480664c0 0x7f964810f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 -- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 msgr2=0x7f964810fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964810fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 -- 172.21.15.171:0/697529109 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640009a20 con 0x7f96481285d0
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9647400700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96480664c0 0x7f964810f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.182+0000 7f9646a00700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96481285d0 0x7f964810f650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f963400e900 tx=0x7f9634009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.183+0000 7f963f400700  1 -- 172.21.15.171:0/697529109 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400c670 con 0x7f96481285d0
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.183+0000 7f963f400700  1 -- 172.21.15.171:0/697529109 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963400c7d0 con 0x7f96481285d0
2024-03-29T08:54:31.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.183+0000 7f963f400700  1 -- 172.21.15.171:0/697529109 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400cb50 con 0x7f96481285d0
2024-03-29T08:54:31.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.183+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9648111ea0 con 0x7f96481285d0
2024-03-29T08:54:31.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.184+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9648110030 con 0x7f96481285d0
2024-03-29T08:54:31.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.185+0000 7f963f400700  1 -- 172.21.15.171:0/697529109 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f963401b400 con 0x7f96481285d0
2024-03-29T08:54:31.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.185+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9648065c60 con 0x7f96481285d0
2024-03-29T08:54:31.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.186+0000 7f963f400700  1 -- 172.21.15.171:0/697529109 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f9634058d70 con 0x7f96481285d0
2024-03-29T08:54:31.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.190+0000 7f963f400700  1 -- 172.21.15.171:0/697529109 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f96340352b0 con 0x7f96481285d0
2024-03-29T08:54:31.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.193+0000 7f3bcf800700  1  Processor -- start
2024-03-29T08:54:31.193 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.193+0000 7f3bcf800700  1 --  start start
2024-03-29T08:54:31.194 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcf800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc80668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.194 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcf800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f3bc8066d90 0x7f3bc81252b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.194 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcf800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc8069b40 con 0x7f3bc81257a0
2024-03-29T08:54:31.194 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcf800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc8069550 con 0x7f3bc8066d90
2024-03-29T08:54:31.194 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcf800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8068990 con 0x7f3bc80664c0
2024-03-29T08:54:31.194 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcce00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc80668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.194 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcd800700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f3bc81257a0 0x7f3bc812c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60666/0 (socket says 172.21.15.171:60666)
2024-03-29T08:54:31.195 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bcd800700  1 -- 172.21.15.171:0/4137367524 learned_addr learned my addr 172.21.15.171:0/4137367524 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:31.196 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.194+0000 7f3bc7e00700  1 --2- 172.21.15.171:0/4137367524 >> v2:172.21.15.171:3300/0 conn(0x7f3bc8066d90 0x7f3bc81252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bc7400700  1 -- 172.21.15.171:0/4137367524 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779941839 0 0) 0x7f3bc8069b40 con 0x7f3bc81257a0
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bc7400700  1 -- 172.21.15.171:0/4137367524 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb00033f0 con 0x7f3bc81257a0
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bcce00700  1 -- 172.21.15.171:0/4137367524 >> v2:172.21.15.171:3300/0 conn(0x7f3bc8066d90 msgr2=0x7f3bc81252b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bcce00700  1 --2- 172.21.15.171:0/4137367524 >> v2:172.21.15.171:3300/0 conn(0x7f3bc8066d90 0x7f3bc81252b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bcce00700  1 -- 172.21.15.171:0/4137367524 >> v1:172.21.15.171:6789/0 conn(0x7f3bc81257a0 legacy=0x7f3bc812c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bcce00700  1 -- 172.21.15.171:0/4137367524 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8068430 con 0x7f3bc80664c0
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bc7e00700  1 --2- 172.21.15.171:0/4137367524 >> v2:172.21.15.171:3300/0 conn(0x7f3bc8066d90 0x7f3bc81252b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed!
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.195+0000 7f3bcce00700  1 --2- 172.21.15.171:0/4137367524 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc80668a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3bbc006fd0 tx=0x7f3bbc006f40).ready entity=mon.2 client_cookie=87a29b446a7745f9 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.196+0000 7f3bc7400700  1 -- 172.21.15.171:0/4137367524 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc005880 con 0x7f3bc80664c0
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.196+0000 7f3bc7400700  1 -- 172.21.15.171:0/4137367524 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc0059e0 con 0x7f3bc80664c0
2024-03-29T08:54:31.197 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.196+0000 7f3bc7400700  1 -- 172.21.15.171:0/4137367524 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc005d60 con 0x7f3bc80664c0
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 -- 172.21.15.171:0/4137367524 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 msgr2=0x7f3bc80668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 --2- 172.21.15.171:0/4137367524 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc80668a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3bbc006fd0 tx=0x7f3bbc006f40).stop
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 -- 172.21.15.171:0/4137367524 shutdown_connections
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 --2- 172.21.15.171:0/4137367524 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc80668a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 --2- 172.21.15.171:0/4137367524 >> v2:172.21.15.171:3300/0 conn(0x7f3bc8066d90 0x7f3bc81252b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 -- 172.21.15.171:0/4137367524 >> 172.21.15.171:0/4137367524 conn(0x7f3bc8098a40 msgr2=0x7f3bc8098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 -- 172.21.15.171:0/4137367524 shutdown_connections
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.197+0000 7f3bcf800700  1 -- 172.21.15.171:0/4137367524 wait complete.
2024-03-29T08:54:31.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.199+0000 7f3bcf800700  1  Processor -- start
2024-03-29T08:54:31.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.199+0000 7f3bcf800700  1 --  start start
2024-03-29T08:54:31.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.200+0000 7f3bcf800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc8114180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.200+0000 7f3bcf800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc8066d90 0x7f3bc8114670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.201 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.200+0000 7f3bcf800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc81257a0 0x7f3bc8114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.201 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.200+0000 7f3bcf800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8117840 con 0x7f3bc8066d90
2024-03-29T08:54:31.201 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.200+0000 7f3bcf800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8124da0 con 0x7f3bc81257a0
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.200+0000 7f3bcf800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8117a70 con 0x7f3bc80664c0
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc8114180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc8114180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47876/0 (socket says 172.21.15.171:47876)
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 -- 172.21.15.171:0/2123572676 learned_addr learned my addr 172.21.15.171:0/2123572676 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcd800700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc81257a0 0x7f3bc8114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bc7e00700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc8066d90 0x7f3bc8114670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 -- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc81257a0 msgr2=0x7f3bc8114b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc81257a0 0x7f3bc8114b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 -- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc8066d90 msgr2=0x7f3bc8114670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc8066d90 0x7f3bc8114670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bcce00700  1 -- 172.21.15.171:0/2123572676 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc009250 con 0x7f3bc80664c0
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.201+0000 7f3bc7e00700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc8066d90 0x7f3bc8114670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.202+0000 7f3bcce00700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc8114180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3bbc009dd0 tx=0x7f3bbc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.202 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.202+0000 7f3bc4c00700  1 -- 172.21.15.171:0/2123572676 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00f720 con 0x7f3bc80664c0
2024-03-29T08:54:31.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.202+0000 7f3bc4c00700  1 -- 172.21.15.171:0/2123572676 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00f880 con 0x7f3bc80664c0
2024-03-29T08:54:31.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.202+0000 7f3bc4c00700  1 -- 172.21.15.171:0/2123572676 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00fc40 con 0x7f3bc80664c0
2024-03-29T08:54:31.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.202+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc811f950 con 0x7f3bc80664c0
2024-03-29T08:54:31.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.202+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc8115050 con 0x7f3bc80664c0
2024-03-29T08:54:31.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.204+0000 7f3bc4c00700  1 -- 172.21.15.171:0/2123572676 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f3bbc011650 con 0x7f3bc80664c0
2024-03-29T08:54:31.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.204+0000 7f3bc4c00700  1 -- 172.21.15.171:0/2123572676 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f3bbc055dc0 con 0x7f3bc80664c0
2024-03-29T08:54:31.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.205+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc8065c60 con 0x7f3bc80664c0
2024-03-29T08:54:31.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.212+0000 7f3bc4c00700  1 -- 172.21.15.171:0/2123572676 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f3bbc021070 con 0x7f3bc80664c0
2024-03-29T08:54:31.249 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.249+0000 7f052f600700  1  Processor -- start
2024-03-29T08:54:31.249 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.249+0000 7f052f600700  1 --  start start
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.250+0000 7f052f600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05280664c0 0x7f05280668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.250+0000 7f052f600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f0528125e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.250+0000 7f052f600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0528069b40 con 0x7f0528066d90
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.250+0000 7f052f600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0528069550 con 0x7f05280664c0
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.250+0000 7f052f600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0528068990 con 0x7f05281259c0
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052cc00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05280664c0 0x7f05280668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052d600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f0528125e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052d600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f0528125e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47890/0 (socket says 172.21.15.171:47890)
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052d600700  1 -- 172.21.15.171:0/3520781954 learned_addr learned my addr 172.21.15.171:0/3520781954 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052cc00700  1 -- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 msgr2=0x7f0528125e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052cc00700  1 --2- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f0528125e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052cc00700  1 -- 172.21.15.171:0/3520781954 >> v1:172.21.15.171:6789/0 conn(0x7f0528066d90 legacy=0x7f05281252b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052cc00700  1 -- 172.21.15.171:0/3520781954 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528068430 con 0x7f05280664c0
2024-03-29T08:54:31.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.251+0000 7f052d600700  1 --2- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f0528125e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:31.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.252+0000 7f052cc00700  1 --2- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05280664c0 0x7f05280668a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f051c009760 tx=0x7f051c006f40).ready entity=mon.1 client_cookie=15b2b1fb36bb7d1c server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.252+0000 7f0527400700  1 -- 172.21.15.171:0/3520781954 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c00f510 con 0x7f05280664c0
2024-03-29T08:54:31.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.252+0000 7f0527400700  1 -- 172.21.15.171:0/3520781954 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c00f670 con 0x7f05280664c0
2024-03-29T08:54:31.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.252+0000 7f0527400700  1 -- 172.21.15.171:0/3520781954 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c00f9f0 con 0x7f05280664c0
2024-03-29T08:54:31.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 -- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05280664c0 msgr2=0x7f05280668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 --2- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05280664c0 0x7f05280668a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f051c009760 tx=0x7f051c006f40).stop
2024-03-29T08:54:31.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 -- 172.21.15.171:0/3520781954 shutdown_connections
2024-03-29T08:54:31.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 --2- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f0528125e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 --2- 172.21.15.171:0/3520781954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05280664c0 0x7f05280668a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 -- 172.21.15.171:0/3520781954 >> 172.21.15.171:0/3520781954 conn(0x7f0528098a40 msgr2=0x7f0528098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 -- 172.21.15.171:0/3520781954 shutdown_connections
2024-03-29T08:54:31.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.253+0000 7f052f600700  1 -- 172.21.15.171:0/3520781954 wait complete.
2024-03-29T08:54:31.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.255+0000 7f052f600700  1  Processor -- start
2024-03-29T08:54:31.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.255+0000 7f052f600700  1 --  start start
2024-03-29T08:54:31.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.256+0000 7f052f600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05280664c0 0x7f052811e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.256+0000 7f052f600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0528066d90 0x7f052811e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.256+0000 7f052f600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f052811ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.256+0000 7f052f600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528127a10 con 0x7f05280664c0
2024-03-29T08:54:31.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.256+0000 7f052f600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0528127090 con 0x7f0528066d90
2024-03-29T08:54:31.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.256+0000 7f052f600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0528127c40 con 0x7f05281259c0
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052cc00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05280664c0 0x7f052811e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f052811ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f052811ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47900/0 (socket says 172.21.15.171:47900)
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 -- 172.21.15.171:0/3523899345 learned_addr learned my addr 172.21.15.171:0/3523899345 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052cc00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05280664c0 0x7f052811e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47164/0 (socket says 172.21.15.171:47164)
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f0527e00700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0528066d90 0x7f052811e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 -- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0528066d90 msgr2=0x7f052811e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0528066d90 0x7f052811e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 -- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05280664c0 msgr2=0x7f052811e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05280664c0 0x7f052811e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052d600700  1 -- 172.21.15.171:0/3523899345 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009ae0 con 0x7f05281259c0
2024-03-29T08:54:31.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.257+0000 7f052cc00700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05280664c0 0x7f052811e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:31.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.258+0000 7f052d600700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f052811ee10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0520009fd0 tx=0x7f052000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.258+0000 7f0524c00700  1 -- 172.21.15.171:0/3523899345 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200092e0 con 0x7f05281259c0
2024-03-29T08:54:31.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.258+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051c009250 con 0x7f05281259c0
2024-03-29T08:54:31.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.258+0000 7f0524c00700  1 -- 172.21.15.171:0/3523899345 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052000f040 con 0x7f05281259c0
2024-03-29T08:54:31.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.258+0000 7f0524c00700  1 -- 172.21.15.171:0/3523899345 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000cbd0 con 0x7f05281259c0
2024-03-29T08:54:31.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.259+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052811f760 con 0x7f05281259c0
2024-03-29T08:54:31.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.260+0000 7f0524c00700  1 -- 172.21.15.171:0/3523899345 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f0520014460 con 0x7f05281259c0
2024-03-29T08:54:31.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.261+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0528127350 con 0x7f05281259c0
2024-03-29T08:54:31.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.261+0000 7f0524c00700  1 -- 172.21.15.171:0/3523899345 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f052005ad00 con 0x7f05281259c0
2024-03-29T08:54:31.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.267+0000 7f0524c00700  1 -- 172.21.15.171:0/3523899345 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f052005b060 con 0x7f05281259c0
2024-03-29T08:54:31.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.273+0000 7fa2a1a00700  1  Processor -- start
2024-03-29T08:54:31.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.273+0000 7fa2a1a00700  1 --  start start
2024-03-29T08:54:31.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.274+0000 7fa2a1a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fa29c0664c0 0x7fa29c0668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.274+0000 7fa2a1a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c066d90 0x7fa29c1252b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.274+0000 7fa2a1a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c1257a0 0x7fa29c125c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.274+0000 7fa2a1a00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c069b40 con 0x7fa29c0664c0
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.274+0000 7fa2a1a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c069550 con 0x7fa29c1257a0
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.274+0000 7fa2a1a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c068990 con 0x7fa29c066d90
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.275+0000 7fa29a000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c066d90 0x7fa29c1252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.275+0000 7fa29a000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c066d90 0x7fa29c1252b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47912/0 (socket says 172.21.15.171:47912)
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.275+0000 7fa29a000700  1 -- 172.21.15.171:0/3502941176 learned_addr learned my addr 172.21.15.171:0/3502941176 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.275+0000 7fa29aa00700  1 --2- 172.21.15.171:0/3502941176 >> v2:172.21.15.171:3300/0 conn(0x7fa29c0664c0 0x7fa29c0668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.275+0000 7fa29b400700  1 --2- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c1257a0 0x7fa29c125c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.275+0000 7fa29a000700  1 -- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c1257a0 msgr2=0x7fa29c125c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.276+0000 7fa29a000700  1 --2- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c1257a0 0x7fa29c125c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.276+0000 7fa29a000700  1 -- 172.21.15.171:0/3502941176 >> v2:172.21.15.171:3300/0 conn(0x7fa29c0664c0 msgr2=0x7fa29c0668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.276+0000 7fa29a000700  1 --2- 172.21.15.171:0/3502941176 >> v2:172.21.15.171:3300/0 conn(0x7fa29c0664c0 0x7fa29c0668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.276+0000 7fa29a000700  1 -- 172.21.15.171:0/3502941176 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c126110 con 0x7fa29c066d90
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.276+0000 7fa29aa00700  1 --2- 172.21.15.171:0/3502941176 >> v2:172.21.15.171:3300/0 conn(0x7fa29c0664c0 0x7fa29c0668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.276+0000 7fa29b400700  1 --2- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c1257a0 0x7fa29c125c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.276+0000 7fa29a000700  1 --2- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c066d90 0x7fa29c1252b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa288006fd0 tx=0x7fa2880119b0).ready entity=mon.2 client_cookie=e94f2c6ff4a3e9d4 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa299600700  1 -- 172.21.15.171:0/3502941176 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288016070 con 0x7fa29c066d90
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa299600700  1 -- 172.21.15.171:0/3502941176 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288013c30 con 0x7fa29c066d90
2024-03-29T08:54:31.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa299600700  1 -- 172.21.15.171:0/3502941176 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2880110d0 con 0x7fa29c066d90
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa2a1a00700  1 -- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c066d90 msgr2=0x7fa29c1252b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c066d90 0x7fa29c1252b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa288006fd0 tx=0x7fa2880119b0).stop
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa2a1a00700  1 -- 172.21.15.171:0/3502941176 shutdown_connections
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c1257a0 0x7fa29c125c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/3502941176 >> v2:172.21.15.171:3300/0 conn(0x7fa29c0664c0 0x7fa29c0668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/3502941176 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c066d90 0x7fa29c1252b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.277+0000 7fa2a1a00700  1 -- 172.21.15.171:0/3502941176 >> 172.21.15.171:0/3502941176 conn(0x7fa29c098a40 msgr2=0x7fa29c098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.278+0000 7fa2a1a00700  1 -- 172.21.15.171:0/3502941176 shutdown_connections
2024-03-29T08:54:31.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.278+0000 7fa2a1a00700  1 -- 172.21.15.171:0/3502941176 wait complete.
2024-03-29T08:54:31.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.280+0000 7fa2a1a00700  1  Processor -- start
2024-03-29T08:54:31.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.280+0000 7fa2a1a00700  1 --  start start
2024-03-29T08:54:31.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa2a1a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c0664c0 0x7fa29c0846a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa2a1a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c1257a0 0x7fa29c084b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa2a1a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c11b7d0 0x7fa29c085080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:31.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa2a1a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c124cb0 con 0x7fa29c11b7d0
2024-03-29T08:54:31.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa2a1a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c10f680 con 0x7fa29c0664c0
2024-03-29T08:54:31.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa2a1a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c085a00 con 0x7fa29c1257a0
2024-03-29T08:54:31.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa29a000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c1257a0 0x7fa29c084b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa29aa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c0664c0 0x7fa29c0846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa29a000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c1257a0 0x7fa29c084b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47926/0 (socket says 172.21.15.171:47926)
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.281+0000 7fa29a000700  1 -- 172.21.15.171:0/1261966119 learned_addr learned my addr 172.21.15.171:0/1261966119 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29b400700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c11b7d0 0x7fa29c085080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29aa00700  1 -- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c1257a0 msgr2=0x7fa29c084b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29aa00700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c1257a0 0x7fa29c084b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29aa00700  1 -- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c11b7d0 msgr2=0x7fa29c085080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29aa00700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c11b7d0 0x7fa29c085080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29aa00700  1 -- 172.21.15.171:0/1261966119 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009240 con 0x7fa29c0664c0
2024-03-29T08:54:31.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29a000700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c1257a0 0x7fa29c084b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:31.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.282+0000 7fa29aa00700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c0664c0 0x7fa29c0846a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa28c00e950 tx=0x7fa28c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:31.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.283+0000 7fa292a00700  1 -- 172.21.15.171:0/1261966119 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c009530 con 0x7fa29c0664c0
2024-03-29T08:54:31.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.283+0000 7fa292a00700  1 -- 172.21.15.171:0/1261966119 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00c6a0 con 0x7fa29c0664c0
2024-03-29T08:54:31.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.283+0000 7fa292a00700  1 -- 172.21.15.171:0/1261966119 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00ca20 con 0x7fa29c0664c0
2024-03-29T08:54:31.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.283+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa294009a20 con 0x7fa29c0664c0
2024-03-29T08:54:31.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.283+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa288011c10 con 0x7fa29c0664c0
2024-03-29T08:54:31.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.284+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c065c60 con 0x7fa29c0664c0
2024-03-29T08:54:31.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.285+0000 7fa292a00700  1 -- 172.21.15.171:0/1261966119 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7fa28c01b400 con 0x7fa29c0664c0
2024-03-29T08:54:31.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.286+0000 7fa292a00700  1 -- 172.21.15.171:0/1261966119 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fa28c05c360 con 0x7fa29c0664c0
2024-03-29T08:54:31.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.289+0000 7fa292a00700  1 -- 172.21.15.171:0/1261966119 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7fa28c0352b0 con 0x7fa29c0664c0
2024-03-29T08:54:31.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.359+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f96481277e0 con 0x7f96481285d0
2024-03-29T08:54:31.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.360+0000 7f963f400700  1 -- 172.21.15.171:0/697529109 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9634038aa0 con 0x7f96481285d0
2024-03-29T08:54:31.363 INFO:teuthology.orchestra.run.smithi171.stdout:38654705665
2024-03-29T08:54:31.363 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 >> v1:172.21.15.171:6816/38531 conn(0x7f9628041b80 legacy=0x7f9628044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96481285d0 msgr2=0x7f964810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96481285d0 0x7f964810f650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f963400e900 tx=0x7f9634009060).stop
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 shutdown_connections
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f964812aeb0 0x7f964810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96480664c0 0x7f964810f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 --2- 172.21.15.171:0/697529109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96481285d0 0x7f964810f650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 >> 172.21.15.171:0/697529109 conn(0x7f9648098a40 msgr2=0x7f9648129f20 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 shutdown_connections
2024-03-29T08:54:31.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.363+0000 7f964e200700  1 -- 172.21.15.171:0/697529109 wait complete.
2024-03-29T08:54:31.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.0
2024-03-29T08:54:31.393 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.394+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3bc8046ce0 con 0x7f3bc80664c0
2024-03-29T08:54:31.393 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.394+0000 7f3bc4c00700  1 -- 172.21.15.171:0/2123572676 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bbc021070 con 0x7f3bc80664c0
2024-03-29T08:54:31.394 INFO:teuthology.orchestra.run.smithi171.stdout:38654705665
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 >> v1:172.21.15.171:6816/38531 conn(0x7f3ba8041bd0 legacy=0x7f3ba8044090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 msgr2=0x7f3bc8114180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc8114180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3bbc009dd0 tx=0x7f3bbc016000).stop
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 shutdown_connections
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc81257a0 0x7f3bc8114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bc80664c0 0x7f3bc8114180 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 --2- 172.21.15.171:0/2123572676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc8066d90 0x7f3bc8114670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 >> 172.21.15.171:0/2123572676 conn(0x7f3bc8098a40 msgr2=0x7f3bc8122b60 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.396+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 shutdown_connections
2024-03-29T08:54:31.397 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.397+0000 7f3bcf800700  1 -- 172.21.15.171:0/2123572676 wait complete.
2024-03-29T08:54:31.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.3
2024-03-29T08:54:31.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.433+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05281232f0 con 0x7f05281259c0
2024-03-29T08:54:31.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.434+0000 7f0524c00700  1 -- 172.21.15.171:0/3523899345 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0520035a30 con 0x7f05281259c0
2024-03-29T08:54:31.433 INFO:teuthology.orchestra.run.smithi171.stdout:38654705666
2024-03-29T08:54:31.435 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 >> v1:172.21.15.171:6816/38531 conn(0x7f0508041b80 legacy=0x7f0508044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.435 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 msgr2=0x7f052811ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f052811ee10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0520009fd0 tx=0x7f052000b040).stop
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 shutdown_connections
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f05281259c0 0x7f052811ee10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05280664c0 0x7f052811e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 --2- 172.21.15.171:0/3523899345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0528066d90 0x7f052811e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 >> 172.21.15.171:0/3523899345 conn(0x7f0528098a40 msgr2=0x7f05280972d0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 shutdown_connections
2024-03-29T08:54:31.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.436+0000 7f052f600700  1 -- 172.21.15.171:0/3523899345 wait complete.
2024-03-29T08:54:31.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.451+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa29c124a90 con 0x7fa29c0664c0
2024-03-29T08:54:31.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.452+0000 7fa292a00700  1 -- 172.21.15.171:0/1261966119 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa28c038aa0 con 0x7fa29c0664c0
2024-03-29T08:54:31.451 INFO:teuthology.orchestra.run.smithi171.stdout:38654705665
2024-03-29T08:54:31.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 >> v1:172.21.15.171:6816/38531 conn(0x7fa27c041bd0 legacy=0x7fa27c044090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c0664c0 msgr2=0x7fa29c0846a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c0664c0 0x7fa29c0846a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa28c00e950 tx=0x7fa28c009060).stop
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 shutdown_connections
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c11b7d0 0x7fa29c085080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa29c0664c0 0x7fa29c0846a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 --2- 172.21.15.171:0/1261966119 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa29c1257a0 0x7fa29c084b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 >> 172.21.15.171:0/1261966119 conn(0x7fa29c098a40 msgr2=0x7fa29c11f3c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 shutdown_connections
2024-03-29T08:54:31.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:31.454+0000 7fa2a1a00700  1 -- 172.21.15.171:0/1261966119 wait complete.
2024-03-29T08:54:31.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.2
2024-03-29T08:54:32.385 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T08:54:32.415 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T08:54:32.453 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T08:54:32.472 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T08:54:32.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.598+0000 7f67c7600700  1  Processor -- start
2024-03-29T08:54:32.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.598+0000 7f67c7600700  1 --  start start
2024-03-29T08:54:32.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67c7600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c00664c0 0x7f67c00668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67c7600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c01259c0 0x7f67c0125e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67c7600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c0069b40 con 0x7f67c0066d90
2024-03-29T08:54:32.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67c7600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0069550 con 0x7f67c00664c0
2024-03-29T08:54:32.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67c7600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0068990 con 0x7f67c01259c0
2024-03-29T08:54:32.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67bfe00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f67c0066d90 0x7f67c01252b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60688/0 (socket says 172.21.15.171:60688)
2024-03-29T08:54:32.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67bfe00700  1 -- 172.21.15.171:0/3966539090 learned_addr learned my addr 172.21.15.171:0/3966539090 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:32.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.599+0000 7f67c4c00700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c00664c0 0x7f67c00668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67c5600700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c01259c0 0x7f67c0125e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67bf400700  1 -- 172.21.15.171:0/3966539090 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386340500 0 0) 0x7f67c0069b40 con 0x7f67c0066d90
2024-03-29T08:54:32.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67bf400700  1 -- 172.21.15.171:0/3966539090 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a80033f0 con 0x7f67c0066d90
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67c4c00700  1 -- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c01259c0 msgr2=0x7f67c0125e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67c4c00700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c01259c0 0x7f67c0125e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67c4c00700  1 -- 172.21.15.171:0/3966539090 >> v1:172.21.15.171:6789/0 conn(0x7f67c0066d90 legacy=0x7f67c01252b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67c4c00700  1 -- 172.21.15.171:0/3966539090 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0068430 con 0x7f67c00664c0
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.600+0000 7f67c5600700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c01259c0 0x7f67c0125e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.601+0000 7f67c4c00700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c00664c0 0x7f67c00668a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f67b4009760 tx=0x7f67b4006f40).ready entity=mon.1 client_cookie=1b20e6782d72a5d0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.601+0000 7f67bf400700  1 -- 172.21.15.171:0/3966539090 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4005880 con 0x7f67c00664c0
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.601+0000 7f67bf400700  1 -- 172.21.15.171:0/3966539090 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b40059e0 con 0x7f67c00664c0
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.601+0000 7f67bf400700  1 -- 172.21.15.171:0/3966539090 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4005d60 con 0x7f67c00664c0
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 -- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c00664c0 msgr2=0x7f67c00668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c00664c0 0x7f67c00668a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f67b4009760 tx=0x7f67b4006f40).stop
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 -- 172.21.15.171:0/3966539090 shutdown_connections
2024-03-29T08:54:32.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c01259c0 0x7f67c0125e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 --2- 172.21.15.171:0/3966539090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c00664c0 0x7f67c00668a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 -- 172.21.15.171:0/3966539090 >> 172.21.15.171:0/3966539090 conn(0x7f67c0098a40 msgr2=0x7f67c0098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 -- 172.21.15.171:0/3966539090 shutdown_connections
2024-03-29T08:54:32.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.602+0000 7f67c7600700  1 -- 172.21.15.171:0/3966539090 wait complete.
2024-03-29T08:54:32.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.603+0000 7f67c7600700  1  Processor -- start
2024-03-29T08:54:32.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.603+0000 7f67c7600700  1 --  start start
2024-03-29T08:54:32.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67c7600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c00664c0 0x7f67c01272c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67c7600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c0066d90 0x7f67c01277b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67c7600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c01259c0 0x7f67c0127ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67c7600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0128e20 con 0x7f67c01259c0
2024-03-29T08:54:32.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67c7600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0129fd0 con 0x7f67c0066d90
2024-03-29T08:54:32.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67c7600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0129c60 con 0x7f67c00664c0
2024-03-29T08:54:32.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67bfe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c0066d90 0x7f67c01277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67bfe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c0066d90 0x7f67c01277b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53398/0 (socket says 172.21.15.171:53398)
2024-03-29T08:54:32.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.604+0000 7f67bfe00700  1 -- 172.21.15.171:0/3593755488 learned_addr learned my addr 172.21.15.171:0/3593755488 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67c4c00700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c00664c0 0x7f67c01272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67c5600700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c01259c0 0x7f67c0127ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67bfe00700  1 -- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c00664c0 msgr2=0x7f67c01272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67bfe00700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c00664c0 0x7f67c01272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67bfe00700  1 -- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c01259c0 msgr2=0x7f67c0127ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67bfe00700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c01259c0 0x7f67c0127ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67bfe00700  1 -- 172.21.15.171:0/3593755488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b8009a20 con 0x7f67c0066d90
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67c5600700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c01259c0 0x7f67c0127ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67c4c00700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c00664c0 0x7f67c01272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed!
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.605+0000 7f67bfe00700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c0066d90 0x7f67c01277b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f67ac00c4f0 tx=0x7f67ac007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.606+0000 7f67bcc00700  1 -- 172.21.15.171:0/3593755488 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0072e0 con 0x7f67c0066d90
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.606+0000 7f67bcc00700  1 -- 172.21.15.171:0/3593755488 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac007440 con 0x7f67c0066d90
2024-03-29T08:54:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.606+0000 7f67bcc00700  1 -- 172.21.15.171:0/3593755488 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0057a0 con 0x7f67c0066d90
2024-03-29T08:54:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.606+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b4009250 con 0x7f67c0066d90
2024-03-29T08:54:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.606+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c012a3d0 con 0x7f67c0066d90
2024-03-29T08:54:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.607+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c0128a00 con 0x7f67c0066d90
2024-03-29T08:54:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.608+0000 7f67bcc00700  1 -- 172.21.15.171:0/3593755488 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f67ac005b90 con 0x7f67c0066d90
2024-03-29T08:54:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.609+0000 7f67bcc00700  1 -- 172.21.15.171:0/3593755488 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f67ac054960 con 0x7f67c0066d90
2024-03-29T08:54:32.615 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.616+0000 7f67bcc00700  1 -- 172.21.15.171:0/3593755488 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f67c0128a00 con 0x7f67c0066d90
2024-03-29T08:54:32.638 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.639+0000 7faeafa00700  1  Processor -- start
2024-03-29T08:54:32.638 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.639+0000 7faeafa00700  1 --  start start
2024-03-29T08:54:32.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faeafa00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7faea80664c0 0x7faea80668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faeafa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea8066d90 0x7faea81252b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faeafa00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea8069b40 con 0x7faea81257a0
2024-03-29T08:54:32.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faeafa00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea8069550 con 0x7faea80664c0
2024-03-29T08:54:32.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faeafa00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faea8068990 con 0x7faea8066d90
2024-03-29T08:54:32.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faea7e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea8066d90 0x7faea81252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faea7e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea8066d90 0x7faea81252b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:47964/0 (socket says 172.21.15.171:47964)
2024-03-29T08:54:32.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faea7e00700  1 -- 172.21.15.171:0/272255047 learned_addr learned my addr 172.21.15.171:0/272255047 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.640+0000 7faead000700  1 --2- 172.21.15.171:0/272255047 >> v2:172.21.15.171:3300/0 conn(0x7faea80664c0 0x7faea80668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7e00700  1 -- 172.21.15.171:0/272255047 >> v2:172.21.15.171:3300/0 conn(0x7faea80664c0 msgr2=0x7faea80668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7e00700  1 --2- 172.21.15.171:0/272255047 >> v2:172.21.15.171:3300/0 conn(0x7faea80664c0 0x7faea80668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7e00700  1 -- 172.21.15.171:0/272255047 >> v1:172.21.15.171:6789/0 conn(0x7faea81257a0 legacy=0x7faea812c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7e00700  1 -- 172.21.15.171:0/272255047 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8068430 con 0x7faea8066d90
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7e00700  1 --2- 172.21.15.171:0/272255047 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea8066d90 0x7faea81252b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fae94006fd0 tx=0x7fae940090f0).ready entity=mon.2 client_cookie=a83739a66279975e server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7400700  1 -- 172.21.15.171:0/272255047 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400b600 con 0x7faea8066d90
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7400700  1 -- 172.21.15.171:0/272255047 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9400b760 con 0x7faea8066d90
2024-03-29T08:54:32.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.641+0000 7faea7400700  1 -- 172.21.15.171:0/272255047 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400bae0 con 0x7faea8066d90
2024-03-29T08:54:32.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.642+0000 7faeafa00700  1 -- 172.21.15.171:0/272255047 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea8066d90 msgr2=0x7faea81252b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.642+0000 7faeafa00700  1 --2- 172.21.15.171:0/272255047 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea8066d90 0x7faea81252b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fae94006fd0 tx=0x7fae940090f0).stop
2024-03-29T08:54:32.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.642+0000 7faeafa00700  1 -- 172.21.15.171:0/272255047 shutdown_connections
2024-03-29T08:54:32.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.642+0000 7faeafa00700  1 --2- 172.21.15.171:0/272255047 >> v2:172.21.15.171:3300/0 conn(0x7faea80664c0 0x7faea80668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.642+0000 7faeafa00700  1 --2- 172.21.15.171:0/272255047 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea8066d90 0x7faea81252b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.642+0000 7faeafa00700  1 -- 172.21.15.171:0/272255047 >> 172.21.15.171:0/272255047 conn(0x7faea8098a40 msgr2=0x7faea8098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.642+0000 7faeafa00700  1 -- 172.21.15.171:0/272255047 shutdown_connections
2024-03-29T08:54:32.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.643+0000 7faeafa00700  1 -- 172.21.15.171:0/272255047 wait complete.
2024-03-29T08:54:32.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.644+0000 7faeafa00700  1  Processor -- start
2024-03-29T08:54:32.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.644+0000 7faeafa00700  1 --  start start
2024-03-29T08:54:32.644 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faeafa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea80664c0 0x7faea8114350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.644 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faeafa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faea8066d90 0x7faea8114840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.644 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faeafa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea81257a0 0x7faea8114d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.644 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faeafa00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8117790 con 0x7faea81257a0
2024-03-29T08:54:32.644 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faeafa00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea81156b0 con 0x7faea8066d90
2024-03-29T08:54:32.644 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faeafa00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faea8117b60 con 0x7faea80664c0
2024-03-29T08:54:32.645 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faea7e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faea8066d90 0x7faea8114840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.645 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faea7e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faea8066d90 0x7faea8114840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53410/0 (socket says 172.21.15.171:53410)
2024-03-29T08:54:32.645 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faea7e00700  1 -- 172.21.15.171:0/1615022796 learned_addr learned my addr 172.21.15.171:0/1615022796 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:32.645 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.645+0000 7faead000700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea80664c0 0x7faea8114350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.645 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.646+0000 7faeada00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea81257a0 0x7faea8114d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.646+0000 7faea7e00700  1 -- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea80664c0 msgr2=0x7faea8114350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea7e00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea80664c0 0x7faea8114350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea7e00700  1 -- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea81257a0 msgr2=0x7faea8114d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea7e00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea81257a0 0x7faea8114d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea7e00700  1 -- 172.21.15.171:0/1615022796 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94009370 con 0x7faea8066d90
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faead000700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea80664c0 0x7faea8114350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faeada00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea81257a0 0x7faea8114d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea7e00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faea8066d90 0x7faea8114840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fae94011000 tx=0x7fae94017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea4c00700  1 -- 172.21.15.171:0/1615022796 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400b8d0 con 0x7faea8066d90
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea4c00700  1 -- 172.21.15.171:0/1615022796 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9400ba30 con 0x7faea8066d90
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.647+0000 7faea4c00700  1 -- 172.21.15.171:0/1615022796 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9401c630 con 0x7faea8066d90
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.648+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea8115e80 con 0x7faea8066d90
2024-03-29T08:54:32.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.648+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea8116fb0 con 0x7faea8066d90
2024-03-29T08:54:32.649 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.649+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea8065c60 con 0x7faea8066d90
2024-03-29T08:54:32.649 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.650+0000 7faea4c00700  1 -- 172.21.15.171:0/1615022796 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7fae9401c9e0 con 0x7faea8066d90
2024-03-29T08:54:32.650 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.650+0000 7faea4c00700  1 -- 172.21.15.171:0/1615022796 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fae94056a70 con 0x7faea8066d90
2024-03-29T08:54:32.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.657+0000 7faea4c00700  1 -- 172.21.15.171:0/1615022796 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7fae94026e40 con 0x7faea8066d90
2024-03-29T08:54:32.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.683+0000 7fb268600700  1  Processor -- start
2024-03-29T08:54:32.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.683+0000 7fb268600700  1 --  start start
2024-03-29T08:54:32.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb268600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb2600668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb268600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb260066d90 0x7fb2601252b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb268600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb260069b40 con 0x7fb2601257a0
2024-03-29T08:54:32.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb268600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb260069550 con 0x7fb2600664c0
2024-03-29T08:54:32.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb268600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb260068990 con 0x7fb260066d90
2024-03-29T08:54:32.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb265c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb2600668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb265c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb2600668a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53418/0 (socket says 172.21.15.171:53418)
2024-03-29T08:54:32.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb265c00700  1 -- 172.21.15.171:0/2919045413 learned_addr learned my addr 172.21.15.171:0/2919045413 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:32.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.684+0000 7fb265200700  1 --2- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb260066d90 0x7fb2601252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb25fe00700  1 -- 172.21.15.171:0/2919045413 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374544489 0 0) 0x7fb260069b40 con 0x7fb2601257a0
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb265c00700  1 -- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb260066d90 msgr2=0x7fb2601252b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb265c00700  1 --2- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb260066d90 0x7fb2601252b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb265c00700  1 -- 172.21.15.171:0/2919045413 >> v1:172.21.15.171:6789/0 conn(0x7fb2601257a0 legacy=0x7fb260125c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb265c00700  1 -- 172.21.15.171:0/2919045413 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260068430 con 0x7fb2600664c0
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb265200700  1 --2- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb260066d90 0x7fb2601252b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb265c00700  1 --2- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb2600668a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb254009840 tx=0x7fb254009060).ready entity=mon.1 client_cookie=11813f03329b1379 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb25fe00700  1 -- 172.21.15.171:0/2919045413 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254005880 con 0x7fb2600664c0
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb25fe00700  1 -- 172.21.15.171:0/2919045413 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2540059e0 con 0x7fb2600664c0
2024-03-29T08:54:32.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.685+0000 7fb25fe00700  1 -- 172.21.15.171:0/2919045413 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254005d60 con 0x7fb2600664c0
2024-03-29T08:54:32.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 -- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 msgr2=0x7fb2600668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 --2- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb2600668a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb254009840 tx=0x7fb254009060).stop
2024-03-29T08:54:32.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 -- 172.21.15.171:0/2919045413 shutdown_connections
2024-03-29T08:54:32.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 --2- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb2600668a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 --2- 172.21.15.171:0/2919045413 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb260066d90 0x7fb2601252b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.686 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 -- 172.21.15.171:0/2919045413 >> 172.21.15.171:0/2919045413 conn(0x7fb260098a40 msgr2=0x7fb260098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 -- 172.21.15.171:0/2919045413 shutdown_connections
2024-03-29T08:54:32.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.686+0000 7fb268600700  1 -- 172.21.15.171:0/2919045413 wait complete.
2024-03-29T08:54:32.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1  Processor -- start
2024-03-29T08:54:32.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1 --  start start
2024-03-29T08:54:32.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb260134960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb260066d90 0x7fb260134e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb2601257a0 0x7fb260135340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb260135830 con 0x7fb260066d90
2024-03-29T08:54:32.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26012c660 con 0x7fb2600664c0
2024-03-29T08:54:32.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.688+0000 7fb268600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb260110030 con 0x7fb2601257a0
2024-03-29T08:54:32.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.689+0000 7fb265200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb260066d90 0x7fb260134e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.689+0000 7fb266600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb2601257a0 0x7fb260135340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.689+0000 7fb265200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb260066d90 0x7fb260134e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47222/0 (socket says 172.21.15.171:47222)
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.689+0000 7fb265200700  1 -- 172.21.15.171:0/1555927008 learned_addr learned my addr 172.21.15.171:0/1555927008 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.689+0000 7fb265c00700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb260134960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.689+0000 7fb266600700  1 -- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 msgr2=0x7fb260134960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb266600700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb260134960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb266600700  1 -- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb260066d90 msgr2=0x7fb260134e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb266600700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb260066d90 0x7fb260134e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb266600700  1 -- 172.21.15.171:0/1555927008 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0092a0 con 0x7fb2601257a0
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb265200700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb260066d90 0x7fb260134e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:32.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb266600700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb2601257a0 0x7fb260135340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb2580012e0 tx=0x7fb258007ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb25d600700  1 -- 172.21.15.171:0/1555927008 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800ab30 con 0x7fb2601257a0
2024-03-29T08:54:32.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb25d600700  1 -- 172.21.15.171:0/1555927008 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800ac90 con 0x7fb2601257a0
2024-03-29T08:54:32.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb254009300 con 0x7fb2601257a0
2024-03-29T08:54:32.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.690+0000 7fb25d600700  1 -- 172.21.15.171:0/1555927008 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258013b30 con 0x7fb2601257a0
2024-03-29T08:54:32.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.691+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26012aaf0 con 0x7fb2601257a0
2024-03-29T08:54:32.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.692+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb260065c60 con 0x7fb2601257a0
2024-03-29T08:54:32.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.692+0000 7fb25d600700  1 -- 172.21.15.171:0/1555927008 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7fb258014030 con 0x7fb2601257a0
2024-03-29T08:54:32.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.693+0000 7fb25d600700  1 -- 172.21.15.171:0/1555927008 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fb25805d140 con 0x7fb2601257a0
2024-03-29T08:54:32.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.699+0000 7f2f59e00700  1  Processor -- start
2024-03-29T08:54:32.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.699+0000 7f2f59e00700  1 --  start start
2024-03-29T08:54:32.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.700+0000 7fb25d600700  1 -- 172.21.15.171:0/1555927008 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7fb25803da20 con 0x7fb2601257a0
2024-03-29T08:54:32.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.700+0000 7f2f59e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f540664c0 0x7f2f540668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.700+0000 7f2f59e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f2f541259c0 0x7f2f5412d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.700+0000 7f2f59e00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f54069b40 con 0x7f2f54066d90
2024-03-29T08:54:32.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.700+0000 7f2f59e00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f54069550 con 0x7f2f541259c0
2024-03-29T08:54:32.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.700+0000 7f2f59e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f54068990 con 0x7f2f540664c0
2024-03-29T08:54:32.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.701+0000 7f2f52000700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f2f54066d90 0x7f2f541252b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60704/0 (socket says 172.21.15.171:60704)
2024-03-29T08:54:32.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.701+0000 7f2f52000700  1 -- 172.21.15.171:0/3242999802 learned_addr learned my addr 172.21.15.171:0/3242999802 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T08:54:32.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.701+0000 7f2f53400700  1 --2- 172.21.15.171:0/3242999802 >> v2:172.21.15.171:3300/0 conn(0x7f2f541259c0 0x7f2f5412d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.701+0000 7f2f52a00700  1 --2- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f540664c0 0x7f2f540668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.701+0000 7f2f53400700  1 -- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f540664c0 msgr2=0x7f2f540668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:32.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f53400700  1 --2- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f540664c0 0x7f2f540668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f53400700  1 -- 172.21.15.171:0/3242999802 >> v1:172.21.15.171:6789/0 conn(0x7f2f54066d90 legacy=0x7f2f541252b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:32.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f53400700  1 -- 172.21.15.171:0/3242999802 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54068430 con 0x7f2f541259c0
2024-03-29T08:54:32.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f52a00700  1 --2- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f540664c0 0x7f2f540668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:32.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f53400700  1 --2- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f5412d600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2f4c009e60 tx=0x7f2f4c009780).ready entity=mon.0 client_cookie=674f2383dc0e40b9 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f51600700  1 -- 172.21.15.171:0/3242999802 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00e070 con 0x7f2f541259c0
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f51600700  1 -- 172.21.15.171:0/3242999802 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c00bb20 con 0x7f2f541259c0
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.702+0000 7f2f51600700  1 -- 172.21.15.171:0/3242999802 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00bea0 con 0x7f2f541259c0
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 -- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 msgr2=0x7f2f5412d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 --2- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f5412d600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2f4c009e60 tx=0x7f2f4c009780).stop
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 -- 172.21.15.171:0/3242999802 shutdown_connections
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 --2- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f5412d600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 --2- 172.21.15.171:0/3242999802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f540664c0 0x7f2f540668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.704 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 -- 172.21.15.171:0/3242999802 >> 172.21.15.171:0/3242999802 conn(0x7f2f54098a40 msgr2=0x7f2f54098e50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.704 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 -- 172.21.15.171:0/3242999802 shutdown_connections
2024-03-29T08:54:32.704 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.703+0000 7f2f59e00700  1 -- 172.21.15.171:0/3242999802 wait complete.
2024-03-29T08:54:32.705 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.705+0000 7f2f59e00700  1  Processor -- start
2024-03-29T08:54:32.705 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.705+0000 7f2f59e00700  1 --  start start
2024-03-29T08:54:32.705 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f59e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f540664c0 0x7f2f54111ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.705 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f59e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f54066d90 0x7f2f541415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f59e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f54141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:32.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f59e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f54110110 con 0x7f2f541259c0
2024-03-29T08:54:32.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f59e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541122b0 con 0x7f2f54066d90
2024-03-29T08:54:32.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f59e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f54112470 con 0x7f2f540664c0
2024-03-29T08:54:32.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f53400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f54141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.706+0000 7f2f53400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f54141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47232/0 (socket says 172.21.15.171:47232)
2024-03-29T08:54:32.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f53400700  1 -- 172.21.15.171:0/2151398508 learned_addr learned my addr 172.21.15.171:0/2151398508 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f53400700  1 -- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f540664c0 msgr2=0x7f2f54111ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f52a00700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f540664c0 0x7f2f54111ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f52000700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f54066d90 0x7f2f541415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f53400700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f540664c0 0x7f2f54111ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f53400700  1 -- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f54066d90 msgr2=0x7f2f541415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f53400700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f54066d90 0x7f2f541415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f53400700  1 -- 172.21.15.171:0/2151398508 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009250 con 0x7f2f541259c0
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f52a00700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f540664c0 0x7f2f54111ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed!
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f52000700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f54066d90 0x7f2f541415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed!
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.707+0000 7f2f53400700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f54141a90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2f54068250 tx=0x7f2f54069440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.708+0000 7f2f4b400700  1 -- 172.21.15.171:0/2151398508 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c01d630 con 0x7f2f541259c0
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.708+0000 7f2f4b400700  1 -- 172.21.15.171:0/2151398508 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c01d790 con 0x7f2f541259c0
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.708+0000 7f2f4b400700  1 -- 172.21.15.171:0/2151398508 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c01db30 con 0x7f2f541259c0
2024-03-29T08:54:32.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.708+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c009a20 con 0x7f2f541259c0
2024-03-29T08:54:32.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.708+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f541421c0 con 0x7f2f541259c0
2024-03-29T08:54:32.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.709+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f54142470 con 0x7f2f541259c0
2024-03-29T08:54:32.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.710+0000 7f2f4b400700  1 -- 172.21.15.171:0/2151398508 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f2f4c003040 con 0x7f2f541259c0
2024-03-29T08:54:32.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.710+0000 7f2f4b400700  1 -- 172.21.15.171:0/2151398508 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f2f4c0570f0 con 0x7f2f541259c0
2024-03-29T08:54:32.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.718+0000 7f2f4b400700  1 -- 172.21.15.171:0/2151398508 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f2f4c03b630 con 0x7f2f541259c0
2024-03-29T08:54:32.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.805+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67c0128a00 con 0x7f67c0066d90
2024-03-29T08:54:32.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.805+0000 7f67bcc00700  1 -- 172.21.15.171:0/3593755488 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67c0128a00 con 0x7f67c0066d90
2024-03-29T08:54:32.805 INFO:teuthology.orchestra.run.smithi171.stdout:38654705666
2024-03-29T08:54:32.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 >> v1:172.21.15.171:6816/38531 conn(0x7f67a0041b80 legacy=0x7f67a0044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c0066d90 msgr2=0x7f67c01277b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c0066d90 0x7f67c01277b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f67ac00c4f0 tx=0x7f67ac007c50).stop
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 shutdown_connections
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c01259c0 0x7f67c0127ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f67c00664c0 0x7f67c01272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 --2- 172.21.15.171:0/3593755488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67c0066d90 0x7f67c01277b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 >> 172.21.15.171:0/3593755488 conn(0x7f67c0098a40 msgr2=0x7f67c0121ff0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 shutdown_connections
2024-03-29T08:54:32.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.808+0000 7f67c7600700  1 -- 172.21.15.171:0/3593755488 wait complete.
2024-03-29T08:54:32.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.830+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faea8046ce0 con 0x7faea8066d90
2024-03-29T08:54:32.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.831+0000 7faea4c00700  1 -- 172.21.15.171:0/1615022796 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae9403ac60 con 0x7faea8066d90
2024-03-29T08:54:32.831 INFO:teuthology.orchestra.run.smithi171.stdout:38654705666
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 >> v1:172.21.15.171:6816/38531 conn(0x7fae88041b80 legacy=0x7fae88044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faea8066d90 msgr2=0x7faea8114840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faea8066d90 0x7faea8114840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fae94011000 tx=0x7fae94017000).stop
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 shutdown_connections
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea81257a0 0x7faea8114d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faea80664c0 0x7faea8114350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 --2- 172.21.15.171:0/1615022796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faea8066d90 0x7faea8114840 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 >> 172.21.15.171:0/1615022796 conn(0x7faea8098a40 msgr2=0x7faea8121ff0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 shutdown_connections
2024-03-29T08:54:32.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.833+0000 7faeafa00700  1 -- 172.21.15.171:0/1615022796 wait complete.
2024-03-29T08:54:32.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.0
2024-03-29T08:54:32.834 DEBUG:teuthology.parallel:result is None
2024-03-29T08:54:32.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.3
2024-03-29T08:54:32.851 DEBUG:teuthology.parallel:result is None
2024-03-29T08:54:32.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.870+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb260110530 con 0x7fb2601257a0
2024-03-29T08:54:32.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.870+0000 7fb25d600700  1 -- 172.21.15.171:0/1555927008 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb25800ae00 con 0x7fb2601257a0
2024-03-29T08:54:32.870 INFO:teuthology.orchestra.run.smithi171.stdout:38654705667
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 >> v1:172.21.15.171:6816/38531 conn(0x7fb240041b80 legacy=0x7fb240044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb2601257a0 msgr2=0x7fb260135340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb2601257a0 0x7fb260135340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb2580012e0 tx=0x7fb258007ee0).stop
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 shutdown_connections
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb2601257a0 0x7fb260135340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2600664c0 0x7fb260134960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 --2- 172.21.15.171:0/1555927008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb260066d90 0x7fb260134e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 >> 172.21.15.171:0/1555927008 conn(0x7fb260098a40 msgr2=0x7fb260097300 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 shutdown_connections
2024-03-29T08:54:32.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.872+0000 7fb268600700  1 -- 172.21.15.171:0/1555927008 wait complete.
2024-03-29T08:54:32.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.1
2024-03-29T08:54:32.889 DEBUG:teuthology.parallel:result is None
2024-03-29T08:54:32.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.895+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f54065c60 con 0x7f2f541259c0
2024-03-29T08:54:32.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.896+0000 7f2f4b400700  1 -- 172.21.15.171:0/2151398508 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f4c03b220 con 0x7f2f541259c0
2024-03-29T08:54:32.895 INFO:teuthology.orchestra.run.smithi171.stdout:38654705666
2024-03-29T08:54:32.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.897+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 >> v1:172.21.15.171:6816/38531 conn(0x7f2f34041b80 legacy=0x7f2f34044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.897+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 msgr2=0x7f2f54141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.897+0000 7f2f59e00700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f54141a90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2f54068250 tx=0x7f2f54069440).stop
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.898+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 shutdown_connections
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.898+0000 7f2f59e00700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f541259c0 0x7f2f54141a90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.898+0000 7f2f59e00700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f540664c0 0x7f2f54111ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.898+0000 7f2f59e00700  1 --2- 172.21.15.171:0/2151398508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f54066d90 0x7f2f541415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.898+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 >> 172.21.15.171:0/2151398508 conn(0x7f2f54098a40 msgr2=0x7f2f5411efd0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.898+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 shutdown_connections
2024-03-29T08:54:32.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:32.898+0000 7f2f59e00700  1 -- 172.21.15.171:0/2151398508 wait complete.
2024-03-29T08:54:32.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.2
2024-03-29T08:54:32.915 DEBUG:teuthology.parallel:result is None
2024-03-29T08:54:32.915 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean
2024-03-29T08:54:32.915 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T08:54:33.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.138+0000 7fca4f800700  1  Processor -- start
2024-03-29T08:54:33.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.138+0000 7fca4f800700  1 --  start start
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4f800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4f800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca48067300 0x7fca48125530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4f800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fca480676e0 0x7fca48125a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4f800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca480694e0 con 0x7fca480676e0
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4f800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca48068e70 con 0x7fca48066a30
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4f800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca48063e80 con 0x7fca48067300
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca47e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca48067300 0x7fca48125530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4ce00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.139+0000 7fca4d800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fca480676e0 0x7fca48125a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca47e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca48067300 0x7fca48125530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:48016/0 (socket says 172.21.15.171:48016)
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca47e00700  1 -- 172.21.15.171:0/2596529137 learned_addr learned my addr 172.21.15.171:0/2596529137 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca4d800700  1 -- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca48067300 msgr2=0x7fca48125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca4d800700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca48067300 0x7fca48125530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca4d800700  1 -- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 msgr2=0x7fca48066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca4d800700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca4d800700  1 -- 172.21.15.171:0/2596529137 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48063cb0 con 0x7fca480676e0
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca4ce00700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca47e00700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca48067300 0x7fca48125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca4d800700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca480676e0 0x7fca48125a20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fca40009e90 tx=0x7fca40009780).ready entity=mon.0 client_cookie=7d71e7328c3db6aa server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca47400700  1 -- 172.21.15.171:0/2596529137 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000e070 con 0x7fca480676e0
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca47400700  1 -- 172.21.15.171:0/2596529137 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4000ba70 con 0x7fca480676e0
2024-03-29T08:54:33.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.140+0000 7fca47400700  1 -- 172.21.15.171:0/2596529137 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000bdf0 con 0x7fca480676e0
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 -- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca480676e0 msgr2=0x7fca48125a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca480676e0 0x7fca48125a20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fca40009e90 tx=0x7fca40009780).stop
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 -- 172.21.15.171:0/2596529137 shutdown_connections
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca480676e0 0x7fca48125a20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 --2- 172.21.15.171:0/2596529137 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca48067300 0x7fca48125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 -- 172.21.15.171:0/2596529137 >> 172.21.15.171:0/2596529137 conn(0x7fca480992c0 msgr2=0x7fca48064c50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 -- 172.21.15.171:0/2596529137 shutdown_connections
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.141+0000 7fca4f800700  1 -- 172.21.15.171:0/2596529137 wait complete.
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.142+0000 7fca4f800700  1  Processor -- start
2024-03-29T08:54:33.144 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.142+0000 7fca4f800700  1 --  start start
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4f800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48111470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4f800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca48067300 0x7fca48111960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4f800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca480676e0 0x7fca48111e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4f800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca48114d20 con 0x7fca48067300
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4f800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca48114170 con 0x7fca48066a30
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4f800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca4811ca40 con 0x7fca480676e0
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4ce00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48111470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4ce00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48111470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53458/0 (socket says 172.21.15.171:53458)
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca47e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca48067300 0x7fca48111960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4ce00700  1 -- 172.21.15.171:0/181274917 learned_addr learned my addr 172.21.15.171:0/181274917 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.143+0000 7fca4d800700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca480676e0 0x7fca48111e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4ce00700  1 -- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca480676e0 msgr2=0x7fca48111e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4ce00700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca480676e0 0x7fca48111e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4ce00700  1 -- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca48067300 msgr2=0x7fca48111960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.145 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4ce00700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca48067300 0x7fca48111960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4ce00700  1 -- 172.21.15.171:0/181274917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c009250 con 0x7fca48066a30
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4d800700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca480676e0 0x7fca48111e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca47e00700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca48067300 0x7fca48111960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4ce00700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48111470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fca3c00ec80 tx=0x7fca3c006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca44c00700  1 -- 172.21.15.171:0/181274917 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c005880 con 0x7fca48066a30
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca44c00700  1 -- 172.21.15.171:0/181274917 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c0059e0 con 0x7fca48066a30
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca44c00700  1 -- 172.21.15.171:0/181274917 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c005d60 con 0x7fca48066a30
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca34009370 con 0x7fca48066a30
2024-03-29T08:54:33.146 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.144+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca40009a20 con 0x7fca48066a30
2024-03-29T08:54:33.147 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.145+0000 7fca44c00700  1 -- 172.21.15.171:0/181274917 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7fca3c00ca60 con 0x7fca48066a30
2024-03-29T08:54:33.147 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.145+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca481143b0 con 0x7fca48066a30
2024-03-29T08:54:33.147 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.146+0000 7fca44c00700  1 -- 172.21.15.171:0/181274917 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fca3c055440 con 0x7fca48066a30
2024-03-29T08:54:33.149 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.150+0000 7fca44c00700  1 -- 172.21.15.171:0/181274917 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7fca481143b0 con 0x7fca48066a30
2024-03-29T08:54:33.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.293+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 --> v1:172.21.15.171:6816/38531 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca481143b0 con 0x7fca28041b80
2024-03-29T08:54:33.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.294+0000 7fca44c00700  1 -- 172.21.15.171:0/181274917 <== mgr.4098 v1:172.21.15.171:6816/38531 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32746 (unknown 2965378022 0 2455282933) 0x7fca481143b0 con 0x7fca28041b80
2024-03-29T08:54:33.294 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:33.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 >> v1:172.21.15.171:6816/38531 conn(0x7fca28041b80 legacy=0x7fca28044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 msgr2=0x7fca48111470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48111470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fca3c00ec80 tx=0x7fca3c006f40).stop
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 shutdown_connections
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fca480676e0 0x7fca48111e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca48066a30 0x7fca48111470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 --2- 172.21.15.171:0/181274917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca48067300 0x7fca48111960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 >> 172.21.15.171:0/181274917 conn(0x7fca480992c0 msgr2=0x7fca4811f760 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 shutdown_connections
2024-03-29T08:54:33.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.296+0000 7fca4f800700  1 -- 172.21.15.171:0/181274917 wait complete.
2024-03-29T08:54:33.298 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T08:54:33.313 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-03-29T08:54:32.500855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188792,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298568,"statfs":{"total":386547056640,"available":385329733632,"internally_reserved":0,"allocated":417792,"data_stored":106325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.571504+0000","last_change":"2024-03-29T08:54:29.570074+0000","last_active":"2024-03-29T08:54:29.571504+0000","last_peered":"2024-03-29T08:54:29.571504+0000","last_clean":"2024-03-29T08:54:29.571504+0000","last_became_active":"2024-03-29T08:54:29.569664+0000","last_became_peered":"2024-03-29T08:54:29.569664+0000","last_unstale":"2024-03-29T08:54:29.571504+0000","last_undegraded":"2024-03-29T08:54:29.571504+0000","last_fullsized":"2024-03-29T08:54:29.571504+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.574223+0000","last_change":"2024-03-29T08:54:29.572552+0000","last_active":"2024-03-29T08:54:29.574223+0000","last_peered":"2024-03-29T08:54:29.574223+0000","last_clean":"2024-03-29T08:54:29.574223+0000","last_became_active":"2024-03-29T08:54:29.569749+0000","last_became_peered":"2024-03-29T08:54:29.569749+0000","last_unstale":"2024-03-29T08:54:29.574223+0000","last_undegraded":"2024-03-29T08:54:29.574223+0000","last_fullsized":"2024-03-29T08:54:29.574223+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.571469+0000","last_change":"2024-03-29T08:54:29.570245+0000","last_active":"2024-03-29T08:54:29.571469+0000","last_peered":"2024-03-29T08:54:29.571469+0000","last_clean":"2024-03-29T08:54:29.571469+0000","last_became_active":"2024-03-29T08:54:29.569819+0000","last_became_peered":"2024-03-29T08:54:29.569819+0000","last_unstale":"2024-03-29T08:54:29.571469+0000","last_undegraded":"2024-03-29T08:54:29.571469+0000","last_fullsized":"2024-03-29T08:54:29.571469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.551772+0000","last_change":"2024-03-29T08:54:29.549849+0000","last_active":"2024-03-29T08:54:29.551772+0000","last_peered":"2024-03-29T08:54:29.551772+0000","last_clean":"2024-03-29T08:54:29.551772+0000","last_became_active":"2024-03-29T08:54:29.548886+0000","last_became_peered":"2024-03-29T08:54:29.548886+0000","last_unstale":"2024-03-29T08:54:29.551772+0000","last_undegraded":"2024-03-29T08:54:29.551772+0000","last_fullsized":"2024-03-29T08:54:29.551772+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.573024+0000","last_change":"2024-03-29T08:54:29.570495+0000","last_active":"2024-03-29T08:54:29.573024+0000","last_peered":"2024-03-29T08:54:29.573024+0000","last_clean":"2024-03-29T08:54:29.573024+0000","last_became_active":"2024-03-29T08:54:29.570203+0000","last_became_peered":"2024-03-29T08:54:29.570203+0000","last_unstale":"2024-03-29T08:54:29.573024+0000","last_undegraded":"2024-03-29T08:54:29.573024+0000","last_fullsized":"2024-03-29T08:54:29.573024+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.551769+0000","last_change":"2024-03-29T08:54:29.549619+0000","last_active":"2024-03-29T08:54:29.551769+0000","last_peered":"2024-03-29T08:54:29.551769+0000","last_clean":"2024-03-29T08:54:29.551769+0000","last_became_active":"2024-03-29T08:54:29.549209+0000","last_became_peered":"2024-03-29T08:54:29.549209+0000","last_unstale":"2024-03-29T08:54:29.551769+0000","last_undegraded":"2024-03-29T08:54:29.551769+0000","last_fullsized":"2024-03-29T08:54:29.551769+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.553956+0000","last_change":"2024-03-29T08:54:29.546972+0000","last_active":"2024-03-29T08:54:29.553956+0000","last_peered":"2024-03-29T08:54:29.553956+0000","last_clean":"2024-03-29T08:54:29.553956+0000","last_became_active":"2024-03-29T08:54:29.546652+0000","last_became_peered":"2024-03-29T08:54:29.546652+0000","last_unstale":"2024-03-29T08:54:29.553956+0000","last_undegraded":"2024-03-29T08:54:29.553956+0000","last_fullsized":"2024-03-29T08:54:29.553956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.552429+0000","last_change":"2024-03-29T08:54:29.551516+0000","last_active":"2024-03-29T08:54:29.552429+0000","last_peered":"2024-03-29T08:54:29.552429+0000","last_clean":"2024-03-29T08:54:29.552429+0000","last_became_active":"2024-03-29T08:54:29.551142+0000","last_became_peered":"2024-03-29T08:54:29.551142+0000","last_unstale":"2024-03-29T08:54:29.552429+0000","last_undegraded":"2024-03-29T08:54:29.552429+0000","last_fullsized":"2024-03-29T08:54:29.552429+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.574381+0000","last_change":"2024-03-29T08:54:29.572921+0000","last_active":"2024-03-29T08:54:29.574381+0000","last_peered":"2024-03-29T08:54:29.574381+0000","last_clean":"2024-03-29T08:54:29.574381+0000","last_became_active":"2024-03-29T08:54:29.571269+0000","last_became_peered":"2024-03-29T08:54:29.571269+0000","last_unstale":"2024-03-29T08:54:29.574381+0000","last_undegraded":"2024-03-29T08:54:29.574381+0000","last_fullsized":"2024-03-29T08:54:29.574381+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":23768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T08:54:33.314 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T08:54:33.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.497+0000 7f664fc00700  1  Processor -- start
2024-03-29T08:54:33.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.497+0000 7f664fc00700  1 --  start start
2024-03-29T08:54:33.499 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664fc00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6648066a30 0x7f6648066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.499 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664fc00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f66480676e0 0x7f6648125c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.499 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664fc00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6648063cb0 con 0x7f6648067300
2024-03-29T08:54:33.499 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664fc00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66480694e0 con 0x7f66480676e0
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664fc00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6648068e70 con 0x7f6648066a30
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664d200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6648066a30 0x7f6648066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664d200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6648066a30 0x7f6648066e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53470/0 (socket says 172.21.15.171:53470)
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664d200700  1 -- 172.21.15.171:0/1533190012 learned_addr learned my addr 172.21.15.171:0/1533190012 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664dc00700  1 --2- 172.21.15.171:0/1533190012 >> v2:172.21.15.171:3300/0 conn(0x7f66480676e0 0x7f6648125c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664d200700  1 -- 172.21.15.171:0/1533190012 >> v2:172.21.15.171:3300/0 conn(0x7f66480676e0 msgr2=0x7f6648125c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664d200700  1 --2- 172.21.15.171:0/1533190012 >> v2:172.21.15.171:3300/0 conn(0x7f66480676e0 0x7f6648125c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664d200700  1 -- 172.21.15.171:0/1533190012 >> v1:172.21.15.171:6789/0 conn(0x7f6648067300 legacy=0x7f6648125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.499+0000 7f664d200700  1 -- 172.21.15.171:0/1533190012 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648069bf0 con 0x7f6648066a30
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664d200700  1 --2- 172.21.15.171:0/1533190012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6648066a30 0x7f6648066e10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f663c009820 tx=0x7f663c0090f0).ready entity=mon.1 client_cookie=772c20b60780178 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f6647400700  1 -- 172.21.15.171:0/1533190012 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c009160 con 0x7f6648066a30
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f6647400700  1 -- 172.21.15.171:0/1533190012 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c00b580 con 0x7f6648066a30
2024-03-29T08:54:33.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f6647400700  1 -- 172.21.15.171:0/1533190012 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00b920 con 0x7f6648066a30
2024-03-29T08:54:33.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664fc00700  1 -- 172.21.15.171:0/1533190012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6648066a30 msgr2=0x7f6648066e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664fc00700  1 --2- 172.21.15.171:0/1533190012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6648066a30 0x7f6648066e10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f663c009820 tx=0x7f663c0090f0).stop
2024-03-29T08:54:33.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664fc00700  1 -- 172.21.15.171:0/1533190012 shutdown_connections
2024-03-29T08:54:33.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664fc00700  1 --2- 172.21.15.171:0/1533190012 >> v2:172.21.15.171:3300/0 conn(0x7f66480676e0 0x7f6648125c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664fc00700  1 --2- 172.21.15.171:0/1533190012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6648066a30 0x7f6648066e10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664fc00700  1 -- 172.21.15.171:0/1533190012 >> 172.21.15.171:0/1533190012 conn(0x7f66480992c0 msgr2=0x7f6648064c50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:33.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.500+0000 7f664fc00700  1 -- 172.21.15.171:0/1533190012 shutdown_connections
2024-03-29T08:54:33.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.501+0000 7f664fc00700  1 -- 172.21.15.171:0/1533190012 wait complete.
2024-03-29T08:54:33.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1  Processor -- start
2024-03-29T08:54:33.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1 --  start start
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6648066a30 0x7f6648111520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6648067300 0x7f6648111a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66480676e0 0x7f6648111f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6648114d40 con 0x7f6648066a30
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6648114190 con 0x7f66480676e0
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.502+0000 7f664fc00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f664811ca60 con 0x7f6648067300
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6648066a30 0x7f6648111520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f6647e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6648067300 0x7f6648111a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6648066a30 0x7f6648111520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47270/0 (socket says 172.21.15.171:47270)
2024-03-29T08:54:33.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 -- 172.21.15.171:0/3584981349 learned_addr learned my addr 172.21.15.171:0/3584981349 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f6647e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6648067300 0x7f6648111a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:48034/0 (socket says 172.21.15.171:48034)
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664dc00700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66480676e0 0x7f6648111f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 -- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6648067300 msgr2=0x7f6648111a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6648067300 0x7f6648111a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 -- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66480676e0 msgr2=0x7f6648111f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66480676e0 0x7f6648111f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 -- 172.21.15.171:0/3584981349 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c009310 con 0x7f6648066a30
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664dc00700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66480676e0 0x7f6648111f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.503+0000 7f664d200700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6648066a30 0x7f6648111520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f663c009ec0 tx=0x7f663c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.504+0000 7f6644c00700  1 -- 172.21.15.171:0/3584981349 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c006990 con 0x7f6648066a30
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.504+0000 7f6644c00700  1 -- 172.21.15.171:0/3584981349 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c00b6f0 con 0x7f6648066a30
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.504+0000 7f6644c00700  1 -- 172.21.15.171:0/3584981349 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00bc90 con 0x7f6648066a30
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.504+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6648114970 con 0x7f6648066a30
2024-03-29T08:54:33.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.504+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66481123f0 con 0x7f6648066a30
2024-03-29T08:54:33.506 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.505+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6648066370 con 0x7f6648066a30
2024-03-29T08:54:33.506 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.505+0000 7f6644c00700  1 -- 172.21.15.171:0/3584981349 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f663c01c630 con 0x7f6648066a30
2024-03-29T08:54:33.506 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.506+0000 7f6644c00700  1 -- 172.21.15.171:0/3584981349 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f663c056f70 con 0x7f6648066a30
2024-03-29T08:54:33.509 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.509+0000 7f6644c00700  1 -- 172.21.15.171:0/3584981349 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f663c007560 con 0x7f6648066a30
2024-03-29T08:54:33.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.657+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 --> v1:172.21.15.171:6816/38531 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66481250c0 con 0x7f6628041b80
2024-03-29T08:54:33.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.658+0000 7f6644c00700  1 -- 172.21.15.171:0/3584981349 <== mgr.4098 v1:172.21.15.171:6816/38531 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32746 (unknown 2965378022 0 2455282933) 0x7f66481250c0 con 0x7f6628041b80
2024-03-29T08:54:33.658 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:33.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 >> v1:172.21.15.171:6816/38531 conn(0x7f6628041b80 legacy=0x7f6628044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6648066a30 msgr2=0x7f6648111520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6648066a30 0x7f6648111520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f663c009ec0 tx=0x7f663c017000).stop
2024-03-29T08:54:33.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 shutdown_connections
2024-03-29T08:54:33.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66480676e0 0x7f6648111f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6648066a30 0x7f6648111520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 --2- 172.21.15.171:0/3584981349 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6648067300 0x7f6648111a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 >> 172.21.15.171:0/3584981349 conn(0x7f66480992c0 msgr2=0x7f664811d7d0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:33.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.660+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 shutdown_connections
2024-03-29T08:54:33.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.661+0000 7f664fc00700  1 -- 172.21.15.171:0/3584981349 wait complete.
2024-03-29T08:54:33.662 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T08:54:33.677 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-03-29T08:54:32.500855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188792,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298568,"statfs":{"total":386547056640,"available":385329733632,"internally_reserved":0,"allocated":417792,"data_stored":106325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.571504+0000","last_change":"2024-03-29T08:54:29.570074+0000","last_active":"2024-03-29T08:54:29.571504+0000","last_peered":"2024-03-29T08:54:29.571504+0000","last_clean":"2024-03-29T08:54:29.571504+0000","last_became_active":"2024-03-29T08:54:29.569664+0000","last_became_peered":"2024-03-29T08:54:29.569664+0000","last_unstale":"2024-03-29T08:54:29.571504+0000","last_undegraded":"2024-03-29T08:54:29.571504+0000","last_fullsized":"2024-03-29T08:54:29.571504+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.574223+0000","last_change":"2024-03-29T08:54:29.572552+0000","last_active":"2024-03-29T08:54:29.574223+0000","last_peered":"2024-03-29T08:54:29.574223+0000","last_clean":"2024-03-29T08:54:29.574223+0000","last_became_active":"2024-03-29T08:54:29.569749+0000","last_became_peered":"2024-03-29T08:54:29.569749+0000","last_unstale":"2024-03-29T08:54:29.574223+0000","last_undegraded":"2024-03-29T08:54:29.574223+0000","last_fullsized":"2024-03-29T08:54:29.574223+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.571469+0000","last_change":"2024-03-29T08:54:29.570245+0000","last_active":"2024-03-29T08:54:29.571469+0000","last_peered":"2024-03-29T08:54:29.571469+0000","last_clean":"2024-03-29T08:54:29.571469+0000","last_became_active":"2024-03-29T08:54:29.569819+0000","last_became_peered":"2024-03-29T08:54:29.569819+0000","last_unstale":"2024-03-29T08:54:29.571469+0000","last_undegraded":"2024-03-29T08:54:29.571469+0000","last_fullsized":"2024-03-29T08:54:29.571469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.551772+0000","last_change":"2024-03-29T08:54:29.549849+0000","last_active":"2024-03-29T08:54:29.551772+0000","last_peered":"2024-03-29T08:54:29.551772+0000","last_clean":"2024-03-29T08:54:29.551772+0000","last_became_active":"2024-03-29T08:54:29.548886+0000","last_became_peered":"2024-03-29T08:54:29.548886+0000","last_unstale":"2024-03-29T08:54:29.551772+0000","last_undegraded":"2024-03-29T08:54:29.551772+0000","last_fullsized":"2024-03-29T08:54:29.551772+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.573024+0000","last_change":"2024-03-29T08:54:29.570495+0000","last_active":"2024-03-29T08:54:29.573024+0000","last_peered":"2024-03-29T08:54:29.573024+0000","last_clean":"2024-03-29T08:54:29.573024+0000","last_became_active":"2024-03-29T08:54:29.570203+0000","last_became_peered":"2024-03-29T08:54:29.570203+0000","last_unstale":"2024-03-29T08:54:29.573024+0000","last_undegraded":"2024-03-29T08:54:29.573024+0000","last_fullsized":"2024-03-29T08:54:29.573024+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.551769+0000","last_change":"2024-03-29T08:54:29.549619+0000","last_active":"2024-03-29T08:54:29.551769+0000","last_peered":"2024-03-29T08:54:29.551769+0000","last_clean":"2024-03-29T08:54:29.551769+0000","last_became_active":"2024-03-29T08:54:29.549209+0000","last_became_peered":"2024-03-29T08:54:29.549209+0000","last_unstale":"2024-03-29T08:54:29.551769+0000","last_undegraded":"2024-03-29T08:54:29.551769+0000","last_fullsized":"2024-03-29T08:54:29.551769+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.553956+0000","last_change":"2024-03-29T08:54:29.546972+0000","last_active":"2024-03-29T08:54:29.553956+0000","last_peered":"2024-03-29T08:54:29.553956+0000","last_clean":"2024-03-29T08:54:29.553956+0000","last_became_active":"2024-03-29T08:54:29.546652+0000","last_became_peered":"2024-03-29T08:54:29.546652+0000","last_unstale":"2024-03-29T08:54:29.553956+0000","last_undegraded":"2024-03-29T08:54:29.553956+0000","last_fullsized":"2024-03-29T08:54:29.553956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.552429+0000","last_change":"2024-03-29T08:54:29.551516+0000","last_active":"2024-03-29T08:54:29.552429+0000","last_peered":"2024-03-29T08:54:29.552429+0000","last_clean":"2024-03-29T08:54:29.552429+0000","last_became_active":"2024-03-29T08:54:29.551142+0000","last_became_peered":"2024-03-29T08:54:29.551142+0000","last_unstale":"2024-03-29T08:54:29.552429+0000","last_undegraded":"2024-03-29T08:54:29.552429+0000","last_fullsized":"2024-03-29T08:54:29.552429+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-03-29T08:54:29.574381+0000","last_change":"2024-03-29T08:54:29.572921+0000","last_active":"2024-03-29T08:54:29.574381+0000","last_peered":"2024-03-29T08:54:29.574381+0000","last_clean":"2024-03-29T08:54:29.574381+0000","last_became_active":"2024-03-29T08:54:29.571269+0000","last_became_peered":"2024-03-29T08:54:29.571269+0000","last_unstale":"2024-03-29T08:54:29.574381+0000","last_undegraded":"2024-03-29T08:54:29.574381+0000","last_fullsized":"2024-03-29T08:54:29.574381+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":23768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T08:54:33.678 INFO:tasks.ceph.ceph_manager.ceph:clean!
2024-03-29T08:54:33.679 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy...
2024-03-29T08:54:33.679 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy
2024-03-29T08:54:33.679 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json
2024-03-29T08:54:33.862 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.863+0000 7fe078800700  1  Processor -- start
2024-03-29T08:54:33.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.863+0000 7fe078800700  1 --  start start
2024-03-29T08:54:33.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe078800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe070066a30 0x7fe070066e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe078800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe070067300 0x7fe070125530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe078800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0700676e0 0x7fe070125a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe078800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0700694e0 con 0x7fe070067300
2024-03-29T08:54:33.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe078800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe070068e70 con 0x7fe0700676e0
2024-03-29T08:54:33.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe078800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe070063e80 con 0x7fe070066a30
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe070067300 0x7fe070125530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe070066a30 0x7fe070066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe070067300 0x7fe070125530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47286/0 (socket says 172.21.15.171:47286)
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075400700  1 -- 172.21.15.171:0/4290742586 learned_addr learned my addr 172.21.15.171:0/4290742586 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe076800700  1 --2- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0700676e0 0x7fe070125a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075e00700  1 -- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0700676e0 msgr2=0x7fe070125a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075e00700  1 --2- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0700676e0 0x7fe070125a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075e00700  1 -- 172.21.15.171:0/4290742586 >> v2:172.21.15.171:3300/0 conn(0x7fe070067300 msgr2=0x7fe070125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075e00700  1 --2- 172.21.15.171:0/4290742586 >> v2:172.21.15.171:3300/0 conn(0x7fe070067300 0x7fe070125530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075e00700  1 -- 172.21.15.171:0/4290742586 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070063cb0 con 0x7fe070066a30
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.864+0000 7fe075400700  1 --2- 172.21.15.171:0/4290742586 >> v2:172.21.15.171:3300/0 conn(0x7fe070067300 0x7fe070125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe075e00700  1 --2- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe070066a30 0x7fe070066e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fe064009760 tx=0x7fe064006f40).ready entity=mon.2 client_cookie=9a5925cd3c1f7fc5 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe074a00700  1 -- 172.21.15.171:0/4290742586 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064005880 con 0x7fe070066a30
2024-03-29T08:54:33.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe074a00700  1 -- 172.21.15.171:0/4290742586 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0640059e0 con 0x7fe070066a30
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe074a00700  1 -- 172.21.15.171:0/4290742586 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064005d60 con 0x7fe070066a30
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe078800700  1 -- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe070066a30 msgr2=0x7fe070066e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe078800700  1 --2- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe070066a30 0x7fe070066e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fe064009760 tx=0x7fe064006f40).stop
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe078800700  1 -- 172.21.15.171:0/4290742586 shutdown_connections
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe078800700  1 --2- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0700676e0 0x7fe070125a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe078800700  1 --2- 172.21.15.171:0/4290742586 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe070066a30 0x7fe070066e10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe078800700  1 --2- 172.21.15.171:0/4290742586 >> v2:172.21.15.171:3300/0 conn(0x7fe070067300 0x7fe070125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.865+0000 7fe078800700  1 -- 172.21.15.171:0/4290742586 >> 172.21.15.171:0/4290742586 conn(0x7fe0700992c0 msgr2=0x7fe070064c50 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.866+0000 7fe078800700  1 -- 172.21.15.171:0/4290742586 shutdown_connections
2024-03-29T08:54:33.867 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.866+0000 7fe078800700  1 -- 172.21.15.171:0/4290742586 wait complete.
2024-03-29T08:54:33.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.867+0000 7fe078800700  1  Processor -- start
2024-03-29T08:54:33.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.868+0000 7fe078800700  1 --  start start
2024-03-29T08:54:33.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.868+0000 7fe078800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe070066a30 0x7fe070111890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.868+0000 7fe078800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe070067300 0x7fe070111d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe078800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe0700676e0 0x7fe070112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe078800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070114630 con 0x7fe070067300
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe078800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0701254d0 con 0x7fe070066a30
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe078800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe070114b60 con 0x7fe0700676e0
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe070066a30 0x7fe070111890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe070067300 0x7fe070111d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe070066a30 0x7fe070111890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53494/0 (socket says 172.21.15.171:53494)
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe070067300 0x7fe070111d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47298/0 (socket says 172.21.15.171:47298)
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 -- 172.21.15.171:0/2422487787 learned_addr learned my addr 172.21.15.171:0/2422487787 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe076800700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe0700676e0 0x7fe070112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 -- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe0700676e0 msgr2=0x7fe070112270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe0700676e0 0x7fe070112270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 -- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe070067300 msgr2=0x7fe070111d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:33.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe070067300 0x7fe070111d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 -- 172.21.15.171:0/2422487787 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060009370 con 0x7fe070066a30
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.869+0000 7fe075e00700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe070066a30 0x7fe070111890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe064009d50 tx=0x7fe064015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.870+0000 7fe06a000700  1 -- 172.21.15.171:0/2422487787 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640068e0 con 0x7fe070066a30
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.870+0000 7fe06a000700  1 -- 172.21.15.171:0/2422487787 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06400d4a0 con 0x7fe070066a30
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.870+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe064009250 con 0x7fe070066a30
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.870+0000 7fe06a000700  1 -- 172.21.15.171:0/2422487787 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06400d840 con 0x7fe070066a30
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.870+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe070112760 con 0x7fe070066a30
2024-03-29T08:54:33.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.871+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe070114f70 con 0x7fe070066a30
2024-03-29T08:54:33.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.871+0000 7fe06a000700  1 -- 172.21.15.171:0/2422487787 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7fe06400dc30 con 0x7fe070066a30
2024-03-29T08:54:33.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.872+0000 7fe06a000700  1 -- 172.21.15.171:0/2422487787 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe064056100 con 0x7fe070066a30
2024-03-29T08:54:33.875 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:33.875+0000 7fe06a000700  1 -- 172.21.15.171:0/2422487787 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7fe064058640 con 0x7fe070066a30
2024-03-29T08:54:34.049 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.049+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe070096a20 con 0x7fe070066a30
2024-03-29T08:54:34.049 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.050+0000 7fe06a000700  1 -- 172.21.15.171:0/2422487787 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0  v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fe0640580c0 con 0x7fe070066a30
2024-03-29T08:54:34.049 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:34.051 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.051+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 >> v1:172.21.15.171:6816/38531 conn(0x7fe054041bb0 legacy=0x7fe054044070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.051 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.051+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe070066a30 msgr2=0x7fe070111890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.051 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.051+0000 7fe078800700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe070066a30 0x7fe070111890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe064009d50 tx=0x7fe064015000).stop
2024-03-29T08:54:34.051 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.052+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 shutdown_connections
2024-03-29T08:54:34.051 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.052+0000 7fe078800700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe0700676e0 0x7fe070112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.052 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.052+0000 7fe078800700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe070066a30 0x7fe070111890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.052 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.052+0000 7fe078800700  1 --2- 172.21.15.171:0/2422487787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe070067300 0x7fe070111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.052 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.052+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 >> 172.21.15.171:0/2422487787 conn(0x7fe0700992c0 msgr2=0x7fe070097cb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:34.052 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.052+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 shutdown_connections
2024-03-29T08:54:34.052 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.052+0000 7fe078800700  1 -- 172.21.15.171:0/2422487787 wait complete.
2024-03-29T08:54:34.068 INFO:teuthology.orchestra.run.smithi171.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]}
2024-03-29T08:54:34.069 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done
2024-03-29T08:54:34.069 INFO:teuthology.run_tasks:Running task exec...
2024-03-29T08:54:34.079 INFO:teuthology.task.exec:Executing custom commands...
2024-03-29T08:54:34.079 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:54:34.079 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific'
2024-03-29T08:54:34.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.257+0000 7f0a49e00700  1  Processor -- start
2024-03-29T08:54:34.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.257+0000 7f0a49e00700  1 --  start start
2024-03-29T08:54:34.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a49e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f0a441253c0 0x7f0a441257a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a49e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a4408e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a49e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a4408e570 0x7f0a4408ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a49e00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a44068dd0 con 0x7f0a441253c0
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a49e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4408eef0 con 0x7f0a4408e570
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a49e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4406aaf0 con 0x7f0a44125c90
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f0a441253c0 0x7f0a441257a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a4408e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a43400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a4408e570 0x7f0a4408ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f0a441253c0 0x7f0a441257a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47304/0 (socket says 172.21.15.171:47304)
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 -- 172.21.15.171:0/2826940850 learned_addr learned my addr 172.21.15.171:0/2826940850 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 -- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 msgr2=0x7f0a4408e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a4408e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 -- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a4408e570 msgr2=0x7f0a4408ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a4408e570 0x7f0a4408ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42a00700  1 -- 172.21.15.171:0/2826940850 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4408f990 con 0x7f0a441253c0
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.258+0000 7f0a42000700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a4408e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:34.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a42a00700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a441253c0 0x7f0a441257a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f0a34009820 tx=0x7f0a340090f0).ready entity=mon.0 client_cookie=dee04a0632ba2e7c server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:34.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a41600700  1 -- 172.21.15.171:0/2826940850 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34009160 con 0x7f0a441253c0
2024-03-29T08:54:34.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a41600700  1 -- 172.21.15.171:0/2826940850 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400d4a0 con 0x7f0a441253c0
2024-03-29T08:54:34.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a41600700  1 -- 172.21.15.171:0/2826940850 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400d840 con 0x7f0a441253c0
2024-03-29T08:54:34.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a49e00700  1 -- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a441253c0 msgr2=0x7f0a441257a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a49e00700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a441253c0 0x7f0a441257a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f0a34009820 tx=0x7f0a340090f0).stop
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a49e00700  1 -- 172.21.15.171:0/2826940850 shutdown_connections
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a49e00700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a4408e570 0x7f0a4408ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a49e00700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a441253c0 0x7f0a441257a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a49e00700  1 --2- 172.21.15.171:0/2826940850 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a4408e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.259+0000 7f0a49e00700  1 -- 172.21.15.171:0/2826940850 >> 172.21.15.171:0/2826940850 conn(0x7f0a44098d90 msgr2=0x7f0a44094bd0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.260+0000 7f0a49e00700  1 -- 172.21.15.171:0/2826940850 shutdown_connections
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.260+0000 7f0a49e00700  1 -- 172.21.15.171:0/2826940850 wait complete.
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.261+0000 7f0a49e00700  1  Processor -- start
2024-03-29T08:54:34.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.262+0000 7f0a49e00700  1 --  start start
2024-03-29T08:54:34.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.262+0000 7f0a49e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a4408e570 0x7f0a44082fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a49e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a441253c0 0x7f0a440834c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a49e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a440839b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a49e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44083ea0 con 0x7f0a4408e570
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a49e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44084260 con 0x7f0a441253c0
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a49e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44085270 con 0x7f0a44125c90
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a4408e570 0x7f0a44082fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a43400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a440839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a441253c0 0x7f0a440834c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a43400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a440839b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:48074/0 (socket says 172.21.15.171:48074)
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a4408e570 0x7f0a44082fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47310/0 (socket says 172.21.15.171:47310)
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a43400700  1 -- 172.21.15.171:0/503580359 learned_addr learned my addr 172.21.15.171:0/503580359 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42000700  1 -- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 msgr2=0x7f0a440839b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42000700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a440839b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42000700  1 -- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a4408e570 msgr2=0x7f0a44082fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42000700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a4408e570 0x7f0a44082fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42000700  1 -- 172.21.15.171:0/503580359 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300092a0 con 0x7f0a441253c0
2024-03-29T08:54:34.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a43400700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a440839b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:34.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.263+0000 7f0a42000700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a441253c0 0x7f0a440834c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0a3000e950 tx=0x7f0a30009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:34.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.264+0000 7f0a3b400700  1 -- 172.21.15.171:0/503580359 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30009580 con 0x7f0a441253c0
2024-03-29T08:54:34.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.264+0000 7f0a3b400700  1 -- 172.21.15.171:0/503580359 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a30012600 con 0x7f0a441253c0
2024-03-29T08:54:34.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.264+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a34009310 con 0x7f0a441253c0
2024-03-29T08:54:34.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.264+0000 7f0a3b400700  1 -- 172.21.15.171:0/503580359 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a300129a0 con 0x7f0a441253c0
2024-03-29T08:54:34.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.264+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a44085a50 con 0x7f0a441253c0
2024-03-29T08:54:34.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.265+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a440840b0 con 0x7f0a441253c0
2024-03-29T08:54:34.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.265+0000 7f0a3b400700  1 -- 172.21.15.171:0/503580359 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f0a30012d10 con 0x7f0a441253c0
2024-03-29T08:54:34.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.266+0000 7f0a3b400700  1 -- 172.21.15.171:0/503580359 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f0a300555d0 con 0x7f0a441253c0
2024-03-29T08:54:34.269 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.269+0000 7f0a3b400700  1 -- 172.21.15.171:0/503580359 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f0a30035fd0 con 0x7f0a441253c0
2024-03-29T08:54:34.430 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.430+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7f0a440952e0 con 0x7f0a441253c0
2024-03-29T08:54:34.554 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.555+0000 7f0a3b400700  1 -- 172.21.15.171:0/503580359 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v13) v1 ==== 143+0+0 (secure 0 0 0) 0x7f0a300397c0 con 0x7f0a441253c0
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 >> v1:172.21.15.171:6816/38531 conn(0x7f0a24041b50 legacy=0x7f0a24044010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a441253c0 msgr2=0x7f0a440834c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a441253c0 0x7f0a440834c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0a3000e950 tx=0x7f0a30009060).stop
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 shutdown_connections
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0a44125c90 0x7f0a440839b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a4408e570 0x7f0a44082fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 --2- 172.21.15.171:0/503580359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a441253c0 0x7f0a440834c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 >> 172.21.15.171:0/503580359 conn(0x7f0a44098d90 msgr2=0x7f0a44090680 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 shutdown_connections
2024-03-29T08:54:34.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.557+0000 7f0a49e00700  1 -- 172.21.15.171:0/503580359 wait complete.
2024-03-29T08:54:34.558 INFO:teuthology.orchestra.run.smithi171.stderr:set require_min_compat_client to pacific
2024-03-29T08:54:34.574 INFO:teuthology.run_tasks:Running task print...
2024-03-29T08:54:34.582 INFO:teuthology.task.print:**** done ceph
2024-03-29T08:54:34.582 INFO:teuthology.run_tasks:Running task print...
2024-03-29T08:54:34.590 INFO:teuthology.task.print:*** upgrading, no cephfs present
2024-03-29T08:54:34.590 INFO:teuthology.run_tasks:Running task exec...
2024-03-29T08:54:34.598 INFO:teuthology.task.exec:Executing custom commands...
2024-03-29T08:54:34.598 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T08:54:34.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump'
2024-03-29T08:54:34.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.776+0000 7f59c9a00700  1  Processor -- start
2024-03-29T08:54:34.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.776+0000 7f59c9a00700  1 --  start start
2024-03-29T08:54:34.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c9a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4069190 0x7f59c4069570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c9a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f59c4069a60 0x7f59c4125330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c9a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4125820 0x7f59c4125ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c9a00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c408f6f0 con 0x7f59c4069a60
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c9a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4091c50 con 0x7f59c4125820
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c9a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4068dd0 con 0x7f59c4069190
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c2000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f59c4069a60 0x7f59c4125330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c2a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4069190 0x7f59c4069570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c3400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4125820 0x7f59c4125ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c2000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f59c4069a60 0x7f59c4125330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47318/0 (socket says 172.21.15.171:47318)
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.777+0000 7f59c2000700  1 -- 172.21.15.171:0/4291590171 learned_addr learned my addr 172.21.15.171:0/4291590171 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c2a00700  1 -- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4125820 msgr2=0x7f59c4125ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c2a00700  1 --2- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4125820 0x7f59c4125ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c2a00700  1 -- 172.21.15.171:0/4291590171 >> v2:172.21.15.171:3300/0 conn(0x7f59c4069a60 msgr2=0x7f59c4125330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T08:54:34.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c2a00700  1 --2- 172.21.15.171:0/4291590171 >> v2:172.21.15.171:3300/0 conn(0x7f59c4069a60 0x7f59c4125330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c2a00700  1 -- 172.21.15.171:0/4291590171 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4126190 con 0x7f59c4069190
2024-03-29T08:54:34.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c3400700  1 --2- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4125820 0x7f59c4125ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed!
2024-03-29T08:54:34.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c2a00700  1 --2- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4069190 0x7f59c4069570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f59b4009790 tx=0x7f59b4009060).ready entity=mon.2 client_cookie=62fd521b3e3f3a96 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:34.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c1600700  1 -- 172.21.15.171:0/4291590171 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40090d0 con 0x7f59c4069190
2024-03-29T08:54:34.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c1600700  1 -- 172.21.15.171:0/4291590171 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b400d4a0 con 0x7f59c4069190
2024-03-29T08:54:34.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.778+0000 7f59c1600700  1 -- 172.21.15.171:0/4291590171 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b400d820 con 0x7f59c4069190
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 -- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4069190 msgr2=0x7f59c4069570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 --2- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4069190 0x7f59c4069570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f59b4009790 tx=0x7f59b4009060).stop
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 -- 172.21.15.171:0/4291590171 shutdown_connections
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 --2- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4125820 0x7f59c4125ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 --2- 172.21.15.171:0/4291590171 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4069190 0x7f59c4069570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 --2- 172.21.15.171:0/4291590171 >> v2:172.21.15.171:3300/0 conn(0x7f59c4069a60 0x7f59c4125330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 -- 172.21.15.171:0/4291590171 >> 172.21.15.171:0/4291590171 conn(0x7f59c4098d20 msgr2=0x7f59c4094bb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 -- 172.21.15.171:0/4291590171 shutdown_connections
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.779+0000 7f59c9a00700  1 -- 172.21.15.171:0/4291590171 wait complete.
2024-03-29T08:54:34.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.781+0000 7f59c9a00700  1  Processor -- start
2024-03-29T08:54:34.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.781+0000 7f59c9a00700  1 --  start start
2024-03-29T08:54:34.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c9a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4069190 0x7f59c4122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c9a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c4069a60 0x7f59c4122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c9a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4125820 0x7f59c4122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c9a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4125460 con 0x7f59c4069a60
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c9a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4123560 con 0x7f59c4069190
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c9a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40839d0 con 0x7f59c4125820
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4069190 0x7f59c4122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c3400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4125820 0x7f59c4122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4069190 0x7f59c4122590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53530/0 (socket says 172.21.15.171:53530)
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 -- 172.21.15.171:0/1188445179 learned_addr learned my addr 172.21.15.171:0/1188445179 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2000700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c4069a60 0x7f59c4122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 -- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4125820 msgr2=0x7f59c4122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4125820 0x7f59c4122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 -- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c4069a60 msgr2=0x7f59c4122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c4069a60 0x7f59c4122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.782+0000 7f59c2a00700  1 -- 172.21.15.171:0/1188445179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc009a20 con 0x7f59c4069190
2024-03-29T08:54:34.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.783+0000 7f59c2a00700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4069190 0x7f59c4122590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f59c406a5d0 tx=0x7f59b4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T08:54:34.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.783+0000 7f59baa00700  1 -- 172.21.15.171:0/1188445179 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40127f0 con 0x7f59c4069190
2024-03-29T08:54:34.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.783+0000 7f59baa00700  1 -- 172.21.15.171:0/1188445179 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4012970 con 0x7f59c4069190
2024-03-29T08:54:34.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.783+0000 7f59baa00700  1 -- 172.21.15.171:0/1188445179 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4012d30 con 0x7f59c4069190
2024-03-29T08:54:34.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.783+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b40092a0 con 0x7f59c4069190
2024-03-29T08:54:34.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.783+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c4134b30 con 0x7f59c4069190
2024-03-29T08:54:34.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.784+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c4123820 con 0x7f59c4069190
2024-03-29T08:54:34.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.784+0000 7f59baa00700  1 -- 172.21.15.171:0/1188445179 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) v1 ==== 48491+0+0 (secure 0 0 0) 0x7f59b401c630 con 0x7f59c4069190
2024-03-29T08:54:34.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.785+0000 7f59baa00700  1 -- 172.21.15.171:0/1188445179 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f59b40565f0 con 0x7f59c4069190
2024-03-29T08:54:34.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.789+0000 7f59baa00700  1 -- 172.21.15.171:0/1188445179 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+131111 (secure 0 0 0) 0x7f59b401d5d0 con 0x7f59c4069190
2024-03-29T08:54:34.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.960+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f59c4123fe0 con 0x7f59c4069190
2024-03-29T08:54:34.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.960+0000 7f59baa00700  1 -- 172.21.15.171:0/1188445179 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) v1 ==== 75+0+358 (secure 0 0 0) 0x7f59b401d5d0 con 0x7f59c4069190
2024-03-29T08:54:34.960 INFO:teuthology.orchestra.run.smithi171.stdout:e1
2024-03-29T08:54:34.960 INFO:teuthology.orchestra.run.smithi171.stdout:enable_multiple, ever_enabled_multiple: 1,1
2024-03-29T08:54:34.960 INFO:teuthology.orchestra.run.smithi171.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
2024-03-29T08:54:34.960 INFO:teuthology.orchestra.run.smithi171.stdout:legacy client fscid: -1
2024-03-29T08:54:34.960 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T08:54:34.960 INFO:teuthology.orchestra.run.smithi171.stdout:No filesystems configured
2024-03-29T08:54:34.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 >> v1:172.21.15.171:6816/38531 conn(0x7f59a4041b80 legacy=0x7f59a4044040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4069190 msgr2=0x7f59c4122590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T08:54:34.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4069190 0x7f59c4122590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f59c406a5d0 tx=0x7f59b4016000).stop
2024-03-29T08:54:34.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 shutdown_connections
2024-03-29T08:54:34.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f59c4125820 0x7f59c4122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c4069190 0x7f59c4122590 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 --2- 172.21.15.171:0/1188445179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c4069a60 0x7f59c4122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2024-03-29T08:54:34.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 >> 172.21.15.171:0/1188445179 conn(0x7f59c4098d20 msgr2=0x7f59c4090a30 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T08:54:34.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 shutdown_connections
2024-03-29T08:54:34.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T08:54:34.962+0000 7f59c9a00700  1 -- 172.21.15.171:0/1188445179 wait complete.
2024-03-29T08:54:34.963 INFO:teuthology.orchestra.run.smithi171.stderr:dumped fsmap epoch 1
2024-03-29T08:54:34.978 INFO:teuthology.run_tasks:Running task install.upgrade...
2024-03-29T08:54:34.989 INFO:teuthology.task.install:project ceph config {'mon.a': None} overrides {'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}
2024-03-29T08:54:34.989 INFO:teuthology.task.install:remote ubuntu@smithi171.front.sepia.ceph.com config {'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}
2024-03-29T08:54:34.989 INFO:teuthology.task.install:extra packages: []
2024-03-29T08:54:34.995 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']}
2024-03-29T08:54:34.995 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd
2024-03-29T08:54:34.995 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}'
2024-03-29T08:54:35.048 INFO:teuthology.orchestra.run.smithi171.stdout:16.2.15-0.el8
2024-03-29T08:54:35.048 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.15-0.el8
2024-03-29T08:54:35.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d0e392d9aee635f2b65768c460c7a151ead7a5e2
2024-03-29T08:54:35.193 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.15-0.el8 to 18.2.2-1015.gd0e392d9
2024-03-29T08:54:35.193 INFO:teuthology.task.install.rpm:Host smithi171 is: centos 8 x86_64
2024-03-29T08:54:35.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d0e392d9aee635f2b65768c460c7a151ead7a5e2
2024-03-29T08:54:35.404 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/centos/8/flavors/default/
2024-03-29T08:54:35.405 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/yum.repos.d/ceph.repo
2024-03-29T08:54:35.582 INFO:teuthology.packaging:Writing yum repo:
[ceph]
name=ceph packages for $basearch
baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/centos/8/flavors/default/$basearch
enabled=1
gpgcheck=0
type=rpm-md

[ceph-noarch]
name=ceph noarch packages
baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/centos/8/flavors/default/noarch
enabled=1
gpgcheck=0
type=rpm-md

[ceph-source]
name=ceph source packages
baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/centos/8/flavors/default/SRPMS
enabled=1
gpgcheck=0
type=rpm-md

2024-03-29T08:54:35.582 DEBUG:teuthology.orchestra.run.smithi171:> set -ex
2024-03-29T08:54:35.582 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo
2024-03-29T08:54:35.649 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d0e392d9aee635f2b65768c460c7a151ead7a5e2/;g' /etc/yum.repos.d/ceph.repo ; fi
2024-03-29T08:54:35.758 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig
2024-03-29T08:54:35.826 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf
2024-03-29T08:54:35.869 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1
2024-03-29T08:54:35.896 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all
2024-03-29T08:54:36.281 INFO:teuthology.orchestra.run.smithi171.stdout:71 files removed
2024-03-29T08:54:36.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd
2024-03-29T08:54:37.231 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64                        223 kB/s |  80 kB     00:00
2024-03-29T08:54:37.566 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages                             33 kB/s | 9.9 kB     00:00
2024-03-29T08:54:37.933 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages                            4.4 kB/s | 1.5 kB     00:00
2024-03-29T09:06:56.202 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - AppStream                      39 kB/s |  28 MB     12:18
2024-03-29T09:07:03.002 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - BaseOS                        7.2 MB/s |  10 MB     00:01
2024-03-29T09:07:05.044 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - Extras                         48 kB/s |  18 kB     00:00
2024-03-29T09:07:05.329 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - Extras common packages         44 kB/s | 7.5 kB     00:00
2024-03-29T09:07:06.514 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 8 - PowerTools                    4.5 MB/s | 4.9 MB     00:01
2024-03-29T09:07:07.640 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph     25 kB/s | 3.5 kB     00:00
2024-03-29T09:07:09.461 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux             9.4 MB/s |  16 MB     00:01
2024-03-29T09:07:13.934 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras                                      495 kB/s |  24 kB     00:00
2024-03-29T09:07:17.653 INFO:teuthology.orchestra.run.smithi171.stderr:Package cephadm available, but not installed.
2024-03-29T09:07:17.654 INFO:teuthology.orchestra.run.smithi171.stdout:No match for argument: cephadm
2024-03-29T09:07:17.659 INFO:teuthology.orchestra.run.smithi171.stderr:Package ceph-mgr-dashboard available, but not installed.
2024-03-29T09:07:17.659 INFO:teuthology.orchestra.run.smithi171.stdout:No match for argument: ceph-mgr-dashboard
2024-03-29T09:07:17.660 INFO:teuthology.orchestra.run.smithi171.stderr:Package ceph-mgr-diskprediction-local available, but not installed.
2024-03-29T09:07:17.660 INFO:teuthology.orchestra.run.smithi171.stdout:No match for argument: ceph-mgr-diskprediction-local
2024-03-29T09:07:17.661 INFO:teuthology.orchestra.run.smithi171.stderr:Package ceph-mgr-rook available, but not installed.
2024-03-29T09:07:17.661 INFO:teuthology.orchestra.run.smithi171.stdout:No match for argument: ceph-mgr-rook
2024-03-29T09:07:17.662 INFO:teuthology.orchestra.run.smithi171.stderr:Package ceph-mgr-cephadm available, but not installed.
2024-03-29T09:07:17.662 INFO:teuthology.orchestra.run.smithi171.stdout:No match for argument: ceph-mgr-cephadm
2024-03-29T09:07:17.664 INFO:teuthology.orchestra.run.smithi171.stderr:Package ceph-volume available, but not installed.
2024-03-29T09:07:17.664 INFO:teuthology.orchestra.run.smithi171.stdout:No match for argument: ceph-volume
2024-03-29T09:07:17.773 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved.
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout: Package                   Arch   Version                     Repository   Size
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading:
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout: ceph                      x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        6.4 k
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base                 x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        5.5 M
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common               x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         22 M
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse                 x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        854 k
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache
2024-03-29T09:07:17.778 INFO:teuthology.orchestra.run.smithi171.stdout:                           x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        166 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds                  x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        2.3 M
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr                  x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        1.6 M
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core     noarch 2:18.2.2-1015.gd0e392d9.el8 ceph-noarch 245 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon                  x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        4.8 M
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd                  x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         18 M
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw              x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         13 M
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux              x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         24 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test                 x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         47 M
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel           x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         31 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2                x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        778 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite             x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        142 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel            x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        139 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: librados2                 x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        3.7 M
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1          x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        474 k
2024-03-29T09:07:17.779 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1                   x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        3.6 M
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2                   x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        6.5 M
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse     x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         45 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common       x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        129 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs            x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        197 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados             x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        371 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd               x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        364 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw               x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        106 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse                  x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph         95 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror                x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        3.5 M
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd                   x86_64 2:18.2.2-1015.gd0e392d9.el8 ceph        181 k
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies:
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout: thrift                    x86_64 0.13.0-2.el8                epel        1.7 M
2024-03-29T09:07:17.780 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:07:17.781 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary
2024-03-29T09:07:17.781 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================
2024-03-29T09:07:17.781 INFO:teuthology.orchestra.run.smithi171.stdout:Install   1 Package
2024-03-29T09:07:17.781 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade  30 Packages
2024-03-29T09:07:17.781 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:07:17.781 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 138 M
2024-03-29T09:07:17.781 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages:
2024-03-29T09:07:17.970 INFO:teuthology.orchestra.run.smithi171.stdout:(1/31): ceph-18.2.2-1015.gd0e392d9.el8.x86_64.r  51 kB/s | 6.4 kB     00:00
2024-03-29T09:07:18.211 INFO:teuthology.orchestra.run.smithi171.stdout:(2/31): thrift-0.13.0-2.el8.x86_64.rpm          4.7 MB/s | 1.7 MB     00:00
2024-03-29T09:07:18.512 INFO:teuthology.orchestra.run.smithi171.stdout:(3/31): ceph-base-18.2.2-1015.gd0e392d9.el8.x86 8.2 MB/s | 5.5 MB     00:00
2024-03-29T09:07:18.580 INFO:teuthology.orchestra.run.smithi171.stdout:(4/31): ceph-immutable-object-cache-18.2.2-1015 2.4 MB/s | 166 kB     00:00
2024-03-29T09:07:18.855 INFO:teuthology.orchestra.run.smithi171.stdout:(5/31): ceph-mds-18.2.2-1015.gd0e392d9.el8.x86_ 8.3 MB/s | 2.3 MB     00:00
2024-03-29T09:07:18.923 INFO:teuthology.orchestra.run.smithi171.stdout:(6/31): ceph-fuse-18.2.2-1015.gd0e392d9.el8.x86 1.2 MB/s | 854 kB     00:00
2024-03-29T09:07:19.030 INFO:teuthology.orchestra.run.smithi171.stdout:(7/31): ceph-mgr-18.2.2-1015.gd0e392d9.el8.x86_ 8.9 MB/s | 1.6 MB     00:00
2024-03-29T09:07:19.606 INFO:teuthology.orchestra.run.smithi171.stdout:(8/31): ceph-common-18.2.2-1015.gd0e392d9.el8.x  13 MB/s |  22 MB     00:01
2024-03-29T09:07:20.665 INFO:teuthology.orchestra.run.smithi171.stdout:(9/31): ceph-osd-18.2.2-1015.gd0e392d9.el8.x86_  11 MB/s |  18 MB     00:01
2024-03-29T09:07:20.857 INFO:teuthology.orchestra.run.smithi171.stdout:(10/31): ceph-radosgw-18.2.2-1015.gd0e392d9.el8  10 MB/s |  13 MB     00:01
2024-03-29T09:07:20.882 INFO:teuthology.orchestra.run.smithi171.stdout:(11/31): ceph-selinux-18.2.2-1015.gd0e392d9.el8 112 kB/s |  24 kB     00:00
2024-03-29T09:07:20.974 INFO:teuthology.orchestra.run.smithi171.stdout:(12/31): ceph-mon-18.2.2-1015.gd0e392d9.el8.x86 2.4 MB/s | 4.8 MB     00:02
2024-03-29T09:07:21.000 INFO:teuthology.orchestra.run.smithi171.stdout:(13/31): libcephfs-devel-18.2.2-1015.gd0e392d9. 263 kB/s |  31 kB     00:00
2024-03-29T09:07:21.058 INFO:teuthology.orchestra.run.smithi171.stdout:(14/31): libcephsqlite-18.2.2-1015.gd0e392d9.el 2.4 MB/s | 142 kB     00:00
2024-03-29T09:07:21.117 INFO:teuthology.orchestra.run.smithi171.stdout:(15/31): librados-devel-18.2.2-1015.gd0e392d9.e 2.3 MB/s | 139 kB     00:00
2024-03-29T09:07:21.267 INFO:teuthology.orchestra.run.smithi171.stdout:(16/31): libcephfs2-18.2.2-1015.gd0e392d9.el8.x 2.6 MB/s | 778 kB     00:00
2024-03-29T09:07:21.493 INFO:teuthology.orchestra.run.smithi171.stdout:(17/31): librados2-18.2.2-1015.gd0e392d9.el8.x8 9.8 MB/s | 3.7 MB     00:00
2024-03-29T09:07:21.518 INFO:teuthology.orchestra.run.smithi171.stdout:(18/31): libradosstriper1-18.2.2-1015.gd0e392d9 1.8 MB/s | 474 kB     00:00
2024-03-29T09:07:21.843 INFO:teuthology.orchestra.run.smithi171.stdout:(19/31): librbd1-18.2.2-1015.gd0e392d9.el8.x86_  10 MB/s | 3.6 MB     00:00
2024-03-29T09:07:21.902 INFO:teuthology.orchestra.run.smithi171.stdout:(20/31): python3-ceph-argparse-18.2.2-1015.gd0e 766 kB/s |  45 kB     00:00
2024-03-29T09:07:21.969 INFO:teuthology.orchestra.run.smithi171.stdout:(21/31): python3-ceph-common-18.2.2-1015.gd0e39 1.9 MB/s | 129 kB     00:00
2024-03-29T09:07:22.066 INFO:teuthology.orchestra.run.smithi171.stdout:(22/31): python3-cephfs-18.2.2-1015.gd0e392d9.e 2.0 MB/s | 197 kB     00:00
2024-03-29T09:07:22.153 INFO:teuthology.orchestra.run.smithi171.stdout:(23/31): python3-rados-18.2.2-1015.gd0e392d9.el 4.2 MB/s | 371 kB     00:00
2024-03-29T09:07:22.237 INFO:teuthology.orchestra.run.smithi171.stdout:(24/31): python3-rbd-18.2.2-1015.gd0e392d9.el8. 4.3 MB/s | 364 kB     00:00
2024-03-29T09:07:22.312 INFO:teuthology.orchestra.run.smithi171.stdout:(25/31): python3-rgw-18.2.2-1015.gd0e392d9.el8. 1.4 MB/s | 106 kB     00:00
2024-03-29T09:07:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:(26/31): rbd-fuse-18.2.2-1015.gd0e392d9.el8.x86 1.4 MB/s |  95 kB     00:00
2024-03-29T09:07:22.755 INFO:teuthology.orchestra.run.smithi171.stdout:(27/31): rbd-mirror-18.2.2-1015.gd0e392d9.el8.x 9.2 MB/s | 3.5 MB     00:00
2024-03-29T09:07:22.830 INFO:teuthology.orchestra.run.smithi171.stdout:(28/31): rbd-nbd-18.2.2-1015.gd0e392d9.el8.x86_ 2.4 MB/s | 181 kB     00:00
2024-03-29T09:07:22.906 INFO:teuthology.orchestra.run.smithi171.stdout:(29/31): ceph-mgr-modules-core-18.2.2-1015.gd0e 3.2 MB/s | 245 kB     00:00
2024-03-29T09:07:23.648 INFO:teuthology.orchestra.run.smithi171.stdout:(30/31): ceph-test-18.2.2-1015.gd0e392d9.el8.x8  17 MB/s |  47 MB     00:02
2024-03-29T09:07:23.740 INFO:teuthology.orchestra.run.smithi171.stdout:(31/31): librgw2-18.2.2-1015.gd0e392d9.el8.x86_ 2.9 MB/s | 6.5 MB     00:02
2024-03-29T09:07:23.743 INFO:teuthology.orchestra.run.smithi171.stdout:--------------------------------------------------------------------------------
2024-03-29T09:07:23.743 INFO:teuthology.orchestra.run.smithi171.stdout:Total                                            23 MB/s | 138 MB     00:05
2024-03-29T09:07:23.743 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check
2024-03-29T09:07:23.809 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded.
2024-03-29T09:07:23.809 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test
2024-03-29T09:07:24.509 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded.
2024-03-29T09:07:24.513 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction
2024-03-29T09:07:26.639 INFO:teuthology.orchestra.run.smithi171.stdout:  Preparing        :                                                        1/1
2024-03-29T09:07:26.853 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: thrift-0.13.0-2.el8.x86_64                             1/1
2024-03-29T09:07:27.457 INFO:teuthology.orchestra.run.smithi171.stdout:  Installing       : thrift-0.13.0-2.el8.x86_64                            1/61
2024-03-29T09:07:27.768 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : librados2-2:18.2.2-1015.gd0e392d9.el8.x86_64          2/61
2024-03-29T09:07:28.217 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librados2-2:18.2.2-1015.gd0e392d9.el8.x86_64          2/61
2024-03-29T09:07:28.418 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : librbd1-2:18.2.2-1015.gd0e392d9.el8.x86_64            3/61
2024-03-29T09:07:28.571 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librbd1-2:18.2.2-1015.gd0e392d9.el8.x86_64            3/61
2024-03-29T09:07:28.859 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : libcephfs2-2:18.2.2-1015.gd0e392d9.el8.x86_64         4/61
2024-03-29T09:07:29.586 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libcephfs2-2:18.2.2-1015.gd0e392d9.el8.x86_64         4/61
2024-03-29T09:07:29.967 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : librgw2-2:18.2.2-1015.gd0e392d9.el8.x86_64            5/61
2024-03-29T09:07:30.068 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librgw2-2:18.2.2-1015.gd0e392d9.el8.x86_64            5/61
2024-03-29T09:07:30.273 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : python3-rados-2:18.2.2-1015.gd0e392d9.el8.x86_64      6/61
2024-03-29T09:07:30.468 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : libcephsqlite-2:18.2.2-1015.gd0e392d9.el8.x86_64      7/61
2024-03-29T09:07:30.595 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libcephsqlite-2:18.2.2-1015.gd0e392d9.el8.x86_64      7/61
2024-03-29T09:07:30.792 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : libradosstriper1-2:18.2.2-1015.gd0e392d9.el8.x86_6    8/61
2024-03-29T09:07:30.882 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libradosstriper1-2:18.2.2-1015.gd0e392d9.el8.x86_6    8/61
2024-03-29T09:07:31.090 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : python3-ceph-argparse-2:18.2.2-1015.gd0e392d9.el8.    9/61
2024-03-29T09:07:31.333 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : python3-cephfs-2:18.2.2-1015.gd0e392d9.el8.x86_64    10/61
2024-03-29T09:07:31.556 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : python3-rbd-2:18.2.2-1015.gd0e392d9.el8.x86_64       11/61
2024-03-29T09:07:31.804 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : python3-rgw-2:18.2.2-1015.gd0e392d9.el8.x86_64       12/61
2024-03-29T09:07:32.125 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : librados-devel-2:18.2.2-1015.gd0e392d9.el8.x86_64    13/61
2024-03-29T09:07:32.480 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-mgr-modules-core-2:18.2.2-1015.gd0e392d9.el8.   14/61
2024-03-29T09:07:32.676 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : python3-ceph-common-2:18.2.2-1015.gd0e392d9.el8.x8   15/61
2024-03-29T09:07:35.163 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-common-2:18.2.2-1015.gd0e392d9.el8.x86_64       16/61
2024-03-29T09:07:35.533 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-common-2:18.2.2-1015.gd0e392d9.el8.x86_64       16/61
2024-03-29T09:07:36.285 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-common-2:18.2.2-1015.gd0e392d9.el8.x86_64       16/61
2024-03-29T09:07:36.604 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-base-2:18.2.2-1015.gd0e392d9.el8.x86_64         17/61
2024-03-29T09:07:36.714 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-base-2:18.2.2-1015.gd0e392d9.el8.x86_64         17/61
2024-03-29T09:07:36.866 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-selinux-2:18.2.2-1015.gd0e392d9.el8.x86_64      18/61
2024-03-29T09:07:56.293 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-selinux-2:18.2.2-1015.gd0e392d9.el8.x86_64      18/61
2024-03-29T09:07:56.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-mds-2:18.2.2-1015.gd0e392d9.el8.x86_64          19/61
2024-03-29T09:07:56.718 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mds-2:18.2.2-1015.gd0e392d9.el8.x86_64          19/61
2024-03-29T09:07:56.942 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-mgr-2:18.2.2-1015.gd0e392d9.el8.x86_64          20/61
2024-03-29T09:07:57.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mgr-2:18.2.2-1015.gd0e392d9.el8.x86_64          20/61
2024-03-29T09:07:57.730 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-mon-2:18.2.2-1015.gd0e392d9.el8.x86_64          21/61
2024-03-29T09:07:59.541 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mon-2:18.2.2-1015.gd0e392d9.el8.x86_64          21/61
2024-03-29T09:07:59.892 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-osd-2:18.2.2-1015.gd0e392d9.el8.x86_64          22/61
2024-03-29T09:07:59.918 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-osd-2:18.2.2-1015.gd0e392d9.el8.x86_64          22/61
2024-03-29T09:08:01.461 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-2:18.2.2-1015.gd0e392d9.el8.x86_64              23/61
2024-03-29T09:08:01.724 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-radosgw-2:18.2.2-1015.gd0e392d9.el8.x86_64      24/61
2024-03-29T09:08:01.760 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-radosgw-2:18.2.2-1015.gd0e392d9.el8.x86_64      24/61
2024-03-29T09:08:01.946 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-immutable-object-cache-2:18.2.2-1015.gd0e392d   25/61
2024-03-29T09:08:02.337 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1015.gd0e392d   25/61
2024-03-29T09:08:02.634 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : rbd-mirror-2:18.2.2-1015.gd0e392d9.el8.x86_64        26/61
2024-03-29T09:08:07.797 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: rbd-mirror-2:18.2.2-1015.gd0e392d9.el8.x86_64        26/61
2024-03-29T09:08:08.082 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-test-2:18.2.2-1015.gd0e392d9.el8.x86_64         27/61
2024-03-29T09:08:08.313 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : libcephfs-devel-2:18.2.2-1015.gd0e392d9.el8.x86_64   28/61
2024-03-29T09:08:08.509 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : rbd-fuse-2:18.2.2-1015.gd0e392d9.el8.x86_64          29/61
2024-03-29T09:08:08.802 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : rbd-nbd-2:18.2.2-1015.gd0e392d9.el8.x86_64           30/61
2024-03-29T09:08:09.013 INFO:teuthology.orchestra.run.smithi171.stdout:  Upgrading        : ceph-fuse-2:18.2.2-1015.gd0e392d9.el8.x86_64         31/61
2024-03-29T09:08:09.143 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-2:16.2.15-0.el8.x86_64                          32/61
2024-03-29T09:08:09.387 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-test-2:16.2.15-0.el8.x86_64                     33/61
2024-03-29T09:08:09.410 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64                  34/61
2024-03-29T09:08:09.411 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-radosgw-2:16.2.15-0.el8.x86_64                  34/61
2024-03-29T09:08:09.683 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64                  34/61
2024-03-29T09:08:09.862 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : rbd-nbd-2:16.2.15-0.el8.x86_64                       35/61
2024-03-29T09:08:09.879 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64                    36/61
2024-03-29T09:08:09.879 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : rbd-mirror-2:16.2.15-0.el8.x86_64                    36/61
2024-03-29T09:08:10.087 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64                    36/61
2024-03-29T09:08:10.237 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : rbd-fuse-2:16.2.15-0.el8.x86_64                      37/61
2024-03-29T09:08:10.255 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64   38/61
2024-03-29T09:08:10.256 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64   38/61
2024-03-29T09:08:10.438 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64   38/61
2024-03-29T09:08:10.634 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : libcephfs-devel-2:16.2.15-0.el8.x86_64               39/61
2024-03-29T09:08:10.651 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64                      40/61
2024-03-29T09:08:10.652 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-mgr-2:16.2.15-0.el8.x86_64                      40/61
2024-03-29T09:08:10.850 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64                      40/61
2024-03-29T09:08:10.850 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : libcephsqlite-2:16.2.15-0.el8.x86_64                 41/61
2024-03-29T09:08:11.121 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64                 41/61
2024-03-29T09:08:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : librados-devel-2:16.2.15-0.el8.x86_64                42/61
2024-03-29T09:08:11.306 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64                      43/61
2024-03-29T09:08:11.307 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-osd-2:16.2.15-0.el8.x86_64                      43/61
2024-03-29T09:08:11.771 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64                      43/61
2024-03-29T09:08:11.786 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64                      44/61
2024-03-29T09:08:11.787 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-mds-2:16.2.15-0.el8.x86_64                      44/61
2024-03-29T09:08:11.954 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64                      44/61
2024-03-29T09:08:11.969 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64                      45/61
2024-03-29T09:08:11.970 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-mon-2:16.2.15-0.el8.x86_64                      45/61
2024-03-29T09:08:12.142 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64                      45/61
2024-03-29T09:08:12.142 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-selinux-2:16.2.15-0.el8.x86_64                  46/61
2024-03-29T09:08:12.322 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64                  46/61
2024-03-29T09:08:12.365 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64                     47/61
2024-03-29T09:08:12.365 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-base-2:16.2.15-0.el8.x86_64                     47/61
2024-03-29T09:08:12.677 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64                     47/61
2024-03-29T09:08:12.678 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-common-2:16.2.15-0.el8.x86_64                   48/61
2024-03-29T09:08:12.908 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64                   48/61
2024-03-29T09:08:12.909 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : libradosstriper1-2:16.2.15-0.el8.x86_64              49/61
2024-03-29T09:08:13.129 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64              49/61
2024-03-29T09:08:13.291 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : python3-cephfs-2:16.2.15-0.el8.x86_64                50/61
2024-03-29T09:08:13.478 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : python3-rbd-2:16.2.15-0.el8.x86_64                   51/61
2024-03-29T09:08:13.479 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : librbd1-2:16.2.15-0.el8.x86_64                       52/61
2024-03-29T09:08:13.808 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64                       52/61
2024-03-29T09:08:14.008 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : python3-rgw-2:16.2.15-0.el8.x86_64                   53/61
2024-03-29T09:08:14.008 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : librgw2-2:16.2.15-0.el8.x86_64                       54/61
2024-03-29T09:08:14.284 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64                       54/61
2024-03-29T09:08:14.487 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : python3-rados-2:16.2.15-0.el8.x86_64                 55/61
2024-03-29T09:08:14.487 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : libcephfs2-2:16.2.15-0.el8.x86_64                    56/61
2024-03-29T09:08:14.747 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64                    56/61
2024-03-29T09:08:14.944 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-fuse-2:16.2.15-0.el8.x86_64                     57/61
2024-03-29T09:08:15.080 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : python3-ceph-argparse-2:16.2.15-0.el8.x86_64         58/61
2024-03-29T09:08:15.250 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : python3-ceph-common-2:16.2.15-0.el8.x86_64           59/61
2024-03-29T09:08:15.432 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch         60/61
2024-03-29T09:08:15.432 INFO:teuthology.orchestra.run.smithi171.stdout:  Cleanup          : librados2-2:16.2.15-0.el8.x86_64                     61/61
2024-03-29T09:08:15.865 INFO:teuthology.orchestra.run.smithi171.stdout:  Running scriptlet: librados2-2:16.2.15-0.el8.x86_64                     61/61
2024-03-29T09:08:15.865 INFO:teuthology.orchestra.run.smithi171.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory
2024-03-29T09:08:15.865 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:16.543 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : thrift-0.13.0-2.el8.x86_64                            1/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-2:18.2.2-1015.gd0e392d9.el8.x86_64               2/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-2:16.2.15-0.el8.x86_64                           3/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-base-2:18.2.2-1015.gd0e392d9.el8.x86_64          4/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-base-2:16.2.15-0.el8.x86_64                      5/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-common-2:18.2.2-1015.gd0e392d9.el8.x86_64        6/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-common-2:16.2.15-0.el8.x86_64                    7/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-fuse-2:18.2.2-1015.gd0e392d9.el8.x86_64          8/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-fuse-2:16.2.15-0.el8.x86_64                      9/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-immutable-object-cache-2:18.2.2-1015.gd0e392d   10/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64   11/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mds-2:18.2.2-1015.gd0e392d9.el8.x86_64          12/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mds-2:16.2.15-0.el8.x86_64                      13/61
2024-03-29T09:08:16.544 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mgr-2:18.2.2-1015.gd0e392d9.el8.x86_64          14/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mgr-2:16.2.15-0.el8.x86_64                      15/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mon-2:18.2.2-1015.gd0e392d9.el8.x86_64          16/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mon-2:16.2.15-0.el8.x86_64                      17/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-osd-2:18.2.2-1015.gd0e392d9.el8.x86_64          18/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-osd-2:16.2.15-0.el8.x86_64                      19/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-radosgw-2:18.2.2-1015.gd0e392d9.el8.x86_64      20/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-radosgw-2:16.2.15-0.el8.x86_64                  21/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-selinux-2:18.2.2-1015.gd0e392d9.el8.x86_64      22/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-selinux-2:16.2.15-0.el8.x86_64                  23/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-test-2:18.2.2-1015.gd0e392d9.el8.x86_64         24/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-test-2:16.2.15-0.el8.x86_64                     25/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephfs-devel-2:18.2.2-1015.gd0e392d9.el8.x86_64   26/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephfs-devel-2:16.2.15-0.el8.x86_64               27/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephfs2-2:18.2.2-1015.gd0e392d9.el8.x86_64        28/61
2024-03-29T09:08:16.545 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephfs2-2:16.2.15-0.el8.x86_64                    29/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephsqlite-2:18.2.2-1015.gd0e392d9.el8.x86_64     30/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libcephsqlite-2:16.2.15-0.el8.x86_64                 31/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librados-devel-2:18.2.2-1015.gd0e392d9.el8.x86_64    32/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librados-devel-2:16.2.15-0.el8.x86_64                33/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librados2-2:18.2.2-1015.gd0e392d9.el8.x86_64         34/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librados2-2:16.2.15-0.el8.x86_64                     35/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libradosstriper1-2:18.2.2-1015.gd0e392d9.el8.x86_6   36/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : libradosstriper1-2:16.2.15-0.el8.x86_64              37/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librbd1-2:18.2.2-1015.gd0e392d9.el8.x86_64           38/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librbd1-2:16.2.15-0.el8.x86_64                       39/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librgw2-2:18.2.2-1015.gd0e392d9.el8.x86_64           40/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : librgw2-2:16.2.15-0.el8.x86_64                       41/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-ceph-argparse-2:18.2.2-1015.gd0e392d9.el8.   42/61
2024-03-29T09:08:16.546 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-ceph-argparse-2:16.2.15-0.el8.x86_64         43/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-ceph-common-2:18.2.2-1015.gd0e392d9.el8.x8   44/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-ceph-common-2:16.2.15-0.el8.x86_64           45/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-cephfs-2:18.2.2-1015.gd0e392d9.el8.x86_64    46/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-cephfs-2:16.2.15-0.el8.x86_64                47/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rados-2:18.2.2-1015.gd0e392d9.el8.x86_64     48/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rados-2:16.2.15-0.el8.x86_64                 49/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rbd-2:18.2.2-1015.gd0e392d9.el8.x86_64       50/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rbd-2:16.2.15-0.el8.x86_64                   51/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rgw-2:18.2.2-1015.gd0e392d9.el8.x86_64       52/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : python3-rgw-2:16.2.15-0.el8.x86_64                   53/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-fuse-2:18.2.2-1015.gd0e392d9.el8.x86_64          54/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-fuse-2:16.2.15-0.el8.x86_64                      55/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-mirror-2:18.2.2-1015.gd0e392d9.el8.x86_64        56/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-mirror-2:16.2.15-0.el8.x86_64                    57/61
2024-03-29T09:08:16.547 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-nbd-2:18.2.2-1015.gd0e392d9.el8.x86_64           58/61
2024-03-29T09:08:16.548 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : rbd-nbd-2:16.2.15-0.el8.x86_64                       59/61
2024-03-29T09:08:16.548 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mgr-modules-core-2:18.2.2-1015.gd0e392d9.el8.   60/61
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  Verifying        : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch         61/61
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded:
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-base-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-common-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-fuse-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-immutable-object-cache-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mds-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mgr-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.903 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mgr-modules-core-2:18.2.2-1015.gd0e392d9.el8.noarch
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-mon-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-osd-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-radosgw-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-selinux-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  ceph-test-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  libcephfs-devel-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  libcephfs2-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  libcephsqlite-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  librados-devel-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  librados2-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  libradosstriper1-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  librbd1-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  librgw2-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.904 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-ceph-argparse-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-ceph-common-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-cephfs-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-rados-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-rbd-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  python3-rgw-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  rbd-fuse-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  rbd-mirror-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  rbd-nbd-2:18.2.2-1015.gd0e392d9.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:Installed:
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:  thrift-0.13.0-2.el8.x86_64
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:17.905 INFO:teuthology.orchestra.run.smithi171.stdout:Complete!
2024-03-29T09:08:18.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d0e392d9aee635f2b65768c460c7a151ead7a5e2
2024-03-29T09:08:18.313 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}'
2024-03-29T09:08:18.366 INFO:teuthology.orchestra.run.smithi171.stdout:18.2.2-1015.gd0e392d9.el8
2024-03-29T09:08:18.367 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1015.gd0e392d9.el8
2024-03-29T09:08:18.367 INFO:teuthology.task.install:The correct ceph version 18.2.2-1015.gd0e392d9 is installed.
2024-03-29T09:08:18.369 INFO:teuthology.run_tasks:Running task print...
2024-03-29T09:08:18.380 INFO:teuthology.task.print:**** done install.upgrade
2024-03-29T09:08:18.380 INFO:teuthology.run_tasks:Running task ceph.restart...
2024-03-29T09:08:18.399 DEBUG:tasks.ceph.mon.a:waiting for process to exit
2024-03-29T09:08:18.399 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:18.418 INFO:tasks.ceph.mon.a:Stopped
2024-03-29T09:08:18.418 INFO:tasks.ceph.mon.a:Restarting daemon
2024-03-29T09:08:18.418 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a
2024-03-29T09:08:18.462 INFO:tasks.ceph.mon.a:Started
2024-03-29T09:08:18.462 DEBUG:tasks.ceph.mon.b:waiting for process to exit
2024-03-29T09:08:18.462 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:18.483 INFO:tasks.ceph.mon.b:Stopped
2024-03-29T09:08:18.483 INFO:tasks.ceph.mon.b:Restarting daemon
2024-03-29T09:08:18.483 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b
2024-03-29T09:08:18.528 INFO:tasks.ceph.mon.b:Started
2024-03-29T09:08:18.528 DEBUG:tasks.ceph.mon.c:waiting for process to exit
2024-03-29T09:08:18.528 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:18.551 INFO:tasks.ceph.mon.c:Stopped
2024-03-29T09:08:18.551 INFO:tasks.ceph.mon.c:Restarting daemon
2024-03-29T09:08:18.552 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c
2024-03-29T09:08:18.597 INFO:tasks.ceph.mon.c:Started
2024-03-29T09:08:18.598 DEBUG:tasks.ceph.mgr.x:waiting for process to exit
2024-03-29T09:08:18.598 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:18.651 INFO:tasks.ceph.mgr.x:Stopped
2024-03-29T09:08:18.651 INFO:tasks.ceph.mgr.x:Restarting daemon
2024-03-29T09:08:18.651 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x
2024-03-29T09:08:18.656 INFO:tasks.ceph.mgr.x:Started
2024-03-29T09:08:18.656 DEBUG:tasks.ceph.mgr.y:waiting for process to exit
2024-03-29T09:08:18.657 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:18.734 INFO:tasks.ceph.mgr.y:Stopped
2024-03-29T09:08:18.735 INFO:tasks.ceph.mgr.y:Restarting daemon
2024-03-29T09:08:18.735 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y
2024-03-29T09:08:18.740 INFO:tasks.ceph.mgr.y:Started
2024-03-29T09:08:18.740 INFO:teuthology.run_tasks:Running task ceph.healthy...
2024-03-29T09:08:18.749 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean...
2024-03-29T09:08:18.750 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available
2024-03-29T09:08:18.750 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json
2024-03-29T09:08:18.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.972+0000 7f23d8800700  1  Processor -- start
2024-03-29T09:08:18.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.973+0000 7f23d8800700  1 --  start start
2024-03-29T09:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.973+0000 7f23d8800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f23d006ef50 0x7f23d01338e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.973+0000 7f23d8800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d0133e20 0x7f23d0136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.973+0000 7f23d8800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d006d120 con 0x7f23d006e460
2024-03-29T09:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.973+0000 7f23d8800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d006ce40 con 0x7f23d006ef50
2024-03-29T09:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.973+0000 7f23d8800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d006c5b0 con 0x7f23d0133e20
2024-03-29T09:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d6800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d0133e20 0x7f23d0136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d5e00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f23d006e460 0x7f23d006e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44404/0 (socket says 172.21.15.171:44404)
2024-03-29T09:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d5e00700  1 -- 172.21.15.171:0/3486233019 learned_addr learned my addr 172.21.15.171:0/3486233019 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d5400700  1 --2- 172.21.15.171:0/3486233019 >> v2:172.21.15.171:3300/0 conn(0x7f23d006ef50 0x7f23d01338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d5400700  1 -- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d0133e20 msgr2=0x7f23d0136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d5400700  1 --2- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d0133e20 0x7f23d0136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d5400700  1 -- 172.21.15.171:0/3486233019 >> v1:172.21.15.171:6789/0 conn(0x7f23d006e460 legacy=0x7f23d006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d5400700  1 -- 172.21.15.171:0/3486233019 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d006f690 con 0x7f23d006ef50
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d4a00700  1 -- 172.21.15.171:0/3486233019 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715755356 0 0) 0x7f23d006d120 con 0x7f23d006e460
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.974+0000 7f23d6800700  1 --2- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d0133e20 0x7f23d0136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.975+0000 7f23d5400700  1 --2- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d006ef50 0x7f23d01338e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009840 tx=0x7f23c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d53e18666df4b8 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.975+0000 7f23d4a00700  1 -- 172.21.15.171:0/3486233019 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0011830 con 0x7f23d006ef50
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.975+0000 7f23d4a00700  1 -- 172.21.15.171:0/3486233019 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0011990 con 0x7f23d006ef50
2024-03-29T09:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.975+0000 7f23d4a00700  1 -- 172.21.15.171:0/3486233019 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0011d20 con 0x7f23d006ef50
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 -- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d006ef50 msgr2=0x7f23d01338e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 --2- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d006ef50 0x7f23d01338e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009840 tx=0x7f23c0009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 -- 172.21.15.171:0/3486233019 shutdown_connections
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 --2- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d0133e20 0x7f23d0136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 --2- 172.21.15.171:0/3486233019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d006ef50 0x7f23d01338e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 -- 172.21.15.171:0/3486233019 >> 172.21.15.171:0/3486233019 conn(0x7f23d009a230 msgr2=0x7f23d009a640 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 -- 172.21.15.171:0/3486233019 shutdown_connections
2024-03-29T09:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.976+0000 7f23d8800700  1 -- 172.21.15.171:0/3486233019 wait complete.
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.977+0000 7f23d8800700  1  Processor -- start
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.977+0000 7f23d8800700  1 --  start start
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d8800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f23d006e460 0x7f23d01c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d8800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d006ef50 0x7f23d01c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d8800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d0133e20 0x7f23d01c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d8800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0133950 con 0x7f23d0133e20
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d8800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0091b30 con 0x7f23d006ef50
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d8800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0133080 con 0x7f23d006e460
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d6800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d0133e20 0x7f23d01c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d5400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d006ef50 0x7f23d01c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d6800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d0133e20 0x7f23d01c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45414/0 (socket says 172.21.15.171:45414)
2024-03-29T09:08:18.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d5400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d006ef50 0x7f23d01c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40260/0 (socket says 172.21.15.171:40260)
2024-03-29T09:08:18.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d6800700  1 -- 172.21.15.171:0/2795255840 learned_addr learned my addr 172.21.15.171:0/2795255840 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:18.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.978+0000 7f23d5e00700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f23d006e460 0x7f23d01c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:18.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.979+0000 7f23d6800700  1 -- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f23d006e460 msgr2=0x7f23d01c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.979+0000 7f23d6800700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f23d006e460 0x7f23d01c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.979+0000 7f23d6800700  1 -- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d006ef50 msgr2=0x7f23d01c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.979+0000 7f23d6800700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d006ef50 0x7f23d01c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.979+0000 7f23d6800700  1 -- 172.21.15.171:0/2795255840 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009a70 con 0x7f23d0133e20
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.979+0000 7f23d6800700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d0133e20 0x7f23d01c39d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00ef90 tx=0x7f23cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.980+0000 7f23ca000700  1 -- 172.21.15.171:0/2795255840 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00cd40 con 0x7f23d0133e20
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.980+0000 7f23ca000700  1 -- 172.21.15.171:0/2795255840 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00f040 con 0x7f23d0133e20
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.980+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c00094a0 con 0x7f23d0133e20
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.980+0000 7f23ca000700  1 -- 172.21.15.171:0/2795255840 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00cea0 con 0x7f23d0133e20
2024-03-29T09:08:18.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.980+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d0090710 con 0x7f23d0133e20
2024-03-29T09:08:18.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.981+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d00623e0 con 0x7f23d0133e20
2024-03-29T09:08:18.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.981+0000 7f23ca000700  1 -- 172.21.15.171:0/2795255840 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f23cc0146c0 con 0x7f23d0133e20
2024-03-29T09:08:18.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.982+0000 7f23ca000700  1 -- 172.21.15.171:0/2795255840 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f23cc056770 con 0x7f23d0133e20
2024-03-29T09:08:18.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.982+0000 7f23d5e00700  1 -- 172.21.15.171:0/2795255840 >> v1:172.21.15.171:6816/38531 conn(0x7f23b40421a0 legacy=0x7f23b4044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:18.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:18.986+0000 7f23ca000700  1 -- 172.21.15.171:0/2795255840 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f23cc036d70 con 0x7f23d0133e20
2024-03-29T09:08:19.052 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:19.052+0000 7f1ca2cbf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member
2024-03-29T09:08:19.060 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:19.060+0000 7f8af3b93200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member
2024-03-29T09:08:19.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.174+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f23d00748d0 con 0x7f23d0133e20
2024-03-29T09:08:19.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.176+0000 7f23ca000700  1 -- 172.21.15.171:0/2795255840 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0  v5) v1 ==== 74+0+97641 (secure 0 0 0) 0x7f23cc018030 con 0x7f23d0133e20
2024-03-29T09:08:19.178 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:19.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 >> v1:172.21.15.171:6816/38531 conn(0x7f23b40421a0 legacy=0x7f23b4044660 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:19.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d0133e20 msgr2=0x7f23d01c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d0133e20 0x7f23d01c39d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00ef90 tx=0x7f23cc00c3a0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 shutdown_connections
2024-03-29T09:08:19.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d0133e20 0x7f23d01c39d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f23d006e460 0x7f23d01c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 --2- 172.21.15.171:0/2795255840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d006ef50 0x7f23d01c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 >> 172.21.15.171:0/2795255840 conn(0x7f23d009a230 msgr2=0x7f23d0099030 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:19.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 shutdown_connections
2024-03-29T09:08:19.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.179+0000 7f23d8800700  1 -- 172.21.15.171:0/2795255840 wait complete.
2024-03-29T09:08:19.198 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":5,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6816","nonce":38531}]},"active_addr":"172.21.15.171:6816/38531","active_change":"2024-03-29T08:54:22.493438+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":4094087308}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":4287724647}]}]}
2024-03-29T09:08:19.200 INFO:tasks.ceph.ceph_manager.ceph:mgr available!
2024-03-29T09:08:19.200 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up
2024-03-29T09:08:19.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:19.375 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:19.374+0000 7f1ca2cbf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member
2024-03-29T09:08:19.375 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:19.374+0000 7f8af3b93200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member
2024-03-29T09:08:19.401 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.400+0000 7f21afe00700  1  Processor -- start
2024-03-29T09:08:19.401 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.401+0000 7f21afe00700  1 --  start start
2024-03-29T09:08:19.402 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.401+0000 7f21afe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a812e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.402 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.401+0000 7f21afe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812b530 0x7f21a8136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.402 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21afe00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a8070d80 con 0x7f21a812ecc0
2024-03-29T09:08:19.402 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21afe00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80715e0 con 0x7f21a812b530
2024-03-29T09:08:19.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21afe00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80722b0 con 0x7f21a812e3a0
2024-03-29T09:08:19.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21aca00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f21a812ecc0 0x7f21a812ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44408/0 (socket says 172.21.15.171:44408)
2024-03-29T09:08:19.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21aca00700  1 -- 172.21.15.171:0/2546022267 learned_addr learned my addr 172.21.15.171:0/2546022267 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:19.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21ad400700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21ade00700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812b530 0x7f21a8136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.404 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21a7e00700  1 -- 172.21.15.171:0/2546022267 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657779313 0 0) 0x7f21a8070d80 con 0x7f21a812ecc0
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21ade00700  1 -- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 msgr2=0x7f21a812e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21ade00700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a812e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21ade00700  1 -- 172.21.15.171:0/2546022267 >> v1:172.21.15.171:6789/0 conn(0x7f21a812ecc0 legacy=0x7f21a812ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21ade00700  1 -- 172.21.15.171:0/2546022267 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8071b40 con 0x7f21a812b530
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.402+0000 7f21ad400700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a812e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.403+0000 7f21ade00700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812b530 0x7f21a8136740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009dc0 tx=0x7f21a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a47c9142ca59baa2 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.403+0000 7f21a7e00700  1 -- 172.21.15.171:0/2546022267 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000e070 con 0x7f21a812b530
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.403+0000 7f21a7e00700  1 -- 172.21.15.171:0/2546022267 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a000bb20 con 0x7f21a812b530
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.403+0000 7f21a7e00700  1 -- 172.21.15.171:0/2546022267 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0012430 con 0x7f21a812b530
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 -- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812b530 msgr2=0x7f21a8136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812b530 0x7f21a8136740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009dc0 tx=0x7f21a000b330 comp rx=0 tx=0).stop
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 -- 172.21.15.171:0/2546022267 shutdown_connections
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a812e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 --2- 172.21.15.171:0/2546022267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812b530 0x7f21a8136740 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.406 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 -- 172.21.15.171:0/2546022267 >> 172.21.15.171:0/2546022267 conn(0x7f21a80a0d70 msgr2=0x7f21a80a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:19.406 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 -- 172.21.15.171:0/2546022267 shutdown_connections
2024-03-29T09:08:19.406 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.404+0000 7f21afe00700  1 -- 172.21.15.171:0/2546022267 wait complete.
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1  Processor -- start
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1 --  start start
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a812b530 0x7f21a8123990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a8123ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812ecc0 0x7f21a8124410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a812fbd0 con 0x7f21a812b530
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a812fe10 con 0x7f21a812ecc0
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21afe00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21a81310e0 con 0x7f21a812e3a0
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21ade00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812ecc0 0x7f21a8124410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21ad400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a812b530 0x7f21a8123990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21ade00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812ecc0 0x7f21a8124410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40280/0 (socket says 172.21.15.171:40280)
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21ade00700  1 -- 172.21.15.171:0/130149052 learned_addr learned my addr 172.21.15.171:0/130149052 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.406+0000 7f21aca00700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a8123ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21ad400700  1 -- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 msgr2=0x7f21a8123ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21ad400700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a8123ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21ad400700  1 -- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812ecc0 msgr2=0x7f21a8124410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21ad400700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812ecc0 0x7f21a8124410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21ad400700  1 -- 172.21.15.171:0/130149052 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0094a0 con 0x7f21a812b530
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21ade00700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812ecc0 0x7f21a8124410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21ad400700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a812b530 0x7f21a8123990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f219c00e9b0 tx=0x7f219c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.407+0000 7f21a5600700  1 -- 172.21.15.171:0/130149052 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00ee50 con 0x7f21a812b530
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.408+0000 7f21a5600700  1 -- 172.21.15.171:0/130149052 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00c850 con 0x7f21a812b530
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.408+0000 7f21a5600700  1 -- 172.21.15.171:0/130149052 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00cc00 con 0x7f21a812b530
2024-03-29T09:08:19.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.408+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a0009a70 con 0x7f21a812b530
2024-03-29T09:08:19.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.408+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a81362f0 con 0x7f21a812b530
2024-03-29T09:08:19.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.409+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a81171d0 con 0x7f21a812b530
2024-03-29T09:08:19.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.410+0000 7f21a5600700  1 -- 172.21.15.171:0/130149052 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f219c013470 con 0x7f21a812b530
2024-03-29T09:08:19.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.411+0000 7f21a5600700  1 -- 172.21.15.171:0/130149052 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f219c056200 con 0x7f21a812b530
2024-03-29T09:08:19.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.411+0000 7f21aca00700  1 -- 172.21.15.171:0/130149052 >> v1:172.21.15.171:6816/38531 conn(0x7f21880421a0 legacy=0x7f2188044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:19.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.413+0000 7f21a5600700  1 -- 172.21.15.171:0/130149052 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f219c036970 con 0x7f21a812b530
2024-03-29T09:08:19.569 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:19.568+0000 7f1ca2cbf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member
2024-03-29T09:08:19.569 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:19.569+0000 7f8af3b93200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member
2024-03-29T09:08:19.573 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.573+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21a8128db0 con 0x7f21a812b530
2024-03-29T09:08:19.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.574+0000 7f21a5600700  1 -- 172.21.15.171:0/130149052 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v13) v1 ==== 74+0+8595 (secure 0 0 0) 0x7f219c021030 con 0x7f21a812b530
2024-03-29T09:08:19.574 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:19.574 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":13,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T08:54:34.548920+0000","last_up_change":"2024-03-29T08:54:27.513354+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":39169}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":39169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":39169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":39169}]},"public_addr":"172.21.15.171:6800/39169","cluster_addr":"172.21.15.171:6801/39169","heartbeat_back_addr":"172.21.15.171:6803/39169","heartbeat_front_addr":"172.21.15.171:6802/39169","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":39170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":39170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":39170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":39170}]},"public_addr":"172.21.15.171:6804/39170","cluster_addr":"172.21.15.171:6805/39170","heartbeat_back_addr":"172.21.15.171:6807/39170","heartbeat_front_addr":"172.21.15.171:6806/39170","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":39179}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":39179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":39179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":39179}]},"public_addr":"172.21.15.171:6809/39179","cluster_addr":"172.21.15.171:6811/39179","heartbeat_back_addr":"172.21.15.171:6815/39179","heartbeat_front_addr":"172.21.15.171:6814/39179","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":39186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":39186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":39186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":39186}]},"public_addr":"172.21.15.171:6808/39186","cluster_addr":"172.21.15.171:6810/39186","heartbeat_back_addr":"172.21.15.171:6813/39186","heartbeat_front_addr":"172.21.15.171:6812/39186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 >> v1:172.21.15.171:6816/38531 conn(0x7f21880421a0 legacy=0x7f2188044660 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a812b530 msgr2=0x7f21a8123990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a812b530 0x7f21a8123990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f219c00e9b0 tx=0x7f219c00ecc0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 shutdown_connections
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a812ecc0 0x7f21a8124410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a812b530 0x7f21a8123990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 --2- 172.21.15.171:0/130149052 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f21a812e3a0 0x7f21a8123ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 >> 172.21.15.171:0/130149052 conn(0x7f21a80a0d70 msgr2=0x7f21a806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 shutdown_connections
2024-03-29T09:08:19.577 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.576+0000 7f21afe00700  1 -- 172.21.15.171:0/130149052 wait complete.
2024-03-29T09:08:19.596 INFO:tasks.ceph.ceph_manager.ceph:all up!
2024-03-29T09:08:19.597 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:19.802 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.802+0000 7f2389a00700  1  Processor -- start
2024-03-29T09:08:19.802 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.802+0000 7f2389a00700  1 --  start start
2024-03-29T09:08:19.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2389a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412e3a0 0x7f238412e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2389a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238412ecc0 0x7f238409c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2389a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f238409c9f0 0x7f238409ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2389a00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840717a0 con 0x7f238409c9f0
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2389a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840711b0 con 0x7f238412ecc0
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2389a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f238409e2c0 con 0x7f238412e3a0
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2383e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412e3a0 0x7f238412e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2383e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412e3a0 0x7f238412e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53442/0 (socket says 172.21.15.171:53442)
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2383e00700  1 -- 172.21.15.171:0/3508176435 learned_addr learned my addr 172.21.15.171:0/3508176435 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2383400700  1 --2- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238412ecc0 0x7f238409c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.803+0000 7f2389000700  1 --2- 172.21.15.171:0/3508176435 >> v2:172.21.15.171:3300/0 conn(0x7f238409c9f0 0x7f238409ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2383e00700  1 -- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238412ecc0 msgr2=0x7f238409c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2383e00700  1 --2- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238412ecc0 0x7f238409c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2383e00700  1 -- 172.21.15.171:0/3508176435 >> v2:172.21.15.171:3300/0 conn(0x7f238409c9f0 msgr2=0x7f238409ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2383e00700  1 --2- 172.21.15.171:0/3508176435 >> v2:172.21.15.171:3300/0 conn(0x7f238409c9f0 0x7f238409ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2383e00700  1 -- 172.21.15.171:0/3508176435 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384070870 con 0x7f238412e3a0
2024-03-29T09:08:19.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2389000700  1 --2- 172.21.15.171:0/3508176435 >> v2:172.21.15.171:3300/0 conn(0x7f238409c9f0 0x7f238409ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:19.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2383e00700  1 --2- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412e3a0 0x7f238412e780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2374009920 tx=0x7f2374009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1581191f472cb96 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.804+0000 7f2382a00700  1 -- 172.21.15.171:0/3508176435 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374011830 con 0x7f238412e3a0
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2382a00700  1 -- 172.21.15.171:0/3508176435 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374011990 con 0x7f238412e3a0
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2382a00700  1 -- 172.21.15.171:0/3508176435 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374011d20 con 0x7f238412e3a0
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 -- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412e3a0 msgr2=0x7f238412e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 --2- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412e3a0 0x7f238412e780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2374009920 tx=0x7f2374009c30 comp rx=0 tx=0).stop
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 -- 172.21.15.171:0/3508176435 shutdown_connections
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 --2- 172.21.15.171:0/3508176435 >> v2:172.21.15.171:3300/0 conn(0x7f238409c9f0 0x7f238409ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 --2- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412e3a0 0x7f238412e780 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 --2- 172.21.15.171:0/3508176435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238412ecc0 0x7f238409c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 -- 172.21.15.171:0/3508176435 >> 172.21.15.171:0/3508176435 conn(0x7f238409d530 msgr2=0x7f238409d940 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:19.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 -- 172.21.15.171:0/3508176435 shutdown_connections
2024-03-29T09:08:19.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.805+0000 7f2389a00700  1 -- 172.21.15.171:0/3508176435 wait complete.
2024-03-29T09:08:19.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.807+0000 7f2389a00700  1  Processor -- start
2024-03-29T09:08:19.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.808+0000 7f2389a00700  1 --  start start
2024-03-29T09:08:19.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.808+0000 7f2389a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238409c9f0 0x7f23841302a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.808+0000 7f2389a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238412e3a0 0x7f23841307e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2389a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412ecc0 0x7f2384130d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2389a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2384131c40 con 0x7f238412e3a0
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2389a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238412d9a0 con 0x7f238409c9f0
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2389a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23841346f0 con 0x7f238412ecc0
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238409c9f0 0x7f23841302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238412e3a0 0x7f23841307e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238409c9f0 0x7f23841302a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40298/0 (socket says 172.21.15.171:40298)
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238412e3a0 0x7f23841307e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45432/0 (socket says 172.21.15.171:45432)
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 -- 172.21.15.171:0/1932846486 learned_addr learned my addr 172.21.15.171:0/1932846486 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:19.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2389000700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412ecc0 0x7f2384130d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:19.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 -- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412ecc0 msgr2=0x7f2384130d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412ecc0 0x7f2384130d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 -- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238412e3a0 msgr2=0x7f23841307e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238412e3a0 0x7f23841307e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383e00700  1 -- 172.21.15.171:0/1932846486 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c009a70 con 0x7f238409c9f0
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.809+0000 7f2383400700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238412e3a0 0x7f23841307e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.810+0000 7f2383e00700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238409c9f0 0x7f23841302a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23740098f0 tx=0x7f2374004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.810+0000 7f237be00700  1 -- 172.21.15.171:0/1932846486 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374004240 con 0x7f238409c9f0
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.810+0000 7f237be00700  1 -- 172.21.15.171:0/1932846486 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237401f070 con 0x7f238409c9f0
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.810+0000 7f237be00700  1 -- 172.21.15.171:0/1932846486 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23740036a0 con 0x7f238409c9f0
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.810+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2374009550 con 0x7f238409c9f0
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.810+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23841329d0 con 0x7f238409c9f0
2024-03-29T09:08:19.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.811+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23840623e0 con 0x7f238409c9f0
2024-03-29T09:08:19.812 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.812+0000 7f237be00700  1 -- 172.21.15.171:0/1932846486 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f2374021030 con 0x7f238409c9f0
2024-03-29T09:08:19.812 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.812+0000 7f237be00700  1 -- 172.21.15.171:0/1932846486 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f23740568d0 con 0x7f238409c9f0
2024-03-29T09:08:19.812 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.813+0000 7f2383400700  1 -- 172.21.15.171:0/1932846486 >> v1:172.21.15.171:6816/38531 conn(0x7f23640421d0 legacy=0x7f2364044690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:19.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.816+0000 7f237be00700  1 -- 172.21.15.171:0/1932846486 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f2374001810 con 0x7f238409c9f0
2024-03-29T09:08:19.971 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:19.972+0000 7f8af3b93200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member
2024-03-29T09:08:19.971 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:19.972+0000 7f1ca2cbf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member
2024-03-29T09:08:19.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.980+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23840748d0 con 0x7f238409c9f0
2024-03-29T09:08:19.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.981+0000 7f237be00700  1 -- 172.21.15.171:0/1932846486 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v13) v1 ==== 74+0+8595 (secure 0 0 0) 0x7f2374001810 con 0x7f238409c9f0
2024-03-29T09:08:19.980 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:19.980 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":13,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T08:54:34.548920+0000","last_up_change":"2024-03-29T08:54:27.513354+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":39169}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":39169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":39169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":39169}]},"public_addr":"172.21.15.171:6800/39169","cluster_addr":"172.21.15.171:6801/39169","heartbeat_back_addr":"172.21.15.171:6803/39169","heartbeat_front_addr":"172.21.15.171:6802/39169","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":39170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":39170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":39170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":39170}]},"public_addr":"172.21.15.171:6804/39170","cluster_addr":"172.21.15.171:6805/39170","heartbeat_back_addr":"172.21.15.171:6807/39170","heartbeat_front_addr":"172.21.15.171:6806/39170","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":39179}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":39179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":39179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":39179}]},"public_addr":"172.21.15.171:6809/39179","cluster_addr":"172.21.15.171:6811/39179","heartbeat_back_addr":"172.21.15.171:6815/39179","heartbeat_front_addr":"172.21.15.171:6814/39179","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":39186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":39186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":39186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":39186}]},"public_addr":"172.21.15.171:6808/39186","cluster_addr":"172.21.15.171:6810/39186","heartbeat_back_addr":"172.21.15.171:6813/39186","heartbeat_front_addr":"172.21.15.171:6812/39186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:19.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.982+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 >> v1:172.21.15.171:6816/38531 conn(0x7f23640421d0 legacy=0x7f2364044690 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:19.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.982+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238409c9f0 msgr2=0x7f23841302a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:19.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.982+0000 7f2389a00700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238409c9f0 0x7f23841302a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23740098f0 tx=0x7f2374004750 comp rx=0 tx=0).stop
2024-03-29T09:08:19.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.983+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 shutdown_connections
2024-03-29T09:08:19.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.983+0000 7f2389a00700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f238412ecc0 0x7f2384130d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.983+0000 7f2389a00700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f238409c9f0 0x7f23841302a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.983+0000 7f2389a00700  1 --2- 172.21.15.171:0/1932846486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238412e3a0 0x7f23841307e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:19.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.983+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 >> 172.21.15.171:0/1932846486 conn(0x7f238409d530 msgr2=0x7f2384135140 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:19.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.983+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 shutdown_connections
2024-03-29T09:08:19.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:19.983+0000 7f2389a00700  1 -- 172.21.15.171:0/1932846486 wait complete.
2024-03-29T09:08:20.002 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats
2024-03-29T09:08:20.003 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats
2024-03-29T09:08:20.003 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats
2024-03-29T09:08:20.004 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats
2024-03-29T09:08:20.151 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:20.152+0000 7f8af3b93200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member
2024-03-29T09:08:20.160 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:20.160+0000 7f1ca2cbf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member
2024-03-29T09:08:20.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.258+0000 7fee3e000700  1  Processor -- start
2024-03-29T09:08:20.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.258+0000 7fee3e000700  1 --  start start
2024-03-29T09:08:20.258 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:20.259+0000 7f8af3b93200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member
2024-03-29T09:08:20.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.259+0000 7fee3e000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fee3812e6e0 0x7fee3812ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.259+0000 7fee3e000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812f130 0x7fee3812b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.259+0000 7fee3e000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812b6a0 0x7fee3812bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.259+0000 7fee3e000700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee381258a0 con 0x7fee3812e6e0
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.259+0000 7fee3e000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee381171a0 con 0x7fee3812f130
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.259+0000 7fee3e000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee38071bc0 con 0x7fee3812b6a0
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.260+0000 7fee37400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fee3812e6e0 0x7fee3812ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.260+0000 7fee37400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fee3812e6e0 0x7fee3812ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45448/0 (socket says 172.21.15.171:45448)
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.260+0000 7fee37400700  1 -- 172.21.15.171:0/3596178253 learned_addr learned my addr 172.21.15.171:0/3596178253 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.260+0000 7fee37e00700  1 --2- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812b6a0 0x7fee3812bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.260+0000 7fee36a00700  1 --2- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812f130 0x7fee3812b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.261+0000 7fee37e00700  1 -- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812f130 msgr2=0x7fee3812b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.261+0000 7fee37e00700  1 --2- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812f130 0x7fee3812b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.261+0000 7fee37e00700  1 -- 172.21.15.171:0/3596178253 >> v2:172.21.15.171:3300/0 conn(0x7fee3812e6e0 msgr2=0x7fee3812ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.261+0000 7fee37e00700  1 --2- 172.21.15.171:0/3596178253 >> v2:172.21.15.171:3300/0 conn(0x7fee3812e6e0 0x7fee3812ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.261+0000 7fee37e00700  1 -- 172.21.15.171:0/3596178253 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3812f530 con 0x7fee3812b6a0
2024-03-29T09:08:20.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.261+0000 7fee37e00700  1 --2- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812b6a0 0x7fee3812bb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee30009d90 tx=0x7fee3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f00b036a85f244a5 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.262+0000 7fee36000700  1 -- 172.21.15.171:0/3596178253 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30014ce0 con 0x7fee3812b6a0
2024-03-29T09:08:20.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.262+0000 7fee36000700  1 -- 172.21.15.171:0/3596178253 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30014e40 con 0x7fee3812b6a0
2024-03-29T09:08:20.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.262+0000 7fee36000700  1 -- 172.21.15.171:0/3596178253 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000baf0 con 0x7fee3812b6a0
2024-03-29T09:08:20.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.262+0000 7fee3e000700  1 -- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812b6a0 msgr2=0x7fee3812bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.262+0000 7fee3e000700  1 --2- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812b6a0 0x7fee3812bb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee30009d90 tx=0x7fee3000b330 comp rx=0 tx=0).stop
2024-03-29T09:08:20.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.263+0000 7fee3e000700  1 -- 172.21.15.171:0/3596178253 shutdown_connections
2024-03-29T09:08:20.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.263+0000 7fee3e000700  1 --2- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812b6a0 0x7fee3812bb30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.263+0000 7fee3e000700  1 --2- 172.21.15.171:0/3596178253 >> v2:172.21.15.171:3300/0 conn(0x7fee3812e6e0 0x7fee3812ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.263+0000 7fee3e000700  1 --2- 172.21.15.171:0/3596178253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812f130 0x7fee3812b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.263+0000 7fee3e000700  1 -- 172.21.15.171:0/3596178253 >> 172.21.15.171:0/3596178253 conn(0x7fee380a0ba0 msgr2=0x7fee380a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.263+0000 7fee3e000700  1 -- 172.21.15.171:0/3596178253 shutdown_connections
2024-03-29T09:08:20.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.263+0000 7fee3e000700  1 -- 172.21.15.171:0/3596178253 wait complete.
2024-03-29T09:08:20.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.265+0000 7fee3e000700  1  Processor -- start
2024-03-29T09:08:20.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.265+0000 7fee3e000700  1 --  start start
2024-03-29T09:08:20.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.266+0000 7fee3e000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812b6a0 0x7fee3806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.266+0000 7fee3e000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812e6e0 0x7fee3806f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.266+0000 7fee3e000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee3812f130 0x7fee3806f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.266+0000 7fee3e000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee38118070 con 0x7fee3812f130
2024-03-29T09:08:20.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.266+0000 7fee3e000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee38117850 con 0x7fee3812b6a0
2024-03-29T09:08:20.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.266+0000 7fee3e000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee381194b0 con 0x7fee3812e6e0
2024-03-29T09:08:20.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.267+0000 7fee36a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812e6e0 0x7fee3806f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.267+0000 7fee36a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812e6e0 0x7fee3806f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53482/0 (socket says 172.21.15.171:53482)
2024-03-29T09:08:20.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.267+0000 7fee36a00700  1 -- 172.21.15.171:0/1039369505 learned_addr learned my addr 172.21.15.171:0/1039369505 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.267+0000 7fee37e00700  1 --2- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee3812f130 0x7fee3806f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.267 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.267+0000 7fee37400700  1 --2- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812b6a0 0x7fee3806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.267 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.268+0000 7fee36a00700  1 -- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812b6a0 msgr2=0x7fee3806ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.267 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.268+0000 7fee36a00700  1 --2- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee3812b6a0 0x7fee3806ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.267 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.268+0000 7fee36a00700  1 -- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee3812f130 msgr2=0x7fee3806f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.268 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.268+0000 7fee36a00700  1 --2- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee3812f130 0x7fee3806f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.268 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.268+0000 7fee36a00700  1 -- 172.21.15.171:0/1039369505 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009a70 con 0x7fee3812e6e0
2024-03-29T09:08:20.268 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.268+0000 7fee37e00700  1 --2- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee3812f130 0x7fee3806f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.268 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.269+0000 7fee36a00700  1 --2- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812e6e0 0x7fee3806f230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee2400e840 tx=0x7fee2400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.268 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.269+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24013610 con 0x7fee3812e6e0
2024-03-29T09:08:20.269 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.269+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3806fcb0 con 0x7fee3812e6e0
2024-03-29T09:08:20.269 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.269+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24013770 con 0x7fee3812e6e0
2024-03-29T09:08:20.269 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.269+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24013b20 con 0x7fee3812e6e0
2024-03-29T09:08:20.269 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.269+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee38118b40 con 0x7fee3812e6e0
2024-03-29T09:08:20.270 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.271+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee10000fb0 con 0x7fee3812e6e0
2024-03-29T09:08:20.271 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.272+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7fee24013c80 con 0x7fee3812e6e0
2024-03-29T09:08:20.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.273+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fee24055630 con 0x7fee3812e6e0
2024-03-29T09:08:20.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.273+0000 7fee37400700  1 -- 172.21.15.171:0/1039369505 >> v1:172.21.15.171:6816/38531 conn(0x7fee180421a0 legacy=0x7fee18044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.273+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 --> v1:172.21.15.171:6808/39186 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee1804c5c0 con 0x7fee180488d0
2024-03-29T09:08:20.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.273+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee24057c10 con 0x7fee3812e6e0
2024-03-29T09:08:20.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.275+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== osd.3 v1:172.21.15.171:6808/39186 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7fee1804c5c0 con 0x7fee180488d0
2024-03-29T09:08:20.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.296+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 --> v1:172.21.15.171:6808/39186 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee10002d00 con 0x7fee180488d0
2024-03-29T09:08:20.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.296+0000 7fee2f400700  1 -- 172.21.15.171:0/1039369505 <== osd.3 v1:172.21.15.171:6808/39186 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4150412591) 0x7fee10002d00 con 0x7fee180488d0
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.297+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 >> v1:172.21.15.171:6808/39186 conn(0x7fee180488d0 legacy=0x7fee1804ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.297+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 >> v1:172.21.15.171:6816/38531 conn(0x7fee180421a0 legacy=0x7fee18044660 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.297+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812e6e0 msgr2=0x7fee3806f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.297+0000 7fee3e000700  1 --2- 172.21.15.171:0/1039369505 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fee3812e6e0 0x7fee3806f230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee2400e840 tx=0x7fee2400eb50 comp rx=0 tx=0).stop
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.297+0000 7fee37e00700  1 -- 172.21.15.171:0/1039369505 reap_dead start
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.298+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 shutdown_connections
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.298+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 >> 172.21.15.171:0/1039369505 conn(0x7fee380a0ba0 msgr2=0x7fee3812c2b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.298+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 shutdown_connections
2024-03-29T09:08:20.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.298+0000 7fee3e000700  1 -- 172.21.15.171:0/1039369505 wait complete.
2024-03-29T09:08:20.310 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:20.310+0000 7f1ca2cbf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member
2024-03-29T09:08:20.320 INFO:teuthology.orchestra.run.smithi171.stdout:38654705833
2024-03-29T09:08:20.320 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T09:08:20.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.322+0000 7f695a400700  1  Processor -- start
2024-03-29T09:08:20.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.325+0000 7fd4fda00700  1  Processor -- start
2024-03-29T09:08:20.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.325+0000 7fd4fda00700  1 --  start start
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.322+0000 7f695a400700  1 --  start start
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.324+0000 7f695a400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f695412f300 0x7f6954133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.324+0000 7f695a400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6954133fa0 0x7f6954136390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.324+0000 7f695a400700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69541171a0 con 0x7f695412e6e0
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.324+0000 7f695a400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69541258a0 con 0x7f695412f300
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.324+0000 7f695a400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6954071bc0 con 0x7f6954133fa0
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.325+0000 7f6953400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f695412e6e0 0x7f695412ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44418/0 (socket says 172.21.15.171:44418)
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.325+0000 7f6953400700  1 -- 172.21.15.171:0/1399022540 learned_addr learned my addr 172.21.15.171:0/1399022540 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.325+0000 7f6952a00700  1 --2- 172.21.15.171:0/1399022540 >> v2:172.21.15.171:3300/0 conn(0x7f695412f300 0x7f6954133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.326+0000 7f6952a00700  1 -- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6954133fa0 msgr2=0x7f6954136390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.326+0000 7f6952000700  1 -- 172.21.15.171:0/1399022540 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259886656 0 0) 0x7f6944001110 con 0x7f695412e6e0
2024-03-29T09:08:20.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.326+0000 7f6953e00700  1 --2- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6954133fa0 0x7f6954136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.326+0000 7f6952a00700  1 --2- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6954133fa0 0x7f6954136390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.326+0000 7f6952a00700  1 -- 172.21.15.171:0/1399022540 >> v1:172.21.15.171:6789/0 conn(0x7f695412e6e0 legacy=0x7f695412ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.326+0000 7f6952a00700  1 -- 172.21.15.171:0/1399022540 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540715a0 con 0x7f695412f300
2024-03-29T09:08:20.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7f6953e00700  1 --2- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6954133fa0 0x7f6954136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:20.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7f6952a00700  1 --2- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f6954133a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6940009840 tx=0x7f6940009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be48e5b24ea67a0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7fd4fda00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fd4f81335b0 0x7fd4f806fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7fd4fda00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4f8138e80 0x7fd4f813b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7fd4fda00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f80703d0 con 0x7fd4f81331d0
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7fd4fda00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f8071bc0 con 0x7fd4f81335b0
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7fd4fda00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f808ebc0 con 0x7fd4f8138e80
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7fd4f6a00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fd4f81331d0 0x7fd4f806f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44432/0 (socket says 172.21.15.171:44432)
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.327+0000 7fd4f6a00700  1 -- 172.21.15.171:0/1175736801 learned_addr learned my addr 172.21.15.171:0/1175736801 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.328+0000 7fd4f6000700  1 --2- 172.21.15.171:0/1175736801 >> v2:172.21.15.171:3300/0 conn(0x7fd4f81335b0 0x7fd4f806fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.328+0000 7fd4f7400700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4f8138e80 0x7fd4f813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.328+0000 7f6952000700  1 -- 172.21.15.171:0/1399022540 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940011830 con 0x7f695412f300
2024-03-29T09:08:20.330 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.328+0000 7fd8e5600700  1  Processor -- start
2024-03-29T09:08:20.330 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7f6952000700  1 -- 172.21.15.171:0/1399022540 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940011990 con 0x7f695412f300
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595145219 0 0) 0x7fd4f80703d0 con 0x7fd4f81331d0
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4dc0035b0 con 0x7fd4f81331d0
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 <== mon.0 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 549611634 0 0) 0x7fd4dc0035b0 con 0x7fd4f81331d0
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4f8138e80 msgr2=0x7fd4f813b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4f8138e80 0x7fd4f813b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 >> v2:172.21.15.171:3300/0 conn(0x7fd4f81335b0 msgr2=0x7fd4f806fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 --2- 172.21.15.171:0/1175736801 >> v2:172.21.15.171:3300/0 conn(0x7fd4f81335b0 0x7fd4f806fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f808b3a0 con 0x7fd4f81331d0
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 <== mon.0 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1029409515 0 0) 0x7fd4e8001670 con 0x7fd4f81331d0
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 >> v1:172.21.15.171:6789/0 conn(0x7fd4f81331d0 legacy=0x7fd4f806f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f5600700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4dc003a30 0x7fd4dc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f5600700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc0043d0 0x7fd4dc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f5600700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4dc004f70 0x7fd4dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f808ebc0 con 0x7fd4dc004f70
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc00bf50 con 0x7fd4dc003a30
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc00c090 con 0x7fd4dc0043d0
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd8e5600700  1 --  start start
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7fd8e5600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e012ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd8e5600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e01328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd8e5600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e00971e0 con 0x7fd8e0094ce0
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd8e5600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0096fb0 con 0x7fd8e01304c0
2024-03-29T09:08:20.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd8e5600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0066630 con 0x7fd8e012db90
2024-03-29T09:08:20.333 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.329+0000 7f6952000700  1 -- 172.21.15.171:0/1399022540 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940011d20 con 0x7f695412f300
2024-03-29T09:08:20.333 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7f695a400700  1 -- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 msgr2=0x7f6954133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.333 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7f695a400700  1 --2- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f6954133a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6940009840 tx=0x7f6940009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:20.333 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd8df400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e01328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.334 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7f695a400700  1 -- 172.21.15.171:0/1399022540 shutdown_connections
2024-03-29T09:08:20.334 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7f695a400700  1 --2- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6954133fa0 0x7f6954136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.334 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7f695a400700  1 --2- 172.21.15.171:0/1399022540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f6954133a60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.334 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7f695a400700  1 -- 172.21.15.171:0/1399022540 >> 172.21.15.171:0/1399022540 conn(0x7f69540a0ba0 msgr2=0x7f69540a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.334 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7f695a400700  1 -- 172.21.15.171:0/1399022540 shutdown_connections
2024-03-29T09:08:20.334 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7f695a400700  1 -- 172.21.15.171:0/1399022540 wait complete.
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd8de000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e012ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7fd8de000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e012ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53504/0 (socket says 172.21.15.171:53504)
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7fd8de000700  1 -- 172.21.15.171:0/1563871881 learned_addr learned my addr 172.21.15.171:0/1563871881 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7fd8dea00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fd8e0094ce0 0x7fd8e00950c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44438/0 (socket says 172.21.15.171:44438)
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.330+0000 7fd4f7400700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4f8138e80 0x7fd4f813b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7fd4f6a00700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4dc003a30 0x7fd4dc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7fd4f6000700  1 --2- 172.21.15.171:0/1175736801 >> v2:172.21.15.171:3300/0 conn(0x7fd4f81335b0 0x7fd4f806fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.332+0000 7fd4f6a00700  1 -- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc0043d0 msgr2=0x7fd4dc0048b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T09:08:20.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.331+0000 7fd8df400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e01328b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40334/0 (socket says 172.21.15.171:40334)
2024-03-29T09:08:20.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.332+0000 7fd4f7400700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4dc004f70 0x7fd4dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.332+0000 7fd8df400700  1 -- 172.21.15.171:0/1563871881 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 msgr2=0x7fd8e012ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd8df400700  1 --2- 172.21.15.171:0/1563871881 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e012ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd4f6000700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc0043d0 0x7fd4dc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd4f6a00700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc0043d0 0x7fd4dc0048b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd4f6a00700  1 -- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4dc004f70 msgr2=0x7fd4dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd8df400700  1 -- 172.21.15.171:0/1563871881 >> v1:172.21.15.171:6789/0 conn(0x7fd8e0094ce0 legacy=0x7fd8e00950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd4f6a00700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4dc004f70 0x7fd4dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd4f6a00700  1 -- 172.21.15.171:0/1175736801 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f808b3a0 con 0x7fd4dc003a30
2024-03-29T09:08:20.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.334+0000 7fd4f7400700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4dc004f70 0x7fd4dc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:20.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.333+0000 7fd8df400700  1 -- 172.21.15.171:0/1563871881 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00974a0 con 0x7fd8e01304c0
2024-03-29T09:08:20.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.334+0000 7fd8df400700  1 --2- 172.21.15.171:0/1563871881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e01328b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009870 tx=0x7fd8d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff034d026796bf7 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.334+0000 7fd4f6a00700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4dc003a30 0x7fd4dc003e50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800c510 tx=0x7fd4dc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e331be4e20da66b server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.334+0000 7f695a400700  1  Processor -- start
2024-03-29T09:08:20.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.334+0000 7fd8dd600700  1 -- 172.21.15.171:0/1563871881 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800f940 con 0x7fd8e01304c0
2024-03-29T09:08:20.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.334+0000 7fd8dd600700  1 -- 172.21.15.171:0/1563871881 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800faa0 con 0x7fd8e01304c0
2024-03-29T09:08:20.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.334+0000 7fd8dd600700  1 -- 172.21.15.171:0/1563871881 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800fe30 con 0x7fd8e01304c0
2024-03-29T09:08:20.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7f695a400700  1 --  start start
2024-03-29T09:08:20.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8005960 con 0x7fd4dc003a30
2024-03-29T09:08:20.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e8005ac0 con 0x7fd4dc003a30
2024-03-29T09:08:20.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd4f5600700  1 -- 172.21.15.171:0/1175736801 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8005e50 con 0x7fd4dc003a30
2024-03-29T09:08:20.340 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd8e5600700  1 -- 172.21.15.171:0/1563871881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 msgr2=0x7fd8e01328b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd8e5600700  1 --2- 172.21.15.171:0/1563871881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e01328b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009870 tx=0x7fd8d8009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:20.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd8e5600700  1 -- 172.21.15.171:0/1563871881 shutdown_connections
2024-03-29T09:08:20.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd8e5600700  1 --2- 172.21.15.171:0/1563871881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e01328b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd8e5600700  1 --2- 172.21.15.171:0/1563871881 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e012ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.335+0000 7fd8e5600700  1 -- 172.21.15.171:0/1563871881 >> 172.21.15.171:0/1563871881 conn(0x7fd8e009d450 msgr2=0x7fd8e009d860 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f695a400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695412e6e0 0x7f695406c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f695a400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f695406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7fd8e5600700  1 -- 172.21.15.171:0/1563871881 shutdown_connections
2024-03-29T09:08:20.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7fd8e5600700  1 -- 172.21.15.171:0/1563871881 wait complete.
2024-03-29T09:08:20.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7fd4fda00700  1 -- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4dc003a30 msgr2=0x7fd4dc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7fd4fda00700  1 --2- 172.21.15.171:0/1175736801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4dc003a30 0x7fd4dc003e50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800c510 tx=0x7fd4dc005880 comp rx=0 tx=0).stop
2024-03-29T09:08:20.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7fd4f7400700  1 -- 172.21.15.171:0/1175736801 reap_dead start
2024-03-29T09:08:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f6953400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695412e6e0 0x7f695406c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f6952a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f695406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f6952a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f695406c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45484/0 (socket says 172.21.15.171:45484)
2024-03-29T09:08:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f6953400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695412e6e0 0x7f695406c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40346/0 (socket says 172.21.15.171:40346)
2024-03-29T09:08:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f6952a00700  1 -- 172.21.15.171:0/1108830098 learned_addr learned my addr 172.21.15.171:0/1108830098 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.336+0000 7f695a400700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6954133fa0 0x7f695406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7fd4fda00700  1 -- 172.21.15.171:0/1175736801 shutdown_connections
2024-03-29T09:08:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7fd4fda00700  1 -- 172.21.15.171:0/1175736801 >> 172.21.15.171:0/1175736801 conn(0x7fd4f80a0ba0 msgr2=0x7fd4f80a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69541363a0 con 0x7f695412f300
2024-03-29T09:08:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69540701b0 con 0x7f695412e6e0
2024-03-29T09:08:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f695406da70 con 0x7f6954133fa0
2024-03-29T09:08:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7fd4fda00700  1 -- 172.21.15.171:0/1175736801 shutdown_connections
2024-03-29T09:08:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7fd4fda00700  1 -- 172.21.15.171:0/1175736801 wait complete.
2024-03-29T09:08:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.337+0000 7f6953e00700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6954133fa0 0x7f695406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7f6953400700  1 -- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6954133fa0 msgr2=0x7f695406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7f6953400700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6954133fa0 0x7f695406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7f6953400700  1 -- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 msgr2=0x7f695406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7f6953400700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f695406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7f6953400700  1 -- 172.21.15.171:0/1108830098 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400094a0 con 0x7f695412e6e0
2024-03-29T09:08:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7f6952a00700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f695412f300 0x7f695406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:20.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7fd8e5600700  1  Processor -- start
2024-03-29T09:08:20.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7fd8e5600700  1 --  start start
2024-03-29T09:08:20.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.338+0000 7f6953e00700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6954133fa0 0x7f695406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7f6953400700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695412e6e0 0x7f695406c1b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f694400c420 tx=0x7f694400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7fd4fda00700  1  Processor -- start
2024-03-29T09:08:20.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944004c80 con 0x7f695412e6e0
2024-03-29T09:08:20.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944004de0 con 0x7f695412e6e0
2024-03-29T09:08:20.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944007310 con 0x7f695412e6e0
2024-03-29T09:08:20.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695406d310 con 0x7f695412e6e0
2024-03-29T09:08:20.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7fd8e5600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8e0094ce0 0x7fd8e0129090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7fd8e5600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e01295d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7fd8e5600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e0129b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6954132fe0 con 0x7f695412e6e0
2024-03-29T09:08:20.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd8de000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e01295d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd8df400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e0129b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd8dea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8e0094ce0 0x7fd8e0129090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd8dea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8e0094ce0 0x7fd8e0129090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45496/0 (socket says 172.21.15.171:45496)
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd8df400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e0129b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40350/0 (socket says 172.21.15.171:40350)
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.341+0000 7fd8de000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e01295d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53518/0 (socket says 172.21.15.171:53518)
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.341+0000 7fd8dea00700  1 -- 172.21.15.171:0/436152035 learned_addr learned my addr 172.21.15.171:0/436152035 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.341+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e012b970 con 0x7fd8e0094ce0
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.341+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e012aa50 con 0x7fd8e01304c0
2024-03-29T09:08:20.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.339+0000 7fd4fda00700  1 --  start start
2024-03-29T09:08:20.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.341+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e012f820 con 0x7fd8e012db90
2024-03-29T09:08:20.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd4fda00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc003a30 0x7fd4f81d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd4fda00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4f8119740 0x7fd4f81d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd4fda00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4f8117010 0x7fd4f8117460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd4fda00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f806f310 con 0x7fd4f8117010
2024-03-29T09:08:20.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd4fda00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f811a1f0 con 0x7fd4f8119740
2024-03-29T09:08:20.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.341+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f6944007470 con 0x7f695412e6e0
2024-03-29T09:08:20.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.340+0000 7fd4fda00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f8118db0 con 0x7fd4dc003a30
2024-03-29T09:08:20.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.342+0000 7fd4f6a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc003a30 0x7fd4f81d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.342+0000 7fd4f6a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc003a30 0x7fd4f81d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53528/0 (socket says 172.21.15.171:53528)
2024-03-29T09:08:20.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.342+0000 7fd4f6a00700  1 -- 172.21.15.171:0/3919054623 learned_addr learned my addr 172.21.15.171:0/3919054623 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.342+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f692c000fb0 con 0x7f695412e6e0
2024-03-29T09:08:20.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.342+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f69440552a0 con 0x7f695412e6e0
2024-03-29T09:08:20.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 --> v1:172.21.15.171:6804/39170 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f693404c610 con 0x7f6934048920
2024-03-29T09:08:20.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd8de000700  1 -- 172.21.15.171:0/436152035 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 msgr2=0x7fd8e0129b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd8de000700  1 --2- 172.21.15.171:0/436152035 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8e01304c0 0x7fd8e0129b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd8de000700  1 -- 172.21.15.171:0/436152035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8e0094ce0 msgr2=0x7fd8e0129090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd8de000700  1 --2- 172.21.15.171:0/436152035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8e0094ce0 0x7fd8e0129090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd8de000700  1 -- 172.21.15.171:0/436152035 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80094a0 con 0x7fd8e012db90
2024-03-29T09:08:20.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7f6952a00700  1 -- 172.21.15.171:0/1108830098 >> v1:172.21.15.171:6816/38531 conn(0x7f69340421f0 legacy=0x7f69340446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd4f7400700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4f8117010 0x7fd4f8117460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd4f6000700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4f8119740 0x7fd4f81d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.343+0000 7fd4f6a00700  1 -- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4f8119740 msgr2=0x7fd4f81d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd4f6a00700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4f8119740 0x7fd4f81d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd4f6a00700  1 -- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4f8117010 msgr2=0x7fd4f8117460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd4f6a00700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4f8117010 0x7fd4f8117460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd4f6a00700  1 -- 172.21.15.171:0/3919054623 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f81d0d80 con 0x7fd4dc003a30
2024-03-29T09:08:20.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd8de000700  1 --2- 172.21.15.171:0/436152035 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e01295d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009db0 tx=0x7fd8c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd4f6000700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4f8119740 0x7fd4f81d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:20.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd4f7400700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4f8117010 0x7fd4f8117460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:20.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd4f6a00700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc003a30 0x7fd4f81d0300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001930 tx=0x7fd4e8001a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800caa0 con 0x7fd8e012db90
2024-03-29T09:08:20.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c800f040 con 0x7fd8e012db90
2024-03-29T09:08:20.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800ce00 con 0x7fd8e012db90
2024-03-29T09:08:20.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.344+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e012c7e0 con 0x7fd8e012db90
2024-03-29T09:08:20.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.345+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8001640 con 0x7fd4dc003a30
2024-03-29T09:08:20.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.345+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e80070d0 con 0x7fd4dc003a30
2024-03-29T09:08:20.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.345+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8007460 con 0x7fd4dc003a30
2024-03-29T09:08:20.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.345+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e012bb80 con 0x7fd8e012db90
2024-03-29T09:08:20.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.345+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6944007720 con 0x7f695412e6e0
2024-03-29T09:08:20.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.345+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f81179a0 con 0x7fd4dc003a30
2024-03-29T09:08:20.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.346+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f8117e60 con 0x7fd4dc003a30
2024-03-29T09:08:20.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.346+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== osd.1 v1:172.21.15.171:6804/39170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f693404c610 con 0x7f6934048920
2024-03-29T09:08:20.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.346+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8e0095f00 con 0x7fd8e012db90
2024-03-29T09:08:20.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.347+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4f8071d80 con 0x7fd4dc003a30
2024-03-29T09:08:20.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.347+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7fd8c8014480 con 0x7fd8e012db90
2024-03-29T09:08:20.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.348+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7fd4e80075c0 con 0x7fd4dc003a30
2024-03-29T09:08:20.359 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd8dea00700  1 -- 172.21.15.171:0/436152035 >> v1:172.21.15.171:6816/38531 conn(0x7fd8bc0421f0 legacy=0x7fd8bc0446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.359 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd8c8055cb0 con 0x7fd8e012db90
2024-03-29T09:08:20.359 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd4e8056f40 con 0x7fd4dc003a30
2024-03-29T09:08:20.359 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd4f6000700  1 -- 172.21.15.171:0/3919054623 >> v1:172.21.15.171:6816/38531 conn(0x7fd4d80421f0 legacy=0x7fd4d80446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.359 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 --> v1:172.21.15.171:6809/39179 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8bc04c610 con 0x7fd8bc048920
2024-03-29T09:08:20.359 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8c8058250 con 0x7fd8e012db90
2024-03-29T09:08:20.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 --> v1:172.21.15.171:6800/39169 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4d804c610 con 0x7fd4d8048920
2024-03-29T09:08:20.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.349+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4e8059420 con 0x7fd4dc003a30
2024-03-29T09:08:20.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.351+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== osd.0 v1:172.21.15.171:6800/39169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7fd4d804c610 con 0x7fd4d8048920
2024-03-29T09:08:20.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.351+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== osd.2 v1:172.21.15.171:6809/39179 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7fd8bc04c610 con 0x7fd8bc048920
2024-03-29T09:08:20.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.370+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 --> v1:172.21.15.171:6800/39169 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4f81195a0 con 0x7fd4d8048920
2024-03-29T09:08:20.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.370+0000 7fd4eea00700  1 -- 172.21.15.171:0/3919054623 <== osd.0 v1:172.21.15.171:6800/39169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4150412591) 0x7fd4f0007330 con 0x7fd4d8048920
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.371+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 >> v1:172.21.15.171:6800/39169 conn(0x7fd4d8048920 legacy=0x7fd4d804ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.371+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 >> v1:172.21.15.171:6816/38531 conn(0x7fd4d80421f0 legacy=0x7fd4d80446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.371+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc003a30 msgr2=0x7fd4f81d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.371+0000 7fd4fda00700  1 --2- 172.21.15.171:0/3919054623 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd4dc003a30 0x7fd4f81d0300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001930 tx=0x7fd4e8001a00 comp rx=0 tx=0).stop
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.371+0000 7fd4f7400700  1 -- 172.21.15.171:0/3919054623 reap_dead start
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.371+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 shutdown_connections
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.371+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 >> 172.21.15.171:0/3919054623 conn(0x7fd4f80a0ba0 msgr2=0x7fd4f808cf80 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.372+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 shutdown_connections
2024-03-29T09:08:20.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.372+0000 7fd4fda00700  1 -- 172.21.15.171:0/3919054623 wait complete.
2024-03-29T09:08:20.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.377+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 --> v1:172.21.15.171:6804/39170 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f692c002d00 con 0x7f6934048920
2024-03-29T09:08:20.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.378+0000 7f694b400700  1 -- 172.21.15.171:0/1108830098 <== osd.1 v1:172.21.15.171:6804/39170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 598221252) 0x7f692c002d00 con 0x7f6934048920
2024-03-29T09:08:20.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.378+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 >> v1:172.21.15.171:6804/39170 conn(0x7f6934048920 legacy=0x7f693404ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.378+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 >> v1:172.21.15.171:6816/38531 conn(0x7f69340421f0 legacy=0x7f69340446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:20.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.378+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695412e6e0 msgr2=0x7f695406c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.378+0000 7f695a400700  1 --2- 172.21.15.171:0/1108830098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695412e6e0 0x7f695406c1b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f694400c420 tx=0x7f694400c730 comp rx=0 tx=0).stop
2024-03-29T09:08:20.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.379+0000 7f6953e00700  1 -- 172.21.15.171:0/1108830098 reap_dead start
2024-03-29T09:08:20.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.379+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 shutdown_connections
2024-03-29T09:08:20.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.379+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 >> 172.21.15.171:0/1108830098 conn(0x7f69540a0ba0 msgr2=0x7f695412a760 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.379+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 shutdown_connections
2024-03-29T09:08:20.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.379+0000 7f695a400700  1 -- 172.21.15.171:0/1108830098 wait complete.
2024-03-29T09:08:20.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.383+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 --> v1:172.21.15.171:6809/39179 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8e006b2a0 con 0x7fd8bc048920
2024-03-29T09:08:20.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.383+0000 7fd8d6a00700  1 -- 172.21.15.171:0/436152035 <== osd.2 v1:172.21.15.171:6809/39179 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4150412591) 0x7fd8e006b2a0 con 0x7fd8bc048920
2024-03-29T09:08:20.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 >> v1:172.21.15.171:6809/39179 conn(0x7fd8bc048920 legacy=0x7fd8bc04ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 >> v1:172.21.15.171:6816/38531 conn(0x7fd8bc0421f0 legacy=0x7fd8bc0446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 msgr2=0x7fd8e01295d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8e5600700  1 --2- 172.21.15.171:0/436152035 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd8e012db90 0x7fd8e01295d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009db0 tx=0x7fd8c800c3a0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8df400700  1 -- 172.21.15.171:0/436152035 reap_dead start
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 shutdown_connections
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 >> 172.21.15.171:0/436152035 conn(0x7fd8e009d450 msgr2=0x7fd8e0093840 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.384+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 shutdown_connections
2024-03-29T09:08:20.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.385+0000 7fd8e5600700  1 -- 172.21.15.171:0/436152035 wait complete.
2024-03-29T09:08:20.400 INFO:teuthology.orchestra.run.smithi171.stdout:38654705833
2024-03-29T09:08:20.400 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T09:08:20.403 INFO:teuthology.orchestra.run.smithi171.stdout:38654705834
2024-03-29T09:08:20.403 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T09:08:20.415 INFO:teuthology.orchestra.run.smithi171.stdout:38654705833
2024-03-29T09:08:20.415 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T09:08:20.492 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:20.492+0000 7f8af3b93200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member
2024-03-29T09:08:20.539 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:20.539+0000 7f1ca2cbf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member
2024-03-29T09:08:20.594 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.595+0000 7f3303600700  1  Processor -- start
2024-03-29T09:08:20.594 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.595+0000 7f3303600700  1 --  start start
2024-03-29T09:08:20.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f3303600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f32fc12ee90 0x7f32fc133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f3303600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc133c60 0x7f32fc136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f3303600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc071520 con 0x7f32fc12e3a0
2024-03-29T09:08:20.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f3303600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc070d80 con 0x7f32fc12ee90
2024-03-29T09:08:20.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f3303600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0722b0 con 0x7f32fc133c60
2024-03-29T09:08:20.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f32fbe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f32fc12ee90 0x7f32fc133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f32fbe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f32fc12ee90 0x7f32fc133720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45522/0 (socket says 172.21.15.171:45522)
2024-03-29T09:08:20.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.596+0000 7f32fbe00700  1 -- 172.21.15.171:0/2503755034 learned_addr learned my addr 172.21.15.171:0/2503755034 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.597+0000 7f32fbe00700  1 -- 172.21.15.171:0/2503755034 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc133c60 msgr2=0x7f32fc136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.597+0000 7f32fbe00700  1 --2- 172.21.15.171:0/2503755034 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc133c60 0x7f32fc136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.597+0000 7f32fbe00700  1 -- 172.21.15.171:0/2503755034 >> v1:172.21.15.171:6789/0 conn(0x7f32fc12e3a0 legacy=0x7f32fc12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.597+0000 7f32fbe00700  1 -- 172.21.15.171:0/2503755034 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc071b40 con 0x7f32fc12ee90
2024-03-29T09:08:20.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.598+0000 7f32fbe00700  1 --2- 172.21.15.171:0/2503755034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc133720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32f00098f0 tx=0x7f32f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fbe8cf64f5dccb server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.598+0000 7f32fb400700  1 -- 172.21.15.171:0/2503755034 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000b8a0 con 0x7f32fc12ee90
2024-03-29T09:08:20.598 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.598+0000 7f32fb400700  1 -- 172.21.15.171:0/2503755034 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f000ba00 con 0x7f32fc12ee90
2024-03-29T09:08:20.598 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.598+0000 7f32fb400700  1 -- 172.21.15.171:0/2503755034 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000bd90 con 0x7f32fc12ee90
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.599+0000 7f3303600700  1 -- 172.21.15.171:0/2503755034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 msgr2=0x7f32fc133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.599+0000 7f3303600700  1 --2- 172.21.15.171:0/2503755034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc133720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32f00098f0 tx=0x7f32f0009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.599+0000 7f3303600700  1 -- 172.21.15.171:0/2503755034 shutdown_connections
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.599+0000 7f3303600700  1 --2- 172.21.15.171:0/2503755034 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc133c60 0x7f32fc136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.599+0000 7f3303600700  1 --2- 172.21.15.171:0/2503755034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc133720 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.599+0000 7f3303600700  1 -- 172.21.15.171:0/2503755034 >> 172.21.15.171:0/2503755034 conn(0x7f32fc0a0d70 msgr2=0x7f32fc0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.600+0000 7f3303600700  1 -- 172.21.15.171:0/2503755034 shutdown_connections
2024-03-29T09:08:20.599 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.600+0000 7f3303600700  1 -- 172.21.15.171:0/2503755034 wait complete.
2024-03-29T09:08:20.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.601+0000 7f3303600700  1  Processor -- start
2024-03-29T09:08:20.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.601+0000 7f3303600700  1 --  start start
2024-03-29T09:08:20.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.602+0000 7f3303600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc12e3a0 0x7f32fc1c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.602+0000 7f3303600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc1c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.601 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.602+0000 7f3303600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32fc133c60 0x7f32fc1c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.602+0000 7f3303600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc08ede0 con 0x7f32fc12ee90
2024-03-29T09:08:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.602+0000 7f3303600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc135ff0 con 0x7f32fc133c60
2024-03-29T09:08:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.602+0000 7f3303600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc08c3b0 con 0x7f32fc12e3a0
2024-03-29T09:08:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.603+0000 7f32fbe00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc1c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.603+0000 7f32fbe00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc1c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45524/0 (socket says 172.21.15.171:45524)
2024-03-29T09:08:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.603+0000 7f32fbe00700  1 -- 172.21.15.171:0/2304939769 learned_addr learned my addr 172.21.15.171:0/2304939769 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.602 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.603+0000 7f3301600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32fc133c60 0x7f32fc1c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.603+0000 7f3300c00700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc12e3a0 0x7f32fc1c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.604+0000 7f3301600700  1 -- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc12e3a0 msgr2=0x7f32fc1c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.604+0000 7f3301600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc12e3a0 0x7f32fc1c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.604+0000 7f3301600700  1 -- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 msgr2=0x7f32fc1c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.604+0000 7f3301600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc1c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.604+0000 7f3301600700  1 -- 172.21.15.171:0/2304939769 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0009550 con 0x7f32fc133c60
2024-03-29T09:08:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.604+0000 7f32fbe00700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc1c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.604+0000 7f3300c00700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc12e3a0 0x7f32fc1c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.605+0000 7f3301600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32fc133c60 0x7f32fc1c8590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f32f400bdf0 tx=0x7f32f4009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.605+0000 7f32f8c00700  1 -- 172.21.15.171:0/2304939769 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400cb30 con 0x7f32fc133c60
2024-03-29T09:08:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.605+0000 7f32f8c00700  1 -- 172.21.15.171:0/2304939769 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f400ccb0 con 0x7f32fc133c60
2024-03-29T09:08:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.605+0000 7f32f8c00700  1 -- 172.21.15.171:0/2304939769 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4014680 con 0x7f32fc133c60
2024-03-29T09:08:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.605+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc127e70 con 0x7f32fc133c60
2024-03-29T09:08:20.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.605+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc08ceb0 con 0x7f32fc133c60
2024-03-29T09:08:20.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.608+0000 7f32f8c00700  1 -- 172.21.15.171:0/2304939769 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f32f401d3b0 con 0x7f32fc133c60
2024-03-29T09:08:20.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.608+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc1171d0 con 0x7f32fc133c60
2024-03-29T09:08:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.608+0000 7f32f8c00700  1 -- 172.21.15.171:0/2304939769 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f32f4006e40 con 0x7f32fc133c60
2024-03-29T09:08:20.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.609+0000 7f3300c00700  1 -- 172.21.15.171:0/2304939769 >> v1:172.21.15.171:6816/38531 conn(0x7f32e00421f0 legacy=0x7f32e00446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.612 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.613+0000 7f32f8c00700  1 -- 172.21.15.171:0/2304939769 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f32f4019080 con 0x7f32fc133c60
2024-03-29T09:08:20.659 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.660+0000 7f2774800700  1  Processor -- start
2024-03-29T09:08:20.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.660+0000 7f2774800700  1 --  start start
2024-03-29T09:08:20.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.661+0000 7f2774800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f276c12e3a0 0x7f276c12e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.661+0000 7f2774800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.661+0000 7f2774800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c070d80 con 0x7f276c12ecc0
2024-03-29T09:08:20.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.661+0000 7f2774800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c0715e0 con 0x7f276c12e3a0
2024-03-29T09:08:20.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.661+0000 7f2774800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0722b0 con 0x7f276c12b530
2024-03-29T09:08:20.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.662+0000 7f2771e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f276c12e3a0 0x7f276c12e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.662+0000 7f2772800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.662+0000 7f2772800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c136740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53546/0 (socket says 172.21.15.171:53546)
2024-03-29T09:08:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.662+0000 7f2772800700  1 -- 172.21.15.171:0/3574797727 learned_addr learned my addr 172.21.15.171:0/3574797727 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.663+0000 7f2772800700  1 -- 172.21.15.171:0/3574797727 >> v2:172.21.15.171:3300/0 conn(0x7f276c12e3a0 msgr2=0x7f276c12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.663+0000 7f2772800700  1 --2- 172.21.15.171:0/3574797727 >> v2:172.21.15.171:3300/0 conn(0x7f276c12e3a0 0x7f276c12e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.663+0000 7f2772800700  1 -- 172.21.15.171:0/3574797727 >> v1:172.21.15.171:6789/0 conn(0x7f276c12ecc0 legacy=0x7f276c12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.663+0000 7f2772800700  1 -- 172.21.15.171:0/3574797727 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c071b40 con 0x7f276c12b530
2024-03-29T09:08:20.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.663+0000 7f2771e00700  1 --2- 172.21.15.171:0/3574797727 >> v2:172.21.15.171:3300/0 conn(0x7f276c12e3a0 0x7f276c12e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.664+0000 7f2772800700  1 --2- 172.21.15.171:0/3574797727 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c136740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2768009e50 tx=0x7f276800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec41b5c0eb041144 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.664+0000 7f2770a00700  1 -- 172.21.15.171:0/3574797727 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800e070 con 0x7f276c12b530
2024-03-29T09:08:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.664+0000 7f2770a00700  1 -- 172.21.15.171:0/3574797727 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800b910 con 0x7f276c12b530
2024-03-29T09:08:20.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.664+0000 7f2770a00700  1 -- 172.21.15.171:0/3574797727 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800bcc0 con 0x7f276c12b530
2024-03-29T09:08:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 -- 172.21.15.171:0/3574797727 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 msgr2=0x7f276c136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 --2- 172.21.15.171:0/3574797727 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c136740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2768009e50 tx=0x7f276800b330 comp rx=0 tx=0).stop
2024-03-29T09:08:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 -- 172.21.15.171:0/3574797727 shutdown_connections
2024-03-29T09:08:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 --2- 172.21.15.171:0/3574797727 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c136740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 --2- 172.21.15.171:0/3574797727 >> v2:172.21.15.171:3300/0 conn(0x7f276c12e3a0 0x7f276c12e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 -- 172.21.15.171:0/3574797727 >> 172.21.15.171:0/3574797727 conn(0x7f276c0a0d70 msgr2=0x7f276c0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 -- 172.21.15.171:0/3574797727 shutdown_connections
2024-03-29T09:08:20.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.665+0000 7f2774800700  1 -- 172.21.15.171:0/3574797727 wait complete.
2024-03-29T09:08:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.667+0000 7f2774800700  1  Processor -- start
2024-03-29T09:08:20.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.667+0000 7f2774800700  1 --  start start
2024-03-29T09:08:20.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2774800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c1c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2774800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f276c12e3a0 0x7f276c1c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2774800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f276c12ecc0 0x7f276c11a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2774800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c11cd10 con 0x7f276c12ecc0
2024-03-29T09:08:20.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2774800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c12ade0 con 0x7f276c12e3a0
2024-03-29T09:08:20.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2774800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276c11d5e0 con 0x7f276c12b530
2024-03-29T09:08:20.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2771e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c1c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2771e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c1c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53552/0 (socket says 172.21.15.171:53552)
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.668+0000 7f2771e00700  1 -- 172.21.15.171:0/2855258471 learned_addr learned my addr 172.21.15.171:0/2855258471 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2772800700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f276c12ecc0 0x7f276c11a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771400700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f276c12e3a0 0x7f276c1c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771e00700  1 -- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f276c12e3a0 msgr2=0x7f276c1c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771e00700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f276c12e3a0 0x7f276c1c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771e00700  1 -- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f276c12ecc0 msgr2=0x7f276c11a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771e00700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f276c12ecc0 0x7f276c11a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771e00700  1 -- 172.21.15.171:0/2855258471 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600094a0 con 0x7f276c12b530
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771400700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f276c12e3a0 0x7f276c1c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:20.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.669+0000 7f2771e00700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c1c3470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f276000ec10 tx=0x7f2760009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.670+0000 7f2766000700  1 -- 172.21.15.171:0/2855258471 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000c940 con 0x7f276c12b530
2024-03-29T09:08:20.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.670+0000 7f2766000700  1 -- 172.21.15.171:0/2855258471 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276000caa0 con 0x7f276c12b530
2024-03-29T09:08:20.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.670+0000 7f2766000700  1 -- 172.21.15.171:0/2855258471 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000ce10 con 0x7f276c12b530
2024-03-29T09:08:20.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.670+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2768009b30 con 0x7f276c12b530
2024-03-29T09:08:20.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.670+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c1c3ef0 con 0x7f276c12b530
2024-03-29T09:08:20.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.672+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c1171d0 con 0x7f276c12b530
2024-03-29T09:08:20.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.673+0000 7f2766000700  1 -- 172.21.15.171:0/2855258471 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f2760013470 con 0x7f276c12b530
2024-03-29T09:08:20.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.673+0000 7f2766000700  1 -- 172.21.15.171:0/2855258471 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f2760055ab0 con 0x7f276c12b530
2024-03-29T09:08:20.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.674+0000 7f2771400700  1 -- 172.21.15.171:0/2855258471 >> v1:172.21.15.171:6816/38531 conn(0x7f27500421a0 legacy=0x7f2750044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.680 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.681+0000 7f2766000700  1 -- 172.21.15.171:0/2855258471 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f2760036300 con 0x7f276c12b530
2024-03-29T09:08:20.724 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:20.724+0000 7f8af3b93200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member
2024-03-29T09:08:20.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.740+0000 7ff666e00700  1  Processor -- start
2024-03-29T09:08:20.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.740+0000 7ff666e00700  1 --  start start
2024-03-29T09:08:20.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.741+0000 7ff666e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff66012e3a0 0x7ff66012e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff666e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff660136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff666e00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff660070d80 con 0x7ff66012ecc0
2024-03-29T09:08:20.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff666e00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6600715e0 con 0x7ff66012e3a0
2024-03-29T09:08:20.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff666e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600722b0 con 0x7ff66012b530
2024-03-29T09:08:20.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff65fe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff66012e3a0 0x7ff66012e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.743+0000 7f5a67800700  1  Processor -- start
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.743+0000 7f5a67800700  1 --  start start
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7f5a67800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f5a6012e6e0 0x7f5a6012ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7f5a67800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6012b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7f5a67800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a601171a0 con 0x7f5a6012b6a0
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7f5a67800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a601258a0 con 0x7f5a6012e6e0
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7f5a67800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a60071bc0 con 0x7f5a6012f130
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7f5a65800700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f5a6012b6a0 0x7f5a60135a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44466/0 (socket says 172.21.15.171:44466)
2024-03-29T09:08:20.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7f5a65800700  1 -- 172.21.15.171:0/3159299322 learned_addr learned my addr 172.21.15.171:0/3159299322 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff664e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff660136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff664e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff660136740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53566/0 (socket says 172.21.15.171:53566)
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.742+0000 7ff664e00700  1 -- 172.21.15.171:0/4098156673 learned_addr learned my addr 172.21.15.171:0/4098156673 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.743+0000 7ff664e00700  1 -- 172.21.15.171:0/4098156673 >> v2:172.21.15.171:3300/0 conn(0x7ff66012e3a0 msgr2=0x7ff66012e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.743+0000 7ff664e00700  1 --2- 172.21.15.171:0/4098156673 >> v2:172.21.15.171:3300/0 conn(0x7ff66012e3a0 0x7ff66012e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.743+0000 7ff664e00700  1 -- 172.21.15.171:0/4098156673 >> v1:172.21.15.171:6789/0 conn(0x7ff66012ecc0 legacy=0x7ff66012ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.743+0000 7ff664e00700  1 -- 172.21.15.171:0/4098156673 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660071b40 con 0x7ff66012b530
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.743+0000 7ff664e00700  1 --2- 172.21.15.171:0/4098156673 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff660136740 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff658009e50 tx=0x7ff65800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e83a9a051dc4d4ca server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7ff65ea00700  1 -- 172.21.15.171:0/4098156673 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65800e070 con 0x7ff66012b530
2024-03-29T09:08:20.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7ff65ea00700  1 -- 172.21.15.171:0/4098156673 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658003a20 con 0x7ff66012b530
2024-03-29T09:08:20.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.744+0000 7ff65ea00700  1 -- 172.21.15.171:0/4098156673 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658003dd0 con 0x7ff66012b530
2024-03-29T09:08:20.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7ff666e00700  1 -- 172.21.15.171:0/4098156673 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 msgr2=0x7ff660136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7ff666e00700  1 --2- 172.21.15.171:0/4098156673 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff660136740 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff658009e50 tx=0x7ff65800b330 comp rx=0 tx=0).stop
2024-03-29T09:08:20.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7f5a5fe00700  1 --2- 172.21.15.171:0/3159299322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6012b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7f5a64e00700  1 --2- 172.21.15.171:0/3159299322 >> v2:172.21.15.171:3300/0 conn(0x7f5a6012e6e0 0x7f5a6012ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7ff666e00700  1 -- 172.21.15.171:0/4098156673 shutdown_connections
2024-03-29T09:08:20.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7ff666e00700  1 --2- 172.21.15.171:0/4098156673 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff660136740 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7ff666e00700  1 --2- 172.21.15.171:0/4098156673 >> v2:172.21.15.171:3300/0 conn(0x7ff66012e3a0 0x7ff66012e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.745+0000 7ff666e00700  1 -- 172.21.15.171:0/4098156673 >> 172.21.15.171:0/4098156673 conn(0x7ff6600a0d70 msgr2=0x7ff6600a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.746+0000 7f5a5fe00700  1 -- 172.21.15.171:0/3159299322 >> v2:172.21.15.171:3300/0 conn(0x7f5a6012e6e0 msgr2=0x7f5a6012ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.746+0000 7f5a5f400700  1 -- 172.21.15.171:0/3159299322 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035817382 0 0) 0x7f5a58001490 con 0x7f5a6012b6a0
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.746+0000 7f5a5fe00700  1 --2- 172.21.15.171:0/3159299322 >> v2:172.21.15.171:3300/0 conn(0x7f5a6012e6e0 0x7f5a6012ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.746+0000 7f5a5fe00700  1 -- 172.21.15.171:0/3159299322 >> v1:172.21.15.171:6789/0 conn(0x7f5a6012b6a0 legacy=0x7f5a60135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.746+0000 7f5a5fe00700  1 -- 172.21.15.171:0/3159299322 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6012f530 con 0x7f5a6012f130
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.747+0000 7f5a64e00700  1 --2- 172.21.15.171:0/3159299322 >> v2:172.21.15.171:3300/0 conn(0x7f5a6012e6e0 0x7f5a6012ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.747+0000 7f5a5fe00700  1 --2- 172.21.15.171:0/3159299322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6012b160 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009840 tx=0x7f5a50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35e6fc7d47f9ef5e server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.746+0000 7ff666e00700  1 -- 172.21.15.171:0/4098156673 shutdown_connections
2024-03-29T09:08:20.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.746+0000 7ff666e00700  1 -- 172.21.15.171:0/4098156673 wait complete.
2024-03-29T09:08:20.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.747+0000 7f5a5f400700  1 -- 172.21.15.171:0/3159299322 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50011830 con 0x7f5a6012f130
2024-03-29T09:08:20.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.747+0000 7f5a5f400700  1 -- 172.21.15.171:0/3159299322 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a50011990 con 0x7f5a6012f130
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.747+0000 7f5a5f400700  1 -- 172.21.15.171:0/3159299322 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50011d20 con 0x7f5a6012f130
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.748+0000 7f5a67800700  1 -- 172.21.15.171:0/3159299322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 msgr2=0x7f5a6012b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.748+0000 7f5a67800700  1 --2- 172.21.15.171:0/3159299322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6012b160 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009840 tx=0x7f5a50009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.748+0000 7f5a67800700  1 -- 172.21.15.171:0/3159299322 shutdown_connections
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.748+0000 7f5a67800700  1 --2- 172.21.15.171:0/3159299322 >> v2:172.21.15.171:3300/0 conn(0x7f5a6012e6e0 0x7f5a6012ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.748+0000 7f5a67800700  1 --2- 172.21.15.171:0/3159299322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6012b160 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.748+0000 7f5a67800700  1 -- 172.21.15.171:0/3159299322 >> 172.21.15.171:0/3159299322 conn(0x7f5a600a0ba0 msgr2=0x7f5a600a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.748+0000 7f5a67800700  1 -- 172.21.15.171:0/3159299322 shutdown_connections
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.749+0000 7f5a67800700  1 -- 172.21.15.171:0/3159299322 wait complete.
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.750+0000 7ff666e00700  1  Processor -- start
2024-03-29T09:08:20.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.750+0000 7ff666e00700  1 --  start start
2024-03-29T09:08:20.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7f5a67800700  1  Processor -- start
2024-03-29T09:08:20.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7ff666e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff6601c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7ff666e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66012ecc0 0x7ff6601c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7ff666e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff660120200 0x7ff66008cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7ff666e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66008ea80 con 0x7ff66012ecc0
2024-03-29T09:08:20.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7ff666e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66008e5a0 con 0x7ff660120200
2024-03-29T09:08:20.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7f5a67800700  1 --  start start
2024-03-29T09:08:20.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7ff666e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff66011fd20 con 0x7ff66012b530
2024-03-29T09:08:20.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.751+0000 7ff664e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff660120200 0x7ff66008cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7ff664e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff660120200 0x7ff66008cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40408/0 (socket says 172.21.15.171:40408)
2024-03-29T09:08:20.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7ff664e00700  1 -- 172.21.15.171:0/2712374618 learned_addr learned my addr 172.21.15.171:0/2712374618 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7f5a67800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a6012b6a0 0x7f5a601c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7f5a67800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5a6012e6e0 0x7f5a601c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7f5a67800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6011a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:20.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7f5a67800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6011d8d0 con 0x7f5a6012b6a0
2024-03-29T09:08:20.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7f5a67800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6011c820 con 0x7f5a6012f130
2024-03-29T09:08:20.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7f5a67800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a601286b0 con 0x7f5a6012e6e0
2024-03-29T09:08:20.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7ff664e00700  1 -- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 msgr2=0x7ff6601c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7ff664e00700  1 --2- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff6601c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7ff664e00700  1 -- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66012ecc0 msgr2=0x7ff6601c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7ff664e00700  1 --2- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66012ecc0 0x7ff6601c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.752+0000 7ff664e00700  1 -- 172.21.15.171:0/2712374618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff658009b30 con 0x7ff660120200
2024-03-29T09:08:20.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6011a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6011a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40420/0 (socket says 172.21.15.171:40420)
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 -- 172.21.15.171:0/1811497084 learned_addr learned my addr 172.21.15.171:0/1811497084 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 -- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5a6012e6e0 msgr2=0x7f5a601c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 --2- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5a6012e6e0 0x7f5a601c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 -- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a6012b6a0 msgr2=0x7f5a601c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 --2- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a6012b6a0 0x7f5a601c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.753+0000 7f5a65800700  1 -- 172.21.15.171:0/1811497084 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0094a0 con 0x7f5a6012f130
2024-03-29T09:08:20.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.754+0000 7ff664e00700  1 --2- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff660120200 0x7ff66008cad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff65800b370 tx=0x7ff658004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.754+0000 7f5a65800700  1 --2- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6011a3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800caf0 tx=0x7f5a5800ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:20.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.754+0000 7ff657e00700  1 -- 172.21.15.171:0/2712374618 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658004440 con 0x7ff660120200
2024-03-29T09:08:20.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.754+0000 7ff657e00700  1 -- 172.21.15.171:0/2712374618 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6580045a0 con 0x7ff660120200
2024-03-29T09:08:20.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.754+0000 7ff657e00700  1 -- 172.21.15.171:0/2712374618 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658004910 con 0x7ff660120200
2024-03-29T09:08:20.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.754+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6601c8740 con 0x7ff660120200
2024-03-29T09:08:20.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.755+0000 7f5a5cc00700  1 -- 172.21.15.171:0/1811497084 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800aa90 con 0x7f5a6012f130
2024-03-29T09:08:20.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.755+0000 7f5a5cc00700  1 -- 172.21.15.171:0/1811497084 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5800abf0 con 0x7f5a6012f130
2024-03-29T09:08:20.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.755+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a500094a0 con 0x7f5a6012f130
2024-03-29T09:08:20.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.755+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6011cf40 con 0x7f5a6012f130
2024-03-29T09:08:20.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.755+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66008d1f0 con 0x7ff660120200
2024-03-29T09:08:20.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.756+0000 7f5a5cc00700  1 -- 172.21.15.171:0/1811497084 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a580070d0 con 0x7f5a6012f130
2024-03-29T09:08:20.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.756+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6011cb50 con 0x7f5a6012f130
2024-03-29T09:08:20.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.758+0000 7ff657e00700  1 -- 172.21.15.171:0/2712374618 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7ff65801c440 con 0x7ff660120200
2024-03-29T09:08:20.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.758+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6601c8960 con 0x7ff660120200
2024-03-29T09:08:20.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.759+0000 7ff657e00700  1 -- 172.21.15.171:0/2712374618 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7ff658056c70 con 0x7ff660120200
2024-03-29T09:08:20.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.759+0000 7ff65fe00700  1 -- 172.21.15.171:0/2712374618 >> v1:172.21.15.171:6816/38531 conn(0x7ff63c0421f0 legacy=0x7ff63c0446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.759+0000 7f5a5cc00700  1 -- 172.21.15.171:0/1811497084 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f5a58007230 con 0x7f5a6012f130
2024-03-29T09:08:20.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.760+0000 7f5a5cc00700  1 -- 172.21.15.171:0/1811497084 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f5a580556c0 con 0x7f5a6012f130
2024-03-29T09:08:20.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.760+0000 7f5a64e00700  1 -- 172.21.15.171:0/1811497084 >> v1:172.21.15.171:6816/38531 conn(0x7f5a400421f0 legacy=0x7f5a400446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.766+0000 7ff657e00700  1 -- 172.21.15.171:0/2712374618 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7ff658017030 con 0x7ff660120200
2024-03-29T09:08:20.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.774+0000 7f5a5cc00700  1 -- 172.21.15.171:0/1811497084 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f5a58035e30 con 0x7f5a6012f130
2024-03-29T09:08:20.779 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:20.780+0000 7f1ca2cbf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member
2024-03-29T09:08:20.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.810+0000 7f3300c00700  1 -- 172.21.15.171:0/2304939769 >> v1:172.21.15.171:6816/38531 conn(0x7f32e00421f0 legacy=0x7f32e00446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.813+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32fc0623e0 con 0x7f32fc133c60
2024-03-29T09:08:20.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.814+0000 7f32f8c00700  1 -- 172.21.15.171:0/2304939769 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32f4039a20 con 0x7f32fc133c60
2024-03-29T09:08:20.813 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.816+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 >> v1:172.21.15.171:6816/38531 conn(0x7f32e00421f0 legacy=0x7f32e00446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.816+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32fc133c60 msgr2=0x7f32fc1c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.816+0000 7f3303600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32fc133c60 0x7f32fc1c8590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f32f400bdf0 tx=0x7f32f4009ed0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.817+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 shutdown_connections
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.817+0000 7f3303600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32fc133c60 0x7f32fc1c8590 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.817+0000 7f3303600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f32fc12e3a0 0x7f32fc1c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.817+0000 7f3303600700  1 --2- 172.21.15.171:0/2304939769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32fc12ee90 0x7f32fc1c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.817+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 >> 172.21.15.171:0/2304939769 conn(0x7f32fc0a0d70 msgr2=0x7f32fc12d380 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.817+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 shutdown_connections
2024-03-29T09:08:20.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.817+0000 7f3303600700  1 -- 172.21.15.171:0/2304939769 wait complete.
2024-03-29T09:08:20.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.3
2024-03-29T09:08:20.870 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:20.871+0000 7f8af3b93200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member
2024-03-29T09:08:20.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.873+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f276c0623e0 con 0x7f276c12b530
2024-03-29T09:08:20.874 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.875+0000 7f2771400700  1 -- 172.21.15.171:0/2855258471 >> v1:172.21.15.171:6816/38531 conn(0x7f27500421a0 legacy=0x7f2750044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.878 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.878+0000 7f2766000700  1 -- 172.21.15.171:0/2855258471 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2760017030 con 0x7f276c12b530
2024-03-29T09:08:20.878 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:20.880 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 >> v1:172.21.15.171:6816/38531 conn(0x7f27500421a0 legacy=0x7f2750044660 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:20.880 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 msgr2=0x7f276c1c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:20.880 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c1c3470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f276000ec10 tx=0x7f2760009ec0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.880 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 shutdown_connections
2024-03-29T09:08:20.881 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f276c12ecc0 0x7f276c11a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.881 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f276c12b530 0x7f276c1c3470 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.881 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 --2- 172.21.15.171:0/2855258471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f276c12e3a0 0x7f276c1c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:20.881 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 >> 172.21.15.171:0/2855258471 conn(0x7f276c0a0d70 msgr2=0x7f276c06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:20.881 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 shutdown_connections
2024-03-29T09:08:20.881 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.881+0000 7f2774800700  1 -- 172.21.15.171:0/2855258471 wait complete.
2024-03-29T09:08:20.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.0
2024-03-29T09:08:20.932 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:20.933+0000 7f1ca2cbf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member
2024-03-29T09:08:20.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.960+0000 7ff65fe00700  1 -- 172.21.15.171:0/2712374618 >> v1:172.21.15.171:6816/38531 conn(0x7ff63c0421f0 legacy=0x7ff63c0446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:20.961+0000 7f5a64e00700  1 -- 172.21.15.171:0/1811497084 >> v1:172.21.15.171:6816/38531 conn(0x7f5a400421f0 legacy=0x7f5a400446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:20.998 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:20.999+0000 7f8af3b93200 -1 mgr[py] Module status has missing NOTIFY_TYPES member
2024-03-29T09:08:21.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.008+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff6601171d0 con 0x7ff660120200
2024-03-29T09:08:21.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.008+0000 7ff657e00700  1 -- 172.21.15.171:0/2712374618 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff658006a10 con 0x7ff660120200
2024-03-29T09:08:21.008 INFO:teuthology.orchestra.run.smithi171.stdout:38654705832
2024-03-29T09:08:21.010 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.010+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 >> v1:172.21.15.171:6816/38531 conn(0x7ff63c0421f0 legacy=0x7ff63c0446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:21.010 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.010+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff660120200 msgr2=0x7ff66008cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:21.010 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.010+0000 7ff666e00700  1 --2- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff660120200 0x7ff66008cad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff65800b370 tx=0x7ff658004ad0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.010 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.011+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 shutdown_connections
2024-03-29T09:08:21.010 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.011+0000 7ff666e00700  1 --2- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff660120200 0x7ff66008cad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.011 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.011+0000 7ff666e00700  1 --2- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff66012b530 0x7ff6601c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.011 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.011+0000 7ff666e00700  1 --2- 172.21.15.171:0/2712374618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66012ecc0 0x7ff6601c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.011 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.011+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 >> 172.21.15.171:0/2712374618 conn(0x7ff6600a0d70 msgr2=0x7ff660124ce0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:21.011 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.011+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 shutdown_connections
2024-03-29T09:08:21.011 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.011+0000 7ff666e00700  1 -- 172.21.15.171:0/2712374618 wait complete.
2024-03-29T09:08:21.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.028+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a601171a0 con 0x7f5a6012f130
2024-03-29T09:08:21.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.029+0000 7f5a5cc00700  1 -- 172.21.15.171:0/1811497084 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a601171a0 con 0x7f5a6012f130
2024-03-29T09:08:21.031 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:21.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705834 got 38654705832 for osd.1
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 >> v1:172.21.15.171:6816/38531 conn(0x7f5a400421f0 legacy=0x7f5a400446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 msgr2=0x7f5a6011a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 --2- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6011a3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800caf0 tx=0x7f5a5800ceb0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 shutdown_connections
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 --2- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a6012f130 0x7f5a6011a3f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 --2- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a6012b6a0 0x7f5a601c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 --2- 172.21.15.171:0/1811497084 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5a6012e6e0 0x7f5a601c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 >> 172.21.15.171:0/1811497084 conn(0x7f5a600a0ba0 msgr2=0x7f5a6006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:21.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 shutdown_connections
2024-03-29T09:08:21.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:21.031+0000 7f5a67800700  1 -- 172.21.15.171:0/1811497084 wait complete.
2024-03-29T09:08:21.045 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:21.046+0000 7f1ca2cbf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member
2024-03-29T09:08:21.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.2
2024-03-29T09:08:21.101 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:21.102+0000 7f8af3b93200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member
2024-03-29T09:08:21.145 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:21.146+0000 7f1ca2cbf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member
2024-03-29T09:08:21.303 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:21.304+0000 7f8af3b93200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member
2024-03-29T09:08:21.331 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:21.331+0000 7f1ca2cbf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member
2024-03-29T09:08:21.518 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:21.519+0000 7f8af3b93200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member
2024-03-29T09:08:21.519 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:21.519+0000 7f1ca2cbf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member
2024-03-29T09:08:21.621 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:21.621+0000 7f1ca2cbf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member
2024-03-29T09:08:21.621 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:21.622+0000 7f8af3b93200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member
2024-03-29T09:08:21.836 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T09:08:21.900 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T09:08:21.943 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:21.944+0000 7f8af3b93200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member
2024-03-29T09:08:21.944 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:21.945+0000 7f1ca2cbf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member
2024-03-29T09:08:22.033 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T09:08:22.042 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:22.042+0000 7f8af3b93200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member
2024-03-29T09:08:22.050 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:22.050+0000 7f1ca2cbf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member
2024-03-29T09:08:22.051 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T09:08:22.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.056+0000 7ffbdca00700  1  Processor -- start
2024-03-29T09:08:22.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.056+0000 7ffbdca00700  1 --  start start
2024-03-29T09:08:22.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.057+0000 7ffbdca00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812e6e0 0x7ffbd812ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.057+0000 7ffbdca00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ffbd812f130 0x7ffbd812b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.057+0000 7ffbdca00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd81171a0 con 0x7ffbd812b6a0
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.057+0000 7ffbdca00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd81258a0 con 0x7ffbd812f130
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.058+0000 7ffbdca00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8071bc0 con 0x7ffbd812e6e0
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.058+0000 7ffbd5400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ffbd812f130 0x7ffbd812b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.058+0000 7ffbd5e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812e6e0 0x7ffbd812ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.058+0000 7ffbd5400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ffbd812f130 0x7ffbd812b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45588/0 (socket says 172.21.15.171:45588)
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.058+0000 7ffbd5400700  1 -- 172.21.15.171:0/2609090481 learned_addr learned my addr 172.21.15.171:0/2609090481 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:22.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.058+0000 7ffbd6800700  1 --1- 172.21.15.171:0/2609090481 >> v1:172.21.15.171:6789/0 conn(0x7ffbd812b6a0 0x7ffbd8135a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44468/0 (socket says 172.21.15.171:44468)
2024-03-29T09:08:22.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.059+0000 7ffbd5e00700  1 -- 172.21.15.171:0/2609090481 >> v2:172.21.15.171:3300/0 conn(0x7ffbd812f130 msgr2=0x7ffbd812b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:22.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.059+0000 7ffbd5e00700  1 --2- 172.21.15.171:0/2609090481 >> v2:172.21.15.171:3300/0 conn(0x7ffbd812f130 0x7ffbd812b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.059+0000 7ffbd5e00700  1 -- 172.21.15.171:0/2609090481 >> v1:172.21.15.171:6789/0 conn(0x7ffbd812b6a0 legacy=0x7ffbd8135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.059+0000 7ffbd5e00700  1 -- 172.21.15.171:0/2609090481 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd812f530 con 0x7ffbd812e6e0
2024-03-29T09:08:22.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.060+0000 7ffbd5e00700  1 --2- 172.21.15.171:0/2609090481 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812e6e0 0x7ffbd812ebf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009840 tx=0x7ffbc0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26bc376282c01501 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.060+0000 7ffbd4a00700  1 -- 172.21.15.171:0/2609090481 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0011830 con 0x7ffbd812e6e0
2024-03-29T09:08:22.060 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.060+0000 7ffbd4a00700  1 -- 172.21.15.171:0/2609090481 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0011990 con 0x7ffbd812e6e0
2024-03-29T09:08:22.060 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.060+0000 7ffbd4a00700  1 -- 172.21.15.171:0/2609090481 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0011830 con 0x7ffbd812e6e0
2024-03-29T09:08:22.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.061+0000 7ffbdca00700  1 -- 172.21.15.171:0/2609090481 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812e6e0 msgr2=0x7ffbd812ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.061+0000 7ffbdca00700  1 --2- 172.21.15.171:0/2609090481 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812e6e0 0x7ffbd812ebf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009840 tx=0x7ffbc0009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:22.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.062+0000 7ffbdca00700  1 -- 172.21.15.171:0/2609090481 shutdown_connections
2024-03-29T09:08:22.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.062+0000 7ffbdca00700  1 --2- 172.21.15.171:0/2609090481 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812e6e0 0x7ffbd812ebf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.062+0000 7ffbdca00700  1 --2- 172.21.15.171:0/2609090481 >> v2:172.21.15.171:3300/0 conn(0x7ffbd812f130 0x7ffbd812b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.062+0000 7ffbdca00700  1 -- 172.21.15.171:0/2609090481 >> 172.21.15.171:0/2609090481 conn(0x7ffbd80a0ba0 msgr2=0x7ffbd80a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.062+0000 7ffbdca00700  1 -- 172.21.15.171:0/2609090481 shutdown_connections
2024-03-29T09:08:22.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.062+0000 7ffbdca00700  1 -- 172.21.15.171:0/2609090481 wait complete.
2024-03-29T09:08:22.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.064+0000 7ffbdca00700  1  Processor -- start
2024-03-29T09:08:22.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.064+0000 7ffbdca00700  1 --  start start
2024-03-29T09:08:22.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.065+0000 7ffbdca00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd812b6a0 0x7ffbd811a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.065+0000 7ffbdca00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd812e6e0 0x7ffbd811a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.065+0000 7ffbdca00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812f130 0x7ffbd811aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.065+0000 7ffbdca00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd811d840 con 0x7ffbd812e6e0
2024-03-29T09:08:22.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.065+0000 7ffbdca00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd811dc10 con 0x7ffbd812b6a0
2024-03-29T09:08:22.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.065+0000 7ffbdca00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8128640 con 0x7ffbd812f130
2024-03-29T09:08:22.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.066+0000 7ffbd5400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd812e6e0 0x7ffbd811a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.066 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.066+0000 7ffbd6800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812f130 0x7ffbd811aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.066 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.066+0000 7ffbd5400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd812e6e0 0x7ffbd811a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45604/0 (socket says 172.21.15.171:45604)
2024-03-29T09:08:22.066 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.066+0000 7ffbd5400700  1 -- 172.21.15.171:0/521327352 learned_addr learned my addr 172.21.15.171:0/521327352 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:22.066 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.066+0000 7ffbd5e00700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd812b6a0 0x7ffbd811a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.067 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.067+0000 7ffbd5400700  1 -- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812f130 msgr2=0x7ffbd811aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.067 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.067+0000 7ffbd5400700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812f130 0x7ffbd811aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.067 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.067+0000 7ffbd5400700  1 -- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd812b6a0 msgr2=0x7ffbd811a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.067 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.067+0000 7ffbd5400700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd812b6a0 0x7ffbd811a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.067 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.067+0000 7ffbd5400700  1 -- 172.21.15.171:0/521327352 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00094a0 con 0x7ffbd812e6e0
2024-03-29T09:08:22.067 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.067+0000 7ffbd5e00700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd812b6a0 0x7ffbd811a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:22.068 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.067+0000 7ffbd6800700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812f130 0x7ffbd811aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:22.068 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.068+0000 7ffbd5400700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd812e6e0 0x7ffbd811a980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e910 tx=0x7ffbc800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.068 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.068+0000 7ffbce000700  1 -- 172.21.15.171:0/521327352 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800ee60 con 0x7ffbd812e6e0
2024-03-29T09:08:22.068 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.068+0000 7ffbce000700  1 -- 172.21.15.171:0/521327352 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800c850 con 0x7ffbd812e6e0
2024-03-29T09:08:22.068 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.068+0000 7ffbce000700  1 -- 172.21.15.171:0/521327352 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800cbc0 con 0x7ffbd812e6e0
2024-03-29T09:08:22.068 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.068+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd811bfd0 con 0x7ffbd812e6e0
2024-03-29T09:08:22.068 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.069+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd81c36a0 con 0x7ffbd812e6e0
2024-03-29T09:08:22.071 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.071+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd812af10 con 0x7ffbd812e6e0
2024-03-29T09:08:22.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.071+0000 7ffbce000700  1 -- 172.21.15.171:0/521327352 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7ffbc800cd20 con 0x7ffbd812e6e0
2024-03-29T09:08:22.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.073+0000 7ffbce000700  1 -- 172.21.15.171:0/521327352 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7ffbc8055880 con 0x7ffbd812e6e0
2024-03-29T09:08:22.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.073+0000 7ffbd5e00700  1 -- 172.21.15.171:0/521327352 >> v1:172.21.15.171:6816/38531 conn(0x7ffbb40421f0 legacy=0x7ffbb40446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:22.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.080+0000 7ffbce000700  1 -- 172.21.15.171:0/521327352 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7ffbc8036130 con 0x7ffbd812e6e0
2024-03-29T09:08:22.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.155+0000 7fd788a00700  1  Processor -- start
2024-03-29T09:08:22.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.155+0000 7fd788a00700  1 --  start start
2024-03-29T09:08:22.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.156+0000 7fd788a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd78412e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.156+0000 7fd788a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412ecc0 0x7fd78412ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.156 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.156+0000 7fd788a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fd78412b360 0x7fd78412b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.156 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.156+0000 7fd788a00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd784071520 con 0x7fd78412b360
2024-03-29T09:08:22.156 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.156+0000 7fd788a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd784070d80 con 0x7fd78412e3a0
2024-03-29T09:08:22.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.156+0000 7fd788a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840722b0 con 0x7fd78412ecc0
2024-03-29T09:08:22.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fd78412b360 0x7fd78412b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fd78412b360 0x7fd78412b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45612/0 (socket says 172.21.15.171:45612)
2024-03-29T09:08:22.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 -- 172.21.15.171:0/7705073 learned_addr learned my addr 172.21.15.171:0/7705073 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:22.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd781400700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412ecc0 0x7fd78412ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 -- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412ecc0 msgr2=0x7fd78412ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:22.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412ecc0 0x7fd78412ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 -- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 msgr2=0x7fd78412e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:22.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd78412e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.157+0000 7fd782800700  1 -- 172.21.15.171:0/7705073 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784071b40 con 0x7fd78412b360
2024-03-29T09:08:22.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.158+0000 7fd782800700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412b360 0x7fd78412b7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009e50 tx=0x7fd77c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d092dab77064519 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.158+0000 7fd780a00700  1 -- 172.21.15.171:0/7705073 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00e070 con 0x7fd78412b360
2024-03-29T09:08:22.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.158+0000 7fd780a00700  1 -- 172.21.15.171:0/7705073 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c00b9c0 con 0x7fd78412b360
2024-03-29T09:08:22.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.158+0000 7fd780a00700  1 -- 172.21.15.171:0/7705073 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00bd30 con 0x7fd78412b360
2024-03-29T09:08:22.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 -- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412b360 msgr2=0x7fd78412b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.159 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412b360 0x7fd78412b7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009e50 tx=0x7fd77c00b330 comp rx=0 tx=0).stop
2024-03-29T09:08:22.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 -- 172.21.15.171:0/7705073 shutdown_connections
2024-03-29T09:08:22.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412b360 0x7fd78412b7c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd78412e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 --2- 172.21.15.171:0/7705073 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412ecc0 0x7fd78412ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 -- 172.21.15.171:0/7705073 >> 172.21.15.171:0/7705073 conn(0x7fd7840a0d70 msgr2=0x7fd7840a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 -- 172.21.15.171:0/7705073 shutdown_connections
2024-03-29T09:08:22.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.159+0000 7fd788a00700  1 -- 172.21.15.171:0/7705073 wait complete.
2024-03-29T09:08:22.161 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.162+0000 7fd788a00700  1  Processor -- start
2024-03-29T09:08:22.161 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.162+0000 7fd788a00700  1 --  start start
2024-03-29T09:08:22.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.163+0000 7fd788a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412b360 0x7fd7841c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.163+0000 7fd788a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd7841c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.163+0000 7fd788a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412ecc0 0x7fd78408ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.163+0000 7fd788a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784120970 con 0x7fd78412ecc0
2024-03-29T09:08:22.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.163+0000 7fd788a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78412a7a0 con 0x7fd78412e3a0
2024-03-29T09:08:22.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.163+0000 7fd788a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd78408ecd0 con 0x7fd78412b360
2024-03-29T09:08:22.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.164+0000 7fd781400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd7841c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.164+0000 7fd781400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd7841c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40438/0 (socket says 172.21.15.171:40438)
2024-03-29T09:08:22.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.164+0000 7fd781400700  1 -- 172.21.15.171:0/3458840306 learned_addr learned my addr 172.21.15.171:0/3458840306 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:22.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.164+0000 7fd782800700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412ecc0 0x7fd78408ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.164+0000 7fd781e00700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412b360 0x7fd7841c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.165 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd781400700  1 -- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412b360 msgr2=0x7fd7841c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.165 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd781400700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412b360 0x7fd7841c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd781400700  1 -- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412ecc0 msgr2=0x7fd78408ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd781400700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412ecc0 0x7fd78408ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd781400700  1 -- 172.21.15.171:0/3458840306 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c009b30 con 0x7fd78412e3a0
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd782800700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412ecc0 0x7fd78408ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd781e00700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412b360 0x7fd7841c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd781400700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd7841c8140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd77000eb50 tx=0x7fd77000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.165+0000 7fd77a000700  1 -- 172.21.15.171:0/3458840306 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000c760 con 0x7fd78412e3a0
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.166+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7841c8680 con 0x7fd78412e3a0
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.166+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7841201e0 con 0x7fd78412e3a0
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.166+0000 7fd77a000700  1 -- 172.21.15.171:0/3458840306 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000c8c0 con 0x7fd78412e3a0
2024-03-29T09:08:22.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.166+0000 7fd77a000700  1 -- 172.21.15.171:0/3458840306 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000cc50 con 0x7fd78412e3a0
2024-03-29T09:08:22.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.167+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c0052e0 con 0x7fd78412e3a0
2024-03-29T09:08:22.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.169+0000 7fd77a000700  1 -- 172.21.15.171:0/3458840306 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7fd770013410 con 0x7fd78412e3a0
2024-03-29T09:08:22.170 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.170+0000 7fd77a000700  1 -- 172.21.15.171:0/3458840306 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd770055a20 con 0x7fd78412e3a0
2024-03-29T09:08:22.170 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.171+0000 7fd781e00700  1 -- 172.21.15.171:0/3458840306 >> v1:172.21.15.171:6816/38531 conn(0x7fd7640421a0 legacy=0x7fd764044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:22.175 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:22.176+0000 7f1ca2cbf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member
2024-03-29T09:08:22.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.176+0000 7fd77a000700  1 -- 172.21.15.171:0/3458840306 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7fd770036190 con 0x7fd78412e3a0
2024-03-29T09:08:22.189 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:22.188+0000 7f8af3b93200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member
2024-03-29T09:08:22.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.274+0000 7ffbd5e00700  1 -- 172.21.15.171:0/521327352 >> v1:172.21.15.171:6816/38531 conn(0x7ffbb40421f0 legacy=0x7ffbb40446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:22.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.290+0000 7f9e2f800700  1  Processor -- start
2024-03-29T09:08:22.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.290+0000 7f9e2f800700  1 --  start start
2024-03-29T09:08:22.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.291+0000 7f9e2f800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f9e2812e3a0 0x7f9e2812e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2f800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812b530 0x7f9e28136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2ce00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f9e2812e3a0 0x7f9e2812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2f800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e28070d80 con 0x7f9e2812ecc0
2024-03-29T09:08:22.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2f800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280715e0 con 0x7f9e2812e3a0
2024-03-29T09:08:22.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2f800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280722b0 con 0x7f9e2812b530
2024-03-29T09:08:22.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2ce00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f9e2812e3a0 0x7f9e2812e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45624/0 (socket says 172.21.15.171:45624)
2024-03-29T09:08:22.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2ce00700  1 -- 172.21.15.171:0/3953279240 learned_addr learned my addr 172.21.15.171:0/3953279240 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:22.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2d800700  1 --2- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812b530 0x7f9e28136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e2ce00700  1 -- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812b530 msgr2=0x7f9e28136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:22.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.292+0000 7f9e27400700  1 -- 172.21.15.171:0/3953279240 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985061814 0 0) 0x7f9e28070d80 con 0x7f9e2812ecc0
2024-03-29T09:08:22.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.293+0000 7f9e2ce00700  1 --2- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812b530 0x7f9e28136740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.293+0000 7f9e2ce00700  1 -- 172.21.15.171:0/3953279240 >> v1:172.21.15.171:6789/0 conn(0x7f9e2812ecc0 legacy=0x7f9e2812ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.293+0000 7f9e2ce00700  1 -- 172.21.15.171:0/3953279240 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28071b40 con 0x7f9e2812e3a0
2024-03-29T09:08:22.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.293+0000 7f9e2d800700  1 --2- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812b530 0x7f9e28136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:22.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.293+0000 7f9e2ce00700  1 --2- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812e3a0 0x7f9e2812e780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9e180098f0 tx=0x7f9e18009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac67b10ce59592cb server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.294+0000 7f9e27400700  1 -- 172.21.15.171:0/3953279240 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800b8a0 con 0x7f9e2812e3a0
2024-03-29T09:08:22.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.294+0000 7f9e27400700  1 -- 172.21.15.171:0/3953279240 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800ba00 con 0x7f9e2812e3a0
2024-03-29T09:08:22.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.294+0000 7f9e27400700  1 -- 172.21.15.171:0/3953279240 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800bd90 con 0x7f9e2812e3a0
2024-03-29T09:08:22.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 -- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812e3a0 msgr2=0x7f9e2812e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 --2- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812e3a0 0x7f9e2812e780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9e180098f0 tx=0x7f9e18009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:22.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 -- 172.21.15.171:0/3953279240 shutdown_connections
2024-03-29T09:08:22.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 --2- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812e3a0 0x7f9e2812e780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 --2- 172.21.15.171:0/3953279240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812b530 0x7f9e28136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 -- 172.21.15.171:0/3953279240 >> 172.21.15.171:0/3953279240 conn(0x7f9e280a0d70 msgr2=0x7f9e280a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 -- 172.21.15.171:0/3953279240 shutdown_connections
2024-03-29T09:08:22.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.295+0000 7f9e2f800700  1 -- 172.21.15.171:0/3953279240 wait complete.
2024-03-29T09:08:22.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.297+0000 7f9e2f800700  1  Processor -- start
2024-03-29T09:08:22.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.298+0000 7f9e2f800700  1 --  start start
2024-03-29T09:08:22.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.298+0000 7f9e2f800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9e2812b530 0x7f9e281c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.298+0000 7f9e2f800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812e3a0 0x7f9e281c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.298+0000 7f9e2f800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812ecc0 0x7f9e28119e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.298+0000 7f9e2f800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2811b8f0 con 0x7f9e2812ecc0
2024-03-29T09:08:22.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.299+0000 7f9e2f800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2811c080 con 0x7f9e2812e3a0
2024-03-29T09:08:22.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.299+0000 7f9e2f800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2812acd0 con 0x7f9e2812b530
2024-03-29T09:08:22.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.299+0000 7f9e27e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812e3a0 0x7f9e281c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.299+0000 7f9e27e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812e3a0 0x7f9e281c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40464/0 (socket says 172.21.15.171:40464)
2024-03-29T09:08:22.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.299+0000 7f9e27e00700  1 -- 172.21.15.171:0/1289177650 learned_addr learned my addr 172.21.15.171:0/1289177650 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:22.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.299+0000 7f9e2ce00700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9e2812b530 0x7f9e281c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.299+0000 7f9e2d800700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812ecc0 0x7f9e28119e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e27e00700  1 -- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9e2812b530 msgr2=0x7f9e281c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e27e00700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9e2812b530 0x7f9e281c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e27e00700  1 -- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812ecc0 msgr2=0x7f9e28119e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e27e00700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812ecc0 0x7f9e28119e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e27e00700  1 -- 172.21.15.171:0/1289177650 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18009550 con 0x7f9e2812e3a0
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e2ce00700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9e2812b530 0x7f9e281c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:22.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e2d800700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812ecc0 0x7f9e28119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:22.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.300+0000 7f9e27e00700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812e3a0 0x7f9e281c39f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c001eb0 tx=0x7f9e1c00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.301+0000 7f9e24c00700  1 -- 172.21.15.171:0/1289177650 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0054e0 con 0x7f9e2812e3a0
2024-03-29T09:08:22.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.301+0000 7f9e24c00700  1 -- 172.21.15.171:0/1289177650 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c003680 con 0x7f9e2812e3a0
2024-03-29T09:08:22.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.301+0000 7f9e24c00700  1 -- 172.21.15.171:0/1289177650 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0039f0 con 0x7f9e2812e3a0
2024-03-29T09:08:22.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.301+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e281c3f30 con 0x7f9e2812e3a0
2024-03-29T09:08:22.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.301+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2811cb10 con 0x7f9e2812e3a0
2024-03-29T09:08:22.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.302+0000 7f9e24c00700  1 -- 172.21.15.171:0/1289177650 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f9e1c003b50 con 0x7f9e2812e3a0
2024-03-29T09:08:22.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.303+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e281171d0 con 0x7f9e2812e3a0
2024-03-29T09:08:22.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.303+0000 7f9e24c00700  1 -- 172.21.15.171:0/1289177650 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f9e1c05a300 con 0x7f9e2812e3a0
2024-03-29T09:08:22.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.304+0000 7f9e2ce00700  1 -- 172.21.15.171:0/1289177650 >> v1:172.21.15.171:6816/38531 conn(0x7f9e0c0421f0 legacy=0x7f9e0c0446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:22.306 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.307+0000 7f9e24c00700  1 -- 172.21.15.171:0/1289177650 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f9e1c07fb60 con 0x7f9e2812e3a0
2024-03-29T09:08:22.314 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.315+0000 7fde89800700  1  Processor -- start
2024-03-29T09:08:22.314 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.315+0000 7fde89800700  1 --  start start
2024-03-29T09:08:22.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.316+0000 7fde89800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 0x7fde84133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.317+0000 7fde89800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde84133fa0 0x7fde84136390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.317+0000 7fde89800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde841171a0 con 0x7fde8412e6e0
2024-03-29T09:08:22.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.317+0000 7fde89800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde841258a0 con 0x7fde84133fa0
2024-03-29T09:08:22.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.317+0000 7fde89800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde84071bc0 con 0x7fde8412f300
2024-03-29T09:08:22.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.317+0000 7fde82a00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fde8412e6e0 0x7fde8412ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44498/0 (socket says 172.21.15.171:44498)
2024-03-29T09:08:22.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.317+0000 7fde82a00700  1 -- 172.21.15.171:0/4250818802 learned_addr learned my addr 172.21.15.171:0/4250818802 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:22.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.317+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607133245 0 0) 0x7fde74001110 con 0x7fde8412e6e0
2024-03-29T09:08:22.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde680035b0 con 0x7fde8412e6e0
2024-03-29T09:08:22.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde82000700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 0x7fde84133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde83400700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde84133fa0 0x7fde84136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 <== mon.0 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399653902 0 0) 0x7fde680035b0 con 0x7fde8412e6e0
2024-03-29T09:08:22.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 msgr2=0x7fde84133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:22.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 0x7fde84133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde84133fa0 msgr2=0x7fde84136390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:22.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde84133fa0 0x7fde84136390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840715a0 con 0x7fde8412e6e0
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 <== mon.0 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1029409515 0 0) 0x7fde74001800 con 0x7fde8412e6e0
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 >> v1:172.21.15.171:6789/0 conn(0x7fde8412e6e0 legacy=0x7fde8412ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68003a00 0x7fde68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68004850 0x7fde68004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 0x7fde680052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde841258a0 con 0x7fde68003a00
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde84071bc0 con 0x7fde68004850
2024-03-29T09:08:22.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.318+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde6800bc80 con 0x7fde8412f300
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82000700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68004850 0x7fde68004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde83400700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde84133fa0 0x7fde84136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82a00700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68003a00 0x7fde68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82000700  1 -- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 msgr2=0x7fde680052d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82000700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 0x7fde680052d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82000700  1 -- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68003a00 msgr2=0x7fde68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82000700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68003a00 0x7fde68003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82000700  1 -- 172.21.15.171:0/4250818802 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840715a0 con 0x7fde68004850
2024-03-29T09:08:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.319+0000 7fde82a00700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68003a00 0x7fde68003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.320+0000 7fde82000700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68004850 0x7fde68004cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde70009860 tx=0x7fde68005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113d6153648c2ff9 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.320+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000c070 con 0x7fde68004850
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.320+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70013610 con 0x7fde68004850
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.320+0000 7fde81600700  1 -- 172.21.15.171:0/4250818802 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700139c0 con 0x7fde68004850
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 -- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68004850 msgr2=0x7fde68004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68004850 0x7fde68004cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde70009860 tx=0x7fde68005880 comp rx=0 tx=0).stop
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 -- 172.21.15.171:0/4250818802 shutdown_connections
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412f300 0x7fde680052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68003a00 0x7fde68003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 --2- 172.21.15.171:0/4250818802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68004850 0x7fde68004cd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 -- 172.21.15.171:0/4250818802 >> 172.21.15.171:0/4250818802 conn(0x7fde840a0ba0 msgr2=0x7fde840a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 -- 172.21.15.171:0/4250818802 shutdown_connections
2024-03-29T09:08:22.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.321+0000 7fde89800700  1 -- 172.21.15.171:0/4250818802 wait complete.
2024-03-29T09:08:22.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.323+0000 7fde89800700  1  Processor -- start
2024-03-29T09:08:22.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.323+0000 7fde89800700  1 --  start start
2024-03-29T09:08:22.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.324+0000 7fde89800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68003a00 0x7fde8406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.324+0000 7fde89800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68004850 0x7fde8406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde89800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412e6e0 0x7fde8406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:22.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde89800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8406f460 con 0x7fde68004850
2024-03-29T09:08:22.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde82a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68003a00 0x7fde8406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.325 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde89800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8406f640 con 0x7fde68003a00
2024-03-29T09:08:22.325 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde89800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde84133d30 con 0x7fde8412e6e0
2024-03-29T09:08:22.325 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde82a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68003a00 0x7fde8406d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40482/0 (socket says 172.21.15.171:40482)
2024-03-29T09:08:22.325 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde82a00700  1 -- 172.21.15.171:0/357033354 learned_addr learned my addr 172.21.15.171:0/357033354 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:22.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde82000700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68004850 0x7fde8406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.325+0000 7fde83400700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412e6e0 0x7fde8406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:22.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde82a00700  1 -- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412e6e0 msgr2=0x7fde8406dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde82a00700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412e6e0 0x7fde8406dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde82a00700  1 -- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68004850 msgr2=0x7fde8406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde82a00700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68004850 0x7fde8406d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde82a00700  1 -- 172.21.15.171:0/357033354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8406fdd0 con 0x7fde68003a00
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde83400700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412e6e0 0x7fde8406dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde82a00700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68003a00 0x7fde8406d220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde74005b00 tx=0x7fde74005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.326+0000 7fde7aa00700  1 -- 172.21.15.171:0/357033354 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74019070 con 0x7fde68003a00
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.327+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8406f900 con 0x7fde68003a00
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.327+0000 7fde7aa00700  1 -- 172.21.15.171:0/357033354 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74007750 con 0x7fde68003a00
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.327+0000 7fde7aa00700  1 -- 172.21.15.171:0/357033354 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7401e620 con 0x7fde68003a00
2024-03-29T09:08:22.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.327+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde841c3590 con 0x7fde68003a00
2024-03-29T09:08:22.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.329+0000 7fde7aa00700  1 -- 172.21.15.171:0/357033354 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7fde74027440 con 0x7fde68003a00
2024-03-29T09:08:22.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.329+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8406b810 con 0x7fde68003a00
2024-03-29T09:08:22.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.330+0000 7fde7aa00700  1 -- 172.21.15.171:0/357033354 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fde7405d5d0 con 0x7fde68003a00
2024-03-29T09:08:22.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.330+0000 7fde82000700  1 -- 172.21.15.171:0/357033354 >> v1:172.21.15.171:6816/38531 conn(0x7fde640421a0 legacy=0x7fde64044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:22.333 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.334+0000 7fde7aa00700  1 -- 172.21.15.171:0/357033354 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7fde7403db70 con 0x7fde68003a00
2024-03-29T09:08:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.372+0000 7fd781e00700  1 -- 172.21.15.171:0/3458840306 >> v1:172.21.15.171:6816/38531 conn(0x7fd7640421a0 legacy=0x7fd764044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:22.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.377+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffbd806b810 con 0x7ffbd812e6e0
2024-03-29T09:08:22.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.378+0000 7ffbce000700  1 -- 172.21.15.171:0/521327352 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffbc8017030 con 0x7ffbd812e6e0
2024-03-29T09:08:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:22.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 >> v1:172.21.15.171:6816/38531 conn(0x7ffbb40421f0 legacy=0x7ffbb40446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:22.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd812e6e0 msgr2=0x7ffbd811a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd812e6e0 0x7ffbd811a980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e910 tx=0x7ffbc800ec20 comp rx=0 tx=0).stop
2024-03-29T09:08:22.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 shutdown_connections
2024-03-29T09:08:22.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ffbd812f130 0x7ffbd811aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd812b6a0 0x7ffbd811a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 --2- 172.21.15.171:0/521327352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd812e6e0 0x7ffbd811a980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 >> 172.21.15.171:0/521327352 conn(0x7ffbd80a0ba0 msgr2=0x7ffbd806c1b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.383+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 shutdown_connections
2024-03-29T09:08:22.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.384+0000 7ffbdca00700  1 -- 172.21.15.171:0/521327352 wait complete.
2024-03-29T09:08:22.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.3
2024-03-29T09:08:22.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.446+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd75c005590 con 0x7fd78412e3a0
2024-03-29T09:08:22.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.447+0000 7fd77a000700  1 -- 172.21.15.171:0/3458840306 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7700397b0 con 0x7fd78412e3a0
2024-03-29T09:08:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:22.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.449+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 >> v1:172.21.15.171:6816/38531 conn(0x7fd7640421a0 legacy=0x7fd764044660 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:22.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.449+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 msgr2=0x7fd7841c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.449+0000 7fd788a00700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd7841c8140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd77000eb50 tx=0x7fd77000ef10 comp rx=0 tx=0).stop
2024-03-29T09:08:22.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.450+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 shutdown_connections
2024-03-29T09:08:22.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.450+0000 7fd788a00700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd78412ecc0 0x7fd78408ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.450+0000 7fd788a00700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd78412b360 0x7fd7841c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.450+0000 7fd788a00700  1 --2- 172.21.15.171:0/3458840306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd78412e3a0 0x7fd7841c8140 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.450+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 >> 172.21.15.171:0/3458840306 conn(0x7fd7840a0d70 msgr2=0x7fd78412c520 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.450+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 shutdown_connections
2024-03-29T09:08:22.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.450+0000 7fd788a00700  1 -- 172.21.15.171:0/3458840306 wait complete.
2024-03-29T09:08:22.451 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:22.451+0000 7f8af3b93200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member
2024-03-29T09:08:22.451 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:22.452+0000 7f1ca2cbf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member
2024-03-29T09:08:22.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.0
2024-03-29T09:08:22.499 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.500+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fde841171a0 con 0x7fde68003a00
2024-03-29T09:08:22.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.501+0000 7fde7aa00700  1 -- 172.21.15.171:0/357033354 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde841171a0 con 0x7fde68003a00
2024-03-29T09:08:22.500 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:22.503 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 >> v1:172.21.15.171:6816/38531 conn(0x7fde640421a0 legacy=0x7fde64044660 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:22.503 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68003a00 msgr2=0x7fde8406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68003a00 0x7fde8406d220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde74005b00 tx=0x7fde74005e10 comp rx=0 tx=0).stop
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 shutdown_connections
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fde8412e6e0 0x7fde8406dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde68003a00 0x7fde8406d220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 --2- 172.21.15.171:0/357033354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde68004850 0x7fde8406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 >> 172.21.15.171:0/357033354 conn(0x7fde840a0ba0 msgr2=0x7fde84124980 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 shutdown_connections
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.504+0000 7fde89800700  1 -- 172.21.15.171:0/357033354 wait complete.
2024-03-29T09:08:22.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.505+0000 7f9e2ce00700  1 -- 172.21.15.171:0/1289177650 >> v1:172.21.15.171:6816/38531 conn(0x7f9e0c0421f0 legacy=0x7f9e0c0446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:22.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.2
2024-03-29T09:08:22.554 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.554+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9e281c40c0 con 0x7f9e2812e3a0
2024-03-29T09:08:22.554 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.555+0000 7f9e24c00700  1 -- 172.21.15.171:0/1289177650 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e1c017070 con 0x7f9e2812e3a0
2024-03-29T09:08:22.554 INFO:teuthology.orchestra.run.smithi171.stdout:38654705832
2024-03-29T09:08:22.556 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 >> v1:172.21.15.171:6816/38531 conn(0x7f9e0c0421f0 legacy=0x7f9e0c0446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:22.556 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812e3a0 msgr2=0x7f9e281c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812e3a0 0x7f9e281c39f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c001eb0 tx=0x7f9e1c00c8b0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 shutdown_connections
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2812ecc0 0x7f9e28119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9e2812b530 0x7f9e281c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 --2- 172.21.15.171:0/1289177650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2812e3a0 0x7f9e281c39f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 >> 172.21.15.171:0/1289177650 conn(0x7f9e280a0d70 msgr2=0x7f9e2806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 shutdown_connections
2024-03-29T09:08:22.557 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:22.557+0000 7f9e2f800700  1 -- 172.21.15.171:0/1289177650 wait complete.
2024-03-29T09:08:22.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705834 got 38654705832 for osd.1
2024-03-29T09:08:22.761 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:22.762+0000 7f1ca2cbf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member
2024-03-29T09:08:22.767 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:22.768+0000 7f8af3b93200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member
2024-03-29T09:08:23.297 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:23.298+0000 7f8af3b93200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member
2024-03-29T09:08:23.301 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:23.301+0000 7f1ca2cbf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member
2024-03-29T09:08:23.413 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T09:08:23.465 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:23.465+0000 7f8af3b93200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member
2024-03-29T09:08:23.467 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:23.468+0000 7f1ca2cbf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member
2024-03-29T09:08:23.479 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T09:08:23.530 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T09:08:23.575 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T09:08:23.654 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.654+0000 7f9fe4400700  1  Processor -- start
2024-03-29T09:08:23.654 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.654+0000 7f9fe4400700  1 --  start start
2024-03-29T09:08:23.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.655+0000 7f9fe4400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12e3a0 0x7f9fdc12e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.655+0000 7f9fe4400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f9fdc12ecc0 0x7f9fdc12ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.655+0000 7f9fe4400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12b360 0x7f9fdc12b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.655+0000 7f9fe4400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fdc071520 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.656+0000 7f9fe4400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc070d80 con 0x7f9fdc12e3a0
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.656+0000 7f9fe4400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0722b0 con 0x7f9fdc12b360
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe2400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12b360 0x7f9fdc12b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe2400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12b360 0x7f9fdc12b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53652/0 (socket says 172.21.15.171:53652)
2024-03-29T09:08:23.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe2400700  1 -- 172.21.15.171:0/3213530268 learned_addr learned my addr 172.21.15.171:0/3213530268 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:23.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe1a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12e3a0 0x7f9fdc12e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe1000700  1 --2- 172.21.15.171:0/3213530268 >> v2:172.21.15.171:3300/0 conn(0x7f9fdc12ecc0 0x7f9fdc12ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe2400700  1 -- 172.21.15.171:0/3213530268 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12e3a0 msgr2=0x7f9fdc12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:23.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe2400700  1 --2- 172.21.15.171:0/3213530268 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12e3a0 0x7f9fdc12e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.657+0000 7f9fe2400700  1 -- 172.21.15.171:0/3213530268 >> v2:172.21.15.171:3300/0 conn(0x7f9fdc12ecc0 msgr2=0x7f9fdc12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:23.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.658+0000 7f9fe2400700  1 --2- 172.21.15.171:0/3213530268 >> v2:172.21.15.171:3300/0 conn(0x7f9fdc12ecc0 0x7f9fdc12ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.658+0000 7f9fe2400700  1 -- 172.21.15.171:0/3213530268 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc071b40 con 0x7f9fdc12b360
2024-03-29T09:08:23.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.658+0000 7f9fe2400700  1 --2- 172.21.15.171:0/3213530268 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12b360 0x7f9fdc12b7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80098f0 tx=0x7f9fc8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d52963524bcd587d server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.658+0000 7f9fdbe00700  1 -- 172.21.15.171:0/3213530268 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8011830 con 0x7f9fdc12b360
2024-03-29T09:08:23.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.659+0000 7f9fdbe00700  1 -- 172.21.15.171:0/3213530268 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc8011990 con 0x7f9fdc12b360
2024-03-29T09:08:23.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.659+0000 7f9fdbe00700  1 -- 172.21.15.171:0/3213530268 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8011d20 con 0x7f9fdc12b360
2024-03-29T09:08:23.659 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 -- 172.21.15.171:0/3213530268 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12b360 msgr2=0x7f9fdc12b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.659 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 --2- 172.21.15.171:0/3213530268 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12b360 0x7f9fdc12b7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80098f0 tx=0x7f9fc8009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:23.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 -- 172.21.15.171:0/3213530268 shutdown_connections
2024-03-29T09:08:23.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 --2- 172.21.15.171:0/3213530268 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12b360 0x7f9fdc12b7f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 --2- 172.21.15.171:0/3213530268 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12e3a0 0x7f9fdc12e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 --2- 172.21.15.171:0/3213530268 >> v2:172.21.15.171:3300/0 conn(0x7f9fdc12ecc0 0x7f9fdc12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 -- 172.21.15.171:0/3213530268 >> 172.21.15.171:0/3213530268 conn(0x7f9fdc0a0d70 msgr2=0x7f9fdc0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:23.660 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.660+0000 7f9fe4400700  1 -- 172.21.15.171:0/3213530268 shutdown_connections
2024-03-29T09:08:23.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.661+0000 7f9fe4400700  1 -- 172.21.15.171:0/3213530268 wait complete.
2024-03-29T09:08:23.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.663+0000 7f9fe4400700  1  Processor -- start
2024-03-29T09:08:23.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.666+0000 7f9fe4400700  1 --  start start
2024-03-29T09:08:23.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.666+0000 7f9fe4400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12b360 0x7f9fdc124960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.666+0000 7f9fe4400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc12e3a0 0x7f9fdc124ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.666+0000 7f9fe4400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12ecc0 0x7f9fdc121410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.667+0000 7f9fe1a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12b360 0x7f9fdc124960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.667+0000 7f9fe1a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12b360 0x7f9fdc124960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40508/0 (socket says 172.21.15.171:40508)
2024-03-29T09:08:23.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.667+0000 7f9fe1000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc12e3a0 0x7f9fdc124ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe1000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc12e3a0 0x7f9fdc124ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45668/0 (socket says 172.21.15.171:45668)
2024-03-29T09:08:23.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe4400700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc130260 con 0x7f9fdc12e3a0
2024-03-29T09:08:23.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe4400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc12a690 con 0x7f9fdc12b360
2024-03-29T09:08:23.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe4400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc12f630 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe1a00700  1 -- 172.21.15.171:0/2676611210 learned_addr learned my addr 172.21.15.171:0/2676611210 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:23.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe2400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12ecc0 0x7f9fdc121410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe2400700  1 -- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12b360 msgr2=0x7f9fdc124960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe2400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12b360 0x7f9fdc124960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.668+0000 7f9fe2400700  1 -- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc12e3a0 msgr2=0x7f9fdc124ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.669+0000 7f9fe2400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc12e3a0 0x7f9fdc124ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.669+0000 7f9fe2400700  1 -- 172.21.15.171:0/2676611210 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009550 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.669+0000 7f9fe1000700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc12e3a0 0x7f9fdc124ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:23.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.669+0000 7f9fe2400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12ecc0 0x7f9fdc121410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8016000 tx=0x7f9fc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.670+0000 7f9fd9600700  1 -- 172.21.15.171:0/2676611210 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8004510 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.670+0000 7f9fd9600700  1 -- 172.21.15.171:0/2676611210 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc801f070 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.670+0000 7f9fd9600700  1 -- 172.21.15.171:0/2676611210 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80038c0 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.670+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc12fcc0 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.670+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc121b30 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.672+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc1171d0 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.673+0000 7f9fd9600700  1 -- 172.21.15.171:0/2676611210 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f9fc8021030 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.674+0000 7f9fd9600700  1 -- 172.21.15.171:0/2676611210 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f9fc8056d70 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.674+0000 7f9fe1a00700  1 -- 172.21.15.171:0/2676611210 >> v1:172.21.15.171:6816/38531 conn(0x7f9fbc0421a0 legacy=0x7f9fbc044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:23.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.679+0000 7f9fd9600700  1 -- 172.21.15.171:0/2676611210 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f9fc8024a30 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.735+0000 7fe4eb800700  1  Processor -- start
2024-03-29T09:08:23.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.735+0000 7fe4eb800700  1 --  start start
2024-03-29T09:08:23.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.736+0000 7fe4eb800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe4e412e3a0 0x7fe4e412e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.736+0000 7fe4eb800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412ecc0 0x7fe4e412ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.736+0000 7fe4eb800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412b360 0x7fe4e412b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.736+0000 7fe4eb800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e4071520 con 0x7fe4e412e3a0
2024-03-29T09:08:23.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.736+0000 7fe4eb800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e4070d80 con 0x7fe4e412b360
2024-03-29T09:08:23.736 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.736+0000 7fe4eb800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e40722b0 con 0x7fe4e412ecc0
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e8e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe4e412e3a0 0x7fe4e412e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e8e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe4e412e3a0 0x7fe4e412e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45674/0 (socket says 172.21.15.171:45674)
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e8e00700  1 -- 172.21.15.171:0/2219925707 learned_addr learned my addr 172.21.15.171:0/2219925707 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e9800700  1 --2- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412b360 0x7fe4e412b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e9800700  1 -- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412ecc0 msgr2=0x7fe4e412ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e9800700  1 --2- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412ecc0 0x7fe4e412ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e9800700  1 -- 172.21.15.171:0/2219925707 >> v2:172.21.15.171:3300/0 conn(0x7fe4e412e3a0 msgr2=0x7fe4e412e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e9800700  1 --2- 172.21.15.171:0/2219925707 >> v2:172.21.15.171:3300/0 conn(0x7fe4e412e3a0 0x7fe4e412e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e9800700  1 -- 172.21.15.171:0/2219925707 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4071b40 con 0x7fe4e412b360
2024-03-29T09:08:23.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.737+0000 7fe4e8e00700  1 --2- 172.21.15.171:0/2219925707 >> v2:172.21.15.171:3300/0 conn(0x7fe4e412e3a0 0x7fe4e412e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:23.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.738+0000 7fe4e9800700  1 --2- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412b360 0x7fe4e412b7a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009d90 tx=0x7fe4dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5272fd4ab079b3 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.738+0000 7fe4e3400700  1 -- 172.21.15.171:0/2219925707 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00e070 con 0x7fe4e412b360
2024-03-29T09:08:23.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.738+0000 7fe4e3400700  1 -- 172.21.15.171:0/2219925707 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00bb20 con 0x7fe4e412b360
2024-03-29T09:08:23.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.738+0000 7fe4e3400700  1 -- 172.21.15.171:0/2219925707 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc012430 con 0x7fe4e412b360
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.739+0000 7fe4eb800700  1 -- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412b360 msgr2=0x7fe4e412b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.739+0000 7fe4eb800700  1 --2- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412b360 0x7fe4e412b7a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009d90 tx=0x7fe4dc00b330 comp rx=0 tx=0).stop
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.740+0000 7fe4eb800700  1 -- 172.21.15.171:0/2219925707 shutdown_connections
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.740+0000 7fe4eb800700  1 --2- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412b360 0x7fe4e412b7a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.740+0000 7fe4eb800700  1 --2- 172.21.15.171:0/2219925707 >> v2:172.21.15.171:3300/0 conn(0x7fe4e412e3a0 0x7fe4e412e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.740+0000 7fe4eb800700  1 --2- 172.21.15.171:0/2219925707 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412ecc0 0x7fe4e412ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.740+0000 7fe4eb800700  1 -- 172.21.15.171:0/2219925707 >> 172.21.15.171:0/2219925707 conn(0x7fe4e40a0d70 msgr2=0x7fe4e40a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:23.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.740+0000 7fe4eb800700  1 -- 172.21.15.171:0/2219925707 shutdown_connections
2024-03-29T09:08:23.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.740+0000 7fe4eb800700  1 -- 172.21.15.171:0/2219925707 wait complete.
2024-03-29T09:08:23.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.742+0000 7fe4eb800700  1  Processor -- start
2024-03-29T09:08:23.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.742+0000 7fe4eb800700  1 --  start start
2024-03-29T09:08:23.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4eb800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412b360 0x7fe4e4125690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4eb800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e412e3a0 0x7fe4e4125bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4eb800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412ecc0 0x7fe4e4126110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4eb800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e41275c0 con 0x7fe4e412e3a0
2024-03-29T09:08:23.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4eb800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e4126980 con 0x7fe4e412ecc0
2024-03-29T09:08:23.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4eb800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e412a630 con 0x7fe4e412b360
2024-03-29T09:08:23.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4e8e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412b360 0x7fe4e4125690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4e8e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412b360 0x7fe4e4125690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53682/0 (socket says 172.21.15.171:53682)
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.743+0000 7fe4e8e00700  1 -- 172.21.15.171:0/1246281183 learned_addr learned my addr 172.21.15.171:0/1246281183 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e3e00700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e412e3a0 0x7fe4e4125bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e9800700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412ecc0 0x7fe4e4126110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e8e00700  1 -- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412ecc0 msgr2=0x7fe4e4126110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e8e00700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412ecc0 0x7fe4e4126110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e8e00700  1 -- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e412e3a0 msgr2=0x7fe4e4125bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e8e00700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e412e3a0 0x7fe4e4125bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e8e00700  1 -- 172.21.15.171:0/1246281183 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009550 con 0x7fe4e412b360
2024-03-29T09:08:23.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e3e00700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e412e3a0 0x7fe4e4125bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:23.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.744+0000 7fe4e9800700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412ecc0 0x7fe4e4126110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:23.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.745+0000 7fe4e8e00700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412b360 0x7fe4e4125690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800ebe0 tx=0x7fe4d8009e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.745+0000 7fe4e0c00700  1 -- 172.21.15.171:0/1246281183 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800c8b0 con 0x7fe4e412b360
2024-03-29T09:08:23.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.745+0000 7fe4e0c00700  1 -- 172.21.15.171:0/1246281183 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d800ca10 con 0x7fe4e412b360
2024-03-29T09:08:23.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.745+0000 7fe4e0c00700  1 -- 172.21.15.171:0/1246281183 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800cd80 con 0x7fe4e412b360
2024-03-29T09:08:23.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.745+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc009a70 con 0x7fe4e412b360
2024-03-29T09:08:23.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.745+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e406ec20 con 0x7fe4e412b360
2024-03-29T09:08:23.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.747+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e41171d0 con 0x7fe4e412b360
2024-03-29T09:08:23.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.748+0000 7fe4e0c00700  1 -- 172.21.15.171:0/1246281183 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7fe4d8013470 con 0x7fe4e412b360
2024-03-29T09:08:23.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.749+0000 7fe4e0c00700  1 -- 172.21.15.171:0/1246281183 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe4d8055bc0 con 0x7fe4e412b360
2024-03-29T09:08:23.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.749+0000 7fe4e3e00700  1 -- 172.21.15.171:0/1246281183 >> v1:172.21.15.171:6816/38531 conn(0x7fe4c40421f0 legacy=0x7fe4c40446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:23.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.752+0000 7fe4e0c00700  1 -- 172.21.15.171:0/1246281183 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7fe4d8036370 con 0x7fe4e412b360
2024-03-29T09:08:23.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.852+0000 7fdd64400700  1  Processor -- start
2024-03-29T09:08:23.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.853+0000 7fdd64400700  1 --  start start
2024-03-29T09:08:23.853 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.854+0000 7fdd64400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.853 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.854+0000 7fdd64400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.854+0000 7fdd64400700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c071520 con 0x7fdd5c12e3a0
2024-03-29T09:08:23.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.854+0000 7fdd64400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c070d80 con 0x7fdd5c12ee90
2024-03-29T09:08:23.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.854+0000 7fdd64400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0722b0 con 0x7fdd5c133c60
2024-03-29T09:08:23.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.855+0000 7fdd61a00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fdd5c12e3a0 0x7fdd5c12e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44512/0 (socket says 172.21.15.171:44512)
2024-03-29T09:08:23.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.855+0000 7fdd61a00700  1 -- 172.21.15.171:0/3139679194 learned_addr learned my addr 172.21.15.171:0/3139679194 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:23.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.855+0000 7fdd62400700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.855+0000 7fdd61000700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.856+0000 7fdd62400700  1 -- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 msgr2=0x7fdd5c133720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:23.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.856+0000 7fdd5be00700  1 -- 172.21.15.171:0/3139679194 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265491843 0 0) 0x7fdd5c071520 con 0x7fdd5c12e3a0
2024-03-29T09:08:23.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.856+0000 7fdd62400700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c133720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.856+0000 7fdd62400700  1 -- 172.21.15.171:0/3139679194 >> v1:172.21.15.171:6789/0 conn(0x7fdd5c12e3a0 legacy=0x7fdd5c12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.856+0000 7fdd62400700  1 -- 172.21.15.171:0/3139679194 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c071b40 con 0x7fdd5c133c60
2024-03-29T09:08:23.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.856+0000 7fdd61000700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c133720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:23.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.856+0000 7fdd62400700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c136050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009dc0 tx=0x7fdd5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e52d10904e95e8a server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.857+0000 7fdd5be00700  1 -- 172.21.15.171:0/3139679194 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400e070 con 0x7fdd5c133c60
2024-03-29T09:08:23.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.857+0000 7fdd5be00700  1 -- 172.21.15.171:0/3139679194 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400bb20 con 0x7fdd5c133c60
2024-03-29T09:08:23.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.857+0000 7fdd5be00700  1 -- 172.21.15.171:0/3139679194 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54012430 con 0x7fdd5c133c60
2024-03-29T09:08:23.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.858+0000 7fdd64400700  1 -- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 msgr2=0x7fdd5c136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.858+0000 7fdd64400700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c136050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009dc0 tx=0x7fdd5400b330 comp rx=0 tx=0).stop
2024-03-29T09:08:23.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.859+0000 7fdd64400700  1 -- 172.21.15.171:0/3139679194 shutdown_connections
2024-03-29T09:08:23.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.859+0000 7fdd64400700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c136050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.859+0000 7fdd64400700  1 --2- 172.21.15.171:0/3139679194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c133720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.859+0000 7fdd64400700  1 -- 172.21.15.171:0/3139679194 >> 172.21.15.171:0/3139679194 conn(0x7fdd5c0a0d70 msgr2=0x7fdd5c0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:23.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.859+0000 7fdd64400700  1 -- 172.21.15.171:0/3139679194 shutdown_connections
2024-03-29T09:08:23.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.859+0000 7fdd64400700  1 -- 172.21.15.171:0/3139679194 wait complete.
2024-03-29T09:08:23.860 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.861+0000 7fdd64400700  1  Processor -- start
2024-03-29T09:08:23.861 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.861+0000 7fdd64400700  1 --  start start
2024-03-29T09:08:23.862 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.862+0000 7fdd64400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd5c12e3a0 0x7fdd5c1216c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.862 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.862+0000 7fdd64400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.863+0000 7fdd64400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.863+0000 7fdd61000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.863+0000 7fdd61000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c121c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40548/0 (socket says 172.21.15.171:40548)
2024-03-29T09:08:23.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.863+0000 7fdd61a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd5c12e3a0 0x7fdd5c1216c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.863+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c123f70 con 0x7fdd5c12e3a0
2024-03-29T09:08:23.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.863+0000 7fdd61000700  1 -- 172.21.15.171:0/2479568929 learned_addr learned my addr 172.21.15.171:0/2479568929 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.863+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c123450 con 0x7fdd5c12ee90
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.864+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c123b30 con 0x7fdd5c133c60
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.864+0000 7fdd62400700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.864+0000 7fdd61000700  1 -- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 msgr2=0x7fdd5c122140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.864+0000 7fdd61000700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c122140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.864+0000 7fdd61000700  1 -- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd5c12e3a0 msgr2=0x7fdd5c1216c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.864+0000 7fdd61000700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd5c12e3a0 0x7fdd5c1216c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.864+0000 7fdd61000700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480094a0 con 0x7fdd5c12ee90
2024-03-29T09:08:23.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.865+0000 7fdd62400700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:23.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.865+0000 7fdd61a00700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd5c12e3a0 0x7fdd5c1216c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:23.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.865+0000 7fdd61000700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c121c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ebe0 tx=0x7fdd4800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.865+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800c850 con 0x7fdd5c12ee90
2024-03-29T09:08:23.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.865+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800c9b0 con 0x7fdd5c12ee90
2024-03-29T09:08:23.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.865+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800cd40 con 0x7fdd5c12ee90
2024-03-29T09:08:23.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.866+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd54009a70 con 0x7fdd5c12ee90
2024-03-29T09:08:23.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.867+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c1c3130 con 0x7fdd5c12ee90
2024-03-29T09:08:23.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.869+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7fdd48013470 con 0x7fdd5c12ee90
2024-03-29T09:08:23.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.868+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c1171d0 con 0x7fdd5c12ee90
2024-03-29T09:08:23.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.870+0000 7fdd61a00700  1 -- 172.21.15.171:0/2479568929 >> v1:172.21.15.171:6816/38531 conn(0x7fdd3c0421f0 legacy=0x7fdd3c0446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:23.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.870+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fdd48054440 con 0x7fdd5c12ee90
2024-03-29T09:08:23.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.874+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7fdd48017080 con 0x7fdd5c12ee90
2024-03-29T09:08:23.874 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.875+0000 7f9fe1a00700  1 -- 172.21.15.171:0/2676611210 >> v1:172.21.15.171:6816/38531 conn(0x7f9fbc0421a0 legacy=0x7f9fbc044660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:23.904 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:23.904+0000 7f1ca2cbf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member
2024-03-29T09:08:23.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.912+0000 7f91b1600700  1  Processor -- start
2024-03-29T09:08:23.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.912+0000 7f91b1600700  1 --  start start
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.913+0000 7f91b1600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12f300 0x7f91ac133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.913+0000 7f91b1600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f91ac133fa0 0x7f91ac136390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.913+0000 7f91b1600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac1171a0 con 0x7f91ac12e6e0
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.913+0000 7f91b1600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac1258a0 con 0x7f91ac133fa0
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.913+0000 7f91b1600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac071bc0 con 0x7f91ac12f300
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.913+0000 7f91aaa00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f91ac12e6e0 0x7f91ac12ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44526/0 (socket says 172.21.15.171:44526)
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.914+0000 7f91ab400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f91ac133fa0 0x7f91ac136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.914+0000 7f91ab400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f91ac133fa0 0x7f91ac136390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45702/0 (socket says 172.21.15.171:45702)
2024-03-29T09:08:23.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.914+0000 7f91ab400700  1 -- 172.21.15.171:0/3335066895 learned_addr learned my addr 172.21.15.171:0/3335066895 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:23.914 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.915+0000 7f91aa000700  1 --2- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12f300 0x7f91ac133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.914 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.915+0000 7f91ab400700  1 -- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12f300 msgr2=0x7f91ac133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:23.914 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.915+0000 7f91a9600700  1 -- 172.21.15.171:0/3335066895 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785173932 0 0) 0x7f919c001110 con 0x7f91ac12e6e0
2024-03-29T09:08:23.914 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.915+0000 7f91ab400700  1 --2- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12f300 0x7f91ac133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.915 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.915+0000 7f91ab400700  1 -- 172.21.15.171:0/3335066895 >> v1:172.21.15.171:6789/0 conn(0x7f91ac12e6e0 legacy=0x7f91ac12ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.915 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.915+0000 7f91ab400700  1 -- 172.21.15.171:0/3335066895 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0715a0 con 0x7f91ac133fa0
2024-03-29T09:08:23.915 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.916+0000 7f91aa000700  1 --2- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12f300 0x7f91ac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:23.915 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.916+0000 7f91ab400700  1 --2- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac133fa0 0x7f91ac136390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009e50 tx=0x7f91a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be5ec8d78838a24 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.916 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.917+0000 7f91a9600700  1 -- 172.21.15.171:0/3335066895 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400e070 con 0x7f91ac133fa0
2024-03-29T09:08:23.916 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.917+0000 7f91a9600700  1 -- 172.21.15.171:0/3335066895 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a400b9c0 con 0x7f91ac133fa0
2024-03-29T09:08:23.916 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.917+0000 7f91a9600700  1 -- 172.21.15.171:0/3335066895 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400e070 con 0x7f91ac133fa0
2024-03-29T09:08:23.918 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.918+0000 7f91b1600700  1 -- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac133fa0 msgr2=0x7f91ac136390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.918 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.918+0000 7f91b1600700  1 --2- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac133fa0 0x7f91ac136390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009e50 tx=0x7f91a400b330 comp rx=0 tx=0).stop
2024-03-29T09:08:23.918 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.918+0000 7f91b1600700  1 -- 172.21.15.171:0/3335066895 shutdown_connections
2024-03-29T09:08:23.918 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.918+0000 7f91b1600700  1 --2- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac133fa0 0x7f91ac136390 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.918 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.918+0000 7f91b1600700  1 --2- 172.21.15.171:0/3335066895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12f300 0x7f91ac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.918 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.918+0000 7f91b1600700  1 -- 172.21.15.171:0/3335066895 >> 172.21.15.171:0/3335066895 conn(0x7f91ac0a0ba0 msgr2=0x7f91ac0a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:23.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.919+0000 7f91b1600700  1 -- 172.21.15.171:0/3335066895 shutdown_connections
2024-03-29T09:08:23.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.919+0000 7f91b1600700  1 -- 172.21.15.171:0/3335066895 wait complete.
2024-03-29T09:08:23.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.921+0000 7f91b1600700  1  Processor -- start
2024-03-29T09:08:23.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.921+0000 7f91b1600700  1 --  start start
2024-03-29T09:08:23.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.922+0000 7f91b1600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12e6e0 0x7f91ac1c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.922+0000 7f91b1600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac12f300 0x7f91ac1c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.922+0000 7f91b1600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f91ac133fa0 0x7f91ac06c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:23.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.922+0000 7f91b1600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac06eda0 con 0x7f91ac12f300
2024-03-29T09:08:23.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.922+0000 7f91b1600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac132f40 con 0x7f91ac12e6e0
2024-03-29T09:08:23.922 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.922+0000 7f91b1600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1c33b0 con 0x7f91ac133fa0
2024-03-29T09:08:23.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.923+0000 7f91aaa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12e6e0 0x7f91ac1c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.923+0000 7f91aaa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12e6e0 0x7f91ac1c37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40552/0 (socket says 172.21.15.171:40552)
2024-03-29T09:08:23.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.923+0000 7f91aaa00700  1 -- 172.21.15.171:0/2539207918 learned_addr learned my addr 172.21.15.171:0/2539207918 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:23.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.923+0000 7f91ab400700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f91ac133fa0 0x7f91ac06c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.923 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.924+0000 7f91aa000700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac12f300 0x7f91ac1c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:23.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.924+0000 7f91ab400700  1 -- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12e6e0 msgr2=0x7f91ac1c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.924+0000 7f91ab400700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12e6e0 0x7f91ac1c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.924 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.924+0000 7f91ab400700  1 -- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac12f300 msgr2=0x7f91ac1c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.924+0000 7f91ab400700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac12f300 0x7f91ac1c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.924+0000 7f91ab400700  1 -- 172.21.15.171:0/2539207918 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4009b30 con 0x7f91ac133fa0
2024-03-29T09:08:23.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.925+0000 7f91aaa00700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12e6e0 0x7f91ac1c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:23.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.925+0000 7f91aa000700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac12f300 0x7f91ac1c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:23.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.925+0000 7f91ab400700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f91ac133fa0 0x7f91ac06c1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91ac071250 tx=0x7f91a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:23.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.926+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40099b0 con 0x7f91ac133fa0
2024-03-29T09:08:23.925 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.926+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4004250 con 0x7f91ac133fa0
2024-03-29T09:08:23.926 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.926+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40045e0 con 0x7f91ac133fa0
2024-03-29T09:08:23.926 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.926+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac133a50 con 0x7f91ac133fa0
2024-03-29T09:08:23.926 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.926+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac06e940 con 0x7f91ac133fa0
2024-03-29T09:08:23.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.928+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac06e0c0 con 0x7f91ac133fa0
2024-03-29T09:08:23.928 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.928+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 5) v1 ==== 48656+0+0 (secure 0 0 0) 0x7f91a4004740 con 0x7f91ac133fa0
2024-03-29T09:08:23.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.929+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f91a4056d50 con 0x7f91ac133fa0
2024-03-29T09:08:23.929 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.929+0000 7f91aaa00700  1 -- 172.21.15.171:0/2539207918 >> v1:172.21.15.171:6816/38531 conn(0x7f918c0421f0 legacy=0x7f918c0446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:23.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.936+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+129857 (secure 0 0 0) 0x7f91ac06e0c0 con 0x7f91ac133fa0
2024-03-29T09:08:23.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.950+0000 7fe4e3e00700  1 -- 172.21.15.171:0/1246281183 >> v1:172.21.15.171:6816/38531 conn(0x7fe4c40421f0 legacy=0x7fe4c40446b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6816/38531
2024-03-29T09:08:23.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.953+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fdc067950 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.954+0000 7f9fd9600700  1 -- 172.21.15.171:0/2676611210 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fc8015020 con 0x7f9fdc12ecc0
2024-03-29T09:08:23.953 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 >> v1:172.21.15.171:6816/38531 conn(0x7f9fbc0421a0 legacy=0x7f9fbc044660 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12ecc0 msgr2=0x7f9fdc121410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12ecc0 0x7f9fdc121410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8016000 tx=0x7f9fc8004750 comp rx=0 tx=0).stop
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 shutdown_connections
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9fdc12ecc0 0x7f9fdc121410 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fdc12b360 0x7f9fdc124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 --2- 172.21.15.171:0/2676611210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fdc12e3a0 0x7f9fdc124ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.956+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 >> 172.21.15.171:0/2676611210 conn(0x7f9fdc0a0d70 msgr2=0x7f9fdc06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.957+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 shutdown_connections
2024-03-29T09:08:23.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.957+0000 7f9fe4400700  1 -- 172.21.15.171:0/2676611210 wait complete.
2024-03-29T09:08:23.966 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:23.967+0000 7f8af3b93200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member
2024-03-29T09:08:23.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.971+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4e40623e0 con 0x7fe4e412b360
2024-03-29T09:08:23.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.972+0000 7fe4e0c00700  1 -- 172.21.15.171:0/1246281183 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4d8055e60 con 0x7fe4e412b360
2024-03-29T09:08:23.972 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.975+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 >> v1:172.21.15.171:6816/38531 conn(0x7fe4c40421f0 legacy=0x7fe4c40446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.975+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412b360 msgr2=0x7fe4e4125690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.975+0000 7fe4eb800700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412b360 0x7fe4e4125690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800ebe0 tx=0x7fe4d8009e70 comp rx=0 tx=0).stop
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.975+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 shutdown_connections
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.975+0000 7fe4eb800700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4e412ecc0 0x7fe4e4126110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.976+0000 7fe4eb800700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe4e412b360 0x7fe4e4125690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.976+0000 7fe4eb800700  1 --2- 172.21.15.171:0/1246281183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4e412e3a0 0x7fe4e4125bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:23.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.976+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 >> 172.21.15.171:0/1246281183 conn(0x7fe4e40a0d70 msgr2=0x7fe4e412c410 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:23.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.3
2024-03-29T09:08:23.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.976+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 shutdown_connections
2024-03-29T09:08:23.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:23.976+0000 7fe4eb800700  1 -- 172.21.15.171:0/1246281183 wait complete.
2024-03-29T09:08:24.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.0
2024-03-29T09:08:24.048 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:24.049+0000 7f1ca2cbf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member
2024-03-29T09:08:24.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.065+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mgrmap(e 6) v1 ==== 51720+0+0 (secure 0 0 0) 0x7fdd48035430 con 0x7fdd5c12ee90
2024-03-29T09:08:24.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.064+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mgrmap(e 6) v1 ==== 51720+0+0 (secure 0 0 0) 0x7f91a4007870 con 0x7f91ac133fa0
2024-03-29T09:08:24.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.065+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 >> v1:172.21.15.171:6816/38531 conn(0x7f918c0421f0 legacy=0x7f918c0446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:24.066 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.066+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 >> v1:172.21.15.171:6816/38531 conn(0x7fdd3c0421f0 legacy=0x7fdd3c0446b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:24.121 INFO:tasks.ceph.mgr.y.smithi171.stderr:2024-03-29T09:08:24.122+0000 7f8af3b93200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member
2024-03-29T09:08:24.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.137+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd5c12e0d0 con 0x7fdd5c12ee90
2024-03-29T09:08:24.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.138+0000 7fdd59600700  1 -- 172.21.15.171:0/2479568929 <== mon.1 v2:172.21.15.171:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd4800cea0 con 0x7fdd5c12ee90
2024-03-29T09:08:24.137 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:24.139 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 msgr2=0x7fdd5c121c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c121c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ebe0 tx=0x7fdd4800eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 shutdown_connections
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fdd5c133c60 0x7fdd5c122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd5c12e3a0 0x7fdd5c1216c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 --2- 172.21.15.171:0/2479568929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd5c12ee90 0x7fdd5c121c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 >> 172.21.15.171:0/2479568929 conn(0x7fdd5c0a0d70 msgr2=0x7fdd5c06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 shutdown_connections
2024-03-29T09:08:24.140 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.140+0000 7fdd64400700  1 -- 172.21.15.171:0/2479568929 wait complete.
2024-03-29T09:08:24.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.2
2024-03-29T09:08:24.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.161+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91ac06e0c0 con 0x7f91ac133fa0
2024-03-29T09:08:24.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.161+0000 7f91a2a00700  1 -- 172.21.15.171:0/2539207918 <== mon.2 v2:172.21.15.171:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91ac06e0c0 con 0x7f91ac133fa0
2024-03-29T09:08:24.161 INFO:teuthology.orchestra.run.smithi171.stdout:38654705832
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f91ac133fa0 msgr2=0x7f91ac06c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f91ac133fa0 0x7f91ac06c1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91ac071250 tx=0x7f91a4004ad0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 shutdown_connections
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f91ac133fa0 0x7f91ac06c1b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91ac12e6e0 0x7f91ac1c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 --2- 172.21.15.171:0/2539207918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91ac12f300 0x7f91ac1c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 >> 172.21.15.171:0/2539207918 conn(0x7f91ac0a0ba0 msgr2=0x7f91ac12b660 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 shutdown_connections
2024-03-29T09:08:24.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:24.163+0000 7f91b1600700  1 -- 172.21.15.171:0/2539207918 wait complete.
2024-03-29T09:08:24.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705834 got 38654705832 for osd.1
2024-03-29T09:08:24.977 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T09:08:25.004 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T09:08:25.071 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:25.071+0000 7f1c7c200700 -1 mgr.server handle_report got status from non-daemon mon.c
2024-03-29T09:08:25.071 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:25.072+0000 7f1c7c200700 -1 mgr.server handle_report got status from non-daemon mon.a
2024-03-29T09:08:25.071 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-29T09:08:25.072+0000 7f1c7c200700 -1 mgr.server handle_report got status from non-daemon mon.b
2024-03-29T09:08:25.158 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T09:08:25.181 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T09:08:25.193 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.193+0000 7f5e19400700  1  Processor -- start
2024-03-29T09:08:25.193 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.194+0000 7f5e19400700  1 --  start start
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e19400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f5e1412e6e0 0x7f5e1412ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e19400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412f130 0x7f5e1412b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e19400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412b6a0 0x7f5e1412bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e19400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e141258a0 con 0x7f5e1412e6e0
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e19400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e141171a0 con 0x7f5e1412b6a0
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e19400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14071bc0 con 0x7f5e1412f130
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e12800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f5e1412e6e0 0x7f5e1412ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e11e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412f130 0x7f5e1412b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e12800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f5e1412e6e0 0x7f5e1412ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45762/0 (socket says 172.21.15.171:45762)
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.195+0000 7f5e12800700  1 -- 172.21.15.171:0/3293862425 learned_addr learned my addr 172.21.15.171:0/3293862425 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11e00700  1 -- 172.21.15.171:0/3293862425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412b6a0 msgr2=0x7f5e1412bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11e00700  1 --2- 172.21.15.171:0/3293862425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412b6a0 0x7f5e1412bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11e00700  1 -- 172.21.15.171:0/3293862425 >> v2:172.21.15.171:3300/0 conn(0x7f5e1412e6e0 msgr2=0x7f5e1412ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11e00700  1 --2- 172.21.15.171:0/3293862425 >> v2:172.21.15.171:3300/0 conn(0x7f5e1412e6e0 0x7f5e1412ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11e00700  1 -- 172.21.15.171:0/3293862425 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1412f530 con 0x7f5e1412f130
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e12800700  1 --2- 172.21.15.171:0/3293862425 >> v2:172.21.15.171:3300/0 conn(0x7f5e1412e6e0 0x7f5e1412ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11e00700  1 --2- 172.21.15.171:0/3293862425 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412f130 0x7f5e1412b160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009840 tx=0x7f5e00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8000e458f51d99ec server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11400700  1 -- 172.21.15.171:0/3293862425 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00011830 con 0x7f5e1412f130
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11400700  1 -- 172.21.15.171:0/3293862425 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00011990 con 0x7f5e1412f130
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.196+0000 7f5e11400700  1 -- 172.21.15.171:0/3293862425 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00011d20 con 0x7f5e1412f130
2024-03-29T09:08:25.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 -- 172.21.15.171:0/3293862425 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412f130 msgr2=0x7f5e1412b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 --2- 172.21.15.171:0/3293862425 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412f130 0x7f5e1412b160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009840 tx=0x7f5e00009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 -- 172.21.15.171:0/3293862425 shutdown_connections
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 --2- 172.21.15.171:0/3293862425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412b6a0 0x7f5e1412bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 --2- 172.21.15.171:0/3293862425 >> v2:172.21.15.171:3300/0 conn(0x7f5e1412e6e0 0x7f5e1412ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 --2- 172.21.15.171:0/3293862425 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412f130 0x7f5e1412b160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 -- 172.21.15.171:0/3293862425 >> 172.21.15.171:0/3293862425 conn(0x7f5e140a0ba0 msgr2=0x7f5e140a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 -- 172.21.15.171:0/3293862425 shutdown_connections
2024-03-29T09:08:25.200 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.197+0000 7f5e19400700  1 -- 172.21.15.171:0/3293862425 wait complete.
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1  Processor -- start
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1 --  start start
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e1412b6a0 0x7f5e1406c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412e6e0 0x7f5e1406ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412f130 0x7f5e1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1406edc0 con 0x7f5e1412b6a0
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14127ff0 con 0x7f5e1412f130
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.199+0000 7f5e19400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14070090 con 0x7f5e1412e6e0
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e1412b6a0 0x7f5e1406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e13200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412f130 0x7f5e1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e1412b6a0 0x7f5e1406c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45776/0 (socket says 172.21.15.171:45776)
2024-03-29T09:08:25.203 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 -- 172.21.15.171:0/3476778633 learned_addr learned my addr 172.21.15.171:0/3476778633 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e11e00700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412e6e0 0x7f5e1406ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 -- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412e6e0 msgr2=0x7f5e1406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412e6e0 0x7f5e1406ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 -- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412f130 msgr2=0x7f5e1406d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412f130 0x7f5e1406d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.200+0000 7f5e12800700  1 -- 172.21.15.171:0/3476778633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009550 con 0x7f5e1412b6a0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.201+0000 7f5e12800700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e1412b6a0 0x7f5e1406c910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400ebe0 tx=0x7f5e0400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.201+0000 7f5e0aa00700  1 -- 172.21.15.171:0/3476778633 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400c850 con 0x7f5e1412b6a0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.201+0000 7f5e0aa00700  1 -- 172.21.15.171:0/3476778633 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0400c9b0 con 0x7f5e1412b6a0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.201+0000 7f5e0aa00700  1 -- 172.21.15.171:0/3476778633 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400cd20 con 0x7f5e1412b6a0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.201+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e000094a0 con 0x7f5e1412b6a0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.201+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1406d8d0 con 0x7f5e1412b6a0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.203+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1406b810 con 0x7f5e1412b6a0
2024-03-29T09:08:25.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.203+0000 7f5e0aa00700  1 -- 172.21.15.171:0/3476778633 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 7) v1 ==== 55042+0+0 (secure 0 0 0) 0x7f5e04013470 con 0x7f5e1412b6a0
2024-03-29T09:08:25.205 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.204+0000 7f5e0aa00700  1 -- 172.21.15.171:0/3476778633 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7f5e0405c720 con 0x7f5e1412b6a0
2024-03-29T09:08:25.208 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.209+0000 7f5e0aa00700  1 -- 172.21.15.171:0/3476778633 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f5e0403a560 con 0x7f5e1412b6a0
2024-03-29T09:08:25.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.255+0000 7fe318000700  1  Processor -- start
2024-03-29T09:08:25.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.255+0000 7fe318000700  1 --  start start
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.256+0000 7fe318000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe31012e3a0 0x7fe31012e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.256+0000 7fe318000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe310136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.256+0000 7fe318000700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe310070d80 con 0x7fe31012ecc0
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.256+0000 7fe318000700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100715e0 con 0x7fe31012e3a0
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.256+0000 7fe318000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100722b0 con 0x7fe31012b530
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe315600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe31012e3a0 0x7fe31012e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe315600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe31012e3a0 0x7fe31012e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45784/0 (socket says 172.21.15.171:45784)
2024-03-29T09:08:25.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe315600700  1 -- 172.21.15.171:0/1080671717 learned_addr learned my addr 172.21.15.171:0/1080671717 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe316000700  1 --2- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe310136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe315600700  1 -- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 msgr2=0x7fe310136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe315600700  1 --2- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe310136740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe315600700  1 -- 172.21.15.171:0/1080671717 >> v1:172.21.15.171:6789/0 conn(0x7fe31012ecc0 legacy=0x7fe31012ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe315600700  1 -- 172.21.15.171:0/1080671717 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310071b40 con 0x7fe31012e3a0
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.257+0000 7fe30fe00700  1 -- 172.21.15.171:0/1080671717 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557861242 0 0) 0x7fe310070d80 con 0x7fe31012ecc0
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.258+0000 7fe315600700  1 --2- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012e3a0 0x7fe31012e780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe3040098f0 tx=0x7fe304009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d743fc7583da87c3 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.258+0000 7fe30fe00700  1 -- 172.21.15.171:0/1080671717 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400b8a0 con 0x7fe31012e3a0
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.258+0000 7fe30fe00700  1 -- 172.21.15.171:0/1080671717 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400ba00 con 0x7fe31012e3a0
2024-03-29T09:08:25.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.258+0000 7fe30fe00700  1 -- 172.21.15.171:0/1080671717 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400bd90 con 0x7fe31012e3a0
2024-03-29T09:08:25.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 -- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012e3a0 msgr2=0x7fe31012e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 --2- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012e3a0 0x7fe31012e780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe3040098f0 tx=0x7fe304009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:25.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 -- 172.21.15.171:0/1080671717 shutdown_connections
2024-03-29T09:08:25.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 --2- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe310136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 --2- 172.21.15.171:0/1080671717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012e3a0 0x7fe31012e780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 -- 172.21.15.171:0/1080671717 >> 172.21.15.171:0/1080671717 conn(0x7fe3100a0d70 msgr2=0x7fe3100a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 -- 172.21.15.171:0/1080671717 shutdown_connections
2024-03-29T09:08:25.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.259+0000 7fe318000700  1 -- 172.21.15.171:0/1080671717 wait complete.
2024-03-29T09:08:25.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.261+0000 7fe318000700  1  Processor -- start
2024-03-29T09:08:25.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.262+0000 7fe318000700  1 --  start start
2024-03-29T09:08:25.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.262+0000 7fe318000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe31008d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe318000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe31012e3a0 0x7fe31008d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe318000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012ecc0 0x7fe3101c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe318000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe310121100 con 0x7fe31012ecc0
2024-03-29T09:08:25.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe318000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe310120d30 con 0x7fe31012e3a0
2024-03-29T09:08:25.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe318000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe31008ed70 con 0x7fe31012b530
2024-03-29T09:08:25.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe314c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe31012e3a0 0x7fe31008d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe316000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012ecc0 0x7fe3101c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe315600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe31008d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe314c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe31012e3a0 0x7fe31008d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40668/0 (socket says 172.21.15.171:40668)
2024-03-29T09:08:25.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe314c00700  1 -- 172.21.15.171:0/1334891967 learned_addr learned my addr 172.21.15.171:0/1334891967 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.263+0000 7fe316000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012ecc0 0x7fe3101c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45796/0 (socket says 172.21.15.171:45796)
2024-03-29T09:08:25.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.264+0000 7fe316000700  1 -- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 msgr2=0x7fe31008d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.264+0000 7fe316000700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe31008d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.264+0000 7fe316000700  1 -- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe31012e3a0 msgr2=0x7fe31008d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.264+0000 7fe316000700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe31012e3a0 0x7fe31008d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.264+0000 7fe316000700  1 -- 172.21.15.171:0/1334891967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304009550 con 0x7fe31012ecc0
2024-03-29T09:08:25.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.264+0000 7fe314c00700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe31012e3a0 0x7fe31008d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:25.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.264+0000 7fe316000700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012ecc0 0x7fe3101c7460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe308007d90 tx=0x7fe30800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.265+0000 7fe30d600700  1 -- 172.21.15.171:0/1334891967 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308018070 con 0x7fe31012ecc0
2024-03-29T09:08:25.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.265+0000 7fe30d600700  1 -- 172.21.15.171:0/1334891967 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30800eb30 con 0x7fe31012ecc0
2024-03-29T09:08:25.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.265+0000 7fe30d600700  1 -- 172.21.15.171:0/1334891967 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308003a20 con 0x7fe31012ecc0
2024-03-29T09:08:25.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.265+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31012ace0 con 0x7fe31012ecc0
2024-03-29T09:08:25.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.265+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31008db90 con 0x7fe31012ecc0
2024-03-29T09:08:25.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.266+0000 7fe30d600700  1 -- 172.21.15.171:0/1334891967 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 7) v1 ==== 55042+0+0 (secure 0 0 0) 0x7fe308014420 con 0x7fe31012ecc0
2024-03-29T09:08:25.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.266+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3101171d0 con 0x7fe31012ecc0
2024-03-29T09:08:25.267 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.268+0000 7fe30d600700  1 -- 172.21.15.171:0/1334891967 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7fe30805c480 con 0x7fe31012ecc0
2024-03-29T09:08:25.270 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.271+0000 7fe30d600700  1 -- 172.21.15.171:0/1334891967 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fe30803a0f0 con 0x7fe31012ecc0
2024-03-29T09:08:25.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.373+0000 7fbbfea00700  1  Processor -- start
2024-03-29T09:08:25.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.373+0000 7fbbfea00700  1 --  start start
2024-03-29T09:08:25.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812e3a0 0x7fbbf812e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfea00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf812ecc0 0x7fbbf809c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfea00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fbbf809c9f0 0x7fbbf809ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfea00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80717a0 con 0x7fbbf809c9f0
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfea00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80711b0 con 0x7fbbf812e3a0
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfea00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf809e2c0 con 0x7fbbf812ecc0
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfcc00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf812ecc0 0x7fbbf809c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfd600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812e3a0 0x7fbbf812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfcc00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf812ecc0 0x7fbbf809c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53818/0 (socket says 172.21.15.171:53818)
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfcc00700  1 -- 172.21.15.171:0/3915813657 learned_addr learned my addr 172.21.15.171:0/3915813657 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.374+0000 7fbbfe000700  1 --2- 172.21.15.171:0/3915813657 >> v2:172.21.15.171:3300/0 conn(0x7fbbf809c9f0 0x7fbbf809ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbfd600700  1 -- 172.21.15.171:0/3915813657 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf812ecc0 msgr2=0x7fbbf809c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:25.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbfd600700  1 --2- 172.21.15.171:0/3915813657 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf812ecc0 0x7fbbf809c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbfd600700  1 -- 172.21.15.171:0/3915813657 >> v2:172.21.15.171:3300/0 conn(0x7fbbf809c9f0 msgr2=0x7fbbf809ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:25.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbfd600700  1 --2- 172.21.15.171:0/3915813657 >> v2:172.21.15.171:3300/0 conn(0x7fbbf809c9f0 0x7fbbf809ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbfd600700  1 -- 172.21.15.171:0/3915813657 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8070870 con 0x7fbbf812e3a0
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbfd600700  1 --2- 172.21.15.171:0/3915813657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812e3a0 0x7fbbf812e780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009870 tx=0x7fbbec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0cf70d4e2b6b130 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbf7e00700  1 -- 172.21.15.171:0/3915813657 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec011830 con 0x7fbbf812e3a0
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbf7e00700  1 -- 172.21.15.171:0/3915813657 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec011990 con 0x7fbbf812e3a0
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.375+0000 7fbbf7e00700  1 -- 172.21.15.171:0/3915813657 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec011d20 con 0x7fbbf812e3a0
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 -- 172.21.15.171:0/3915813657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812e3a0 msgr2=0x7fbbf812e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3915813657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812e3a0 0x7fbbf812e780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009870 tx=0x7fbbec009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 -- 172.21.15.171:0/3915813657 shutdown_connections
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3915813657 >> v2:172.21.15.171:3300/0 conn(0x7fbbf809c9f0 0x7fbbf809ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3915813657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812e3a0 0x7fbbf812e780 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3915813657 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf812ecc0 0x7fbbf809c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 -- 172.21.15.171:0/3915813657 >> 172.21.15.171:0/3915813657 conn(0x7fbbf809d530 msgr2=0x7fbbf809d940 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 -- 172.21.15.171:0/3915813657 shutdown_connections
2024-03-29T09:08:25.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.376+0000 7fbbfea00700  1 -- 172.21.15.171:0/3915813657 wait complete.
2024-03-29T09:08:25.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.378+0000 7fbbfea00700  1  Processor -- start
2024-03-29T09:08:25.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.378+0000 7fbbfea00700  1 --  start start
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.378+0000 7fbbfea00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf809c9f0 0x7fbbf8130220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.378+0000 7fbbfea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf812e3a0 0x7fbbf8130760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.378+0000 7fbbfea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812ecc0 0x7fbbf8130ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfea00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8133080 con 0x7fbbf812e3a0
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfea00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8132930 con 0x7fbbf812ecc0
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfea00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8134700 con 0x7fbbf809c9f0
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf809c9f0 0x7fbbf8130220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf809c9f0 0x7fbbf8130220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53830/0 (socket says 172.21.15.171:53830)
2024-03-29T09:08:25.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 -- 172.21.15.171:0/3477026200 learned_addr learned my addr 172.21.15.171:0/3477026200 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfcc00700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf812e3a0 0x7fbbf8130760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfe000700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812ecc0 0x7fbbf8130ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 -- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812ecc0 msgr2=0x7fbbf8130ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812ecc0 0x7fbbf8130ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 -- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf812e3a0 msgr2=0x7fbbf8130760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf812e3a0 0x7fbbf8130760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfd600700  1 -- 172.21.15.171:0/3477026200 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0094a0 con 0x7fbbf809c9f0
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.379+0000 7fbbfe000700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812ecc0 0x7fbbf8130ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:25.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.380+0000 7fbbfd600700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf809c9f0 0x7fbbf8130220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbbec000c00 tx=0x7fbbec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.380+0000 7fbbf5600700  1 -- 172.21.15.171:0/3477026200 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec004510 con 0x7fbbf809c9f0
2024-03-29T09:08:25.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.380+0000 7fbbf5600700  1 -- 172.21.15.171:0/3477026200 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec01f070 con 0x7fbbf809c9f0
2024-03-29T09:08:25.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.380+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf8131c50 con 0x7fbbf809c9f0
2024-03-29T09:08:25.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.380+0000 7fbbf5600700  1 -- 172.21.15.171:0/3477026200 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0038e0 con 0x7fbbf809c9f0
2024-03-29T09:08:25.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.380+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf81311e0 con 0x7fbbf809c9f0
2024-03-29T09:08:25.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.382+0000 7fbbf5600700  1 -- 172.21.15.171:0/3477026200 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 7) v1 ==== 55042+0+0 (secure 0 0 0) 0x7fbbec003a40 con 0x7fbbf809c9f0
2024-03-29T09:08:25.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.382+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf80623e0 con 0x7fbbf809c9f0
2024-03-29T09:08:25.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.383+0000 7fbbf5600700  1 -- 172.21.15.171:0/3477026200 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7fbbec021070 con 0x7fbbf809c9f0
2024-03-29T09:08:25.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.387+0000 7fbbf5600700  1 -- 172.21.15.171:0/3477026200 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fbbec00abc0 con 0x7fbbf809c9f0
2024-03-29T09:08:25.407 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.407+0000 7f96f8800700  1  Processor -- start
2024-03-29T09:08:25.407 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.408+0000 7f96f8800700  1 --  start start
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.408+0000 7f96f8800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f96f00963d0 0x7f96f00967b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.408+0000 7f96f8800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f006d310 0x7f96f006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.408+0000 7f96f8800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f0070ed0 con 0x7f96f006dcb0
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.408+0000 7f96f8800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f006e140 con 0x7f96f00963d0
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.408+0000 7f96f8800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0098a80 con 0x7f96f006d310
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f96f00963d0 0x7f96f00967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f96f00963d0 0x7f96f00967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45818/0 (socket says 172.21.15.171:45818)
2024-03-29T09:08:25.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5e00700  1 -- 172.21.15.171:0/3995671972 learned_addr learned my addr 172.21.15.171:0/3995671972 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.409 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f6800700  1 --1- 172.21.15.171:0/3995671972 >> v1:172.21.15.171:6789/0 conn(0x7f96f006dcb0 0x7f96f0133510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:44542/0 (socket says 172.21.15.171:44542)
2024-03-29T09:08:25.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5400700  1 --2- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f006d310 0x7f96f006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5e00700  1 -- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f006d310 msgr2=0x7f96f006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:25.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5e00700  1 --2- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f006d310 0x7f96f006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5e00700  1 -- 172.21.15.171:0/3995671972 >> v1:172.21.15.171:6789/0 conn(0x7f96f006dcb0 legacy=0x7f96f0133510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f4a00700  1 -- 172.21.15.171:0/3995671972 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242222256 0 0) 0x7f96f0070ed0 con 0x7f96f006dcb0
2024-03-29T09:08:25.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.409+0000 7f96f5e00700  1 -- 172.21.15.171:0/3995671972 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f0071f20 con 0x7f96f00963d0
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.410+0000 7f96f5e00700  1 --2- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f00963d0 0x7f96f00967b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96e40098f0 tx=0x7f96e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12dde1dafef168d server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.410+0000 7f96f4a00700  1 -- 172.21.15.171:0/3995671972 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400b8a0 con 0x7f96f00963d0
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.410+0000 7f96f4a00700  1 -- 172.21.15.171:0/3995671972 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400ba00 con 0x7f96f00963d0
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.410+0000 7f96f4a00700  1 -- 172.21.15.171:0/3995671972 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400bd90 con 0x7f96f00963d0
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 -- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f00963d0 msgr2=0x7f96f00967b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 --2- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f00963d0 0x7f96f00967b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96e40098f0 tx=0x7f96e4009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 -- 172.21.15.171:0/3995671972 shutdown_connections
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 --2- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f00963d0 0x7f96f00967b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 --2- 172.21.15.171:0/3995671972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f006d310 0x7f96f006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 -- 172.21.15.171:0/3995671972 >> 172.21.15.171:0/3995671972 conn(0x7f96f00978d0 msgr2=0x7f96f0097ce0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 -- 172.21.15.171:0/3995671972 shutdown_connections
2024-03-29T09:08:25.411 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.411+0000 7f96f8800700  1 -- 172.21.15.171:0/3995671972 wait complete.
2024-03-29T09:08:25.412 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.412+0000 7f96f8800700  1  Processor -- start
2024-03-29T09:08:25.412 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f8800700  1 --  start start
2024-03-29T09:08:25.412 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f8800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96f006d310 0x7f96f0090090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.412 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f8800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f006dcb0 0x7f96f00905d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f8800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f00963d0 0x7f96f0090b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f8800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0092350 con 0x7f96f006dcb0
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f8800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0092530 con 0x7f96f00963d0
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f8800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0092f50 con 0x7f96f006d310
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f5e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96f006d310 0x7f96f0090090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f6800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f00963d0 0x7f96f0090b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.413+0000 7f96f5e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96f006d310 0x7f96f0090090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53836/0 (socket says 172.21.15.171:53836)
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f5e00700  1 -- 172.21.15.171:0/1597472740 learned_addr learned my addr 172.21.15.171:0/1597472740 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:25.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f5400700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f006dcb0 0x7f96f00905d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f6800700  1 -- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96f006d310 msgr2=0x7f96f0090090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f6800700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96f006d310 0x7f96f0090090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f6800700  1 -- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f006dcb0 msgr2=0x7f96f00905d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f6800700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f006dcb0 0x7f96f00905d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f6800700  1 -- 172.21.15.171:0/1597472740 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4009550 con 0x7f96f00963d0
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f5400700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f006dcb0 0x7f96f00905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f5e00700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96f006d310 0x7f96f0090090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.414+0000 7f96f6800700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f00963d0 0x7f96f0090b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00cbe0 tx=0x7f96ec00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.415+0000 7f96ea000700  1 -- 172.21.15.171:0/1597472740 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00ab50 con 0x7f96f00963d0
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.415+0000 7f96ea000700  1 -- 172.21.15.171:0/1597472740 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec00acb0 con 0x7f96f00963d0
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.415+0000 7f96ea000700  1 -- 172.21.15.171:0/1597472740 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec007310 con 0x7f96f00963d0
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.415+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f0093790 con 0x7f96f00963d0
2024-03-29T09:08:25.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.415+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f01c3190 con 0x7f96f00963d0
2024-03-29T09:08:25.416 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.416+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f0092c70 con 0x7f96f00963d0
2024-03-29T09:08:25.416 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.416+0000 7f96ea000700  1 -- 172.21.15.171:0/1597472740 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 7) v1 ==== 55042+0+0 (secure 0 0 0) 0x7f96ec007470 con 0x7f96f00963d0
2024-03-29T09:08:25.416 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.417+0000 7f96ea000700  1 -- 172.21.15.171:0/1597472740 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7f96ec05c3f0 con 0x7f96f00963d0
2024-03-29T09:08:25.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.422+0000 7f96ea000700  1 -- 172.21.15.171:0/1597472740 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f96ec03a320 con 0x7f96f00963d0
2024-03-29T09:08:25.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.525+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e140623e0 con 0x7f5e1412b6a0
2024-03-29T09:08:25.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.526+0000 7f5e0aa00700  1 -- 172.21.15.171:0/3476778633 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e04017030 con 0x7f5e1412b6a0
2024-03-29T09:08:25.525 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 >> v1:172.21.15.171:6816/44806 conn(0x7f5df4047490 legacy=0x7f5df4049950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e1412b6a0 msgr2=0x7f5e1406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e1412b6a0 0x7f5e1406c910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400ebe0 tx=0x7f5e0400eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 shutdown_connections
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e1412f130 0x7f5e1406d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e1412b6a0 0x7f5e1406c910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 --2- 172.21.15.171:0/3476778633 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5e1412e6e0 0x7f5e1406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 >> 172.21.15.171:0/3476778633 conn(0x7f5e140a0ba0 msgr2=0x7f5e1412c2b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.528+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 shutdown_connections
2024-03-29T09:08:25.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.529+0000 7f5e19400700  1 -- 172.21.15.171:0/3476778633 wait complete.
2024-03-29T09:08:25.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.3
2024-03-29T09:08:25.569 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.569+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe31011fd20 con 0x7fe31012ecc0
2024-03-29T09:08:25.569 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.570+0000 7fe30d600700  1 -- 172.21.15.171:0/1334891967 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe30803d8e0 con 0x7fe31012ecc0
2024-03-29T09:08:25.569 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:25.570 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.571+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbbf80748d0 con 0x7fbbf809c9f0
2024-03-29T09:08:25.571 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.571+0000 7fbbf5600700  1 -- 172.21.15.171:0/3477026200 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbec015020 con 0x7fbbf809c9f0
2024-03-29T09:08:25.571 INFO:teuthology.orchestra.run.smithi171.stdout:38654705831
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 >> v1:172.21.15.171:6816/44806 conn(0x7fe2f0047490 legacy=0x7fe2f0049950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012ecc0 msgr2=0x7fe3101c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012ecc0 0x7fe3101c7460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe308007d90 tx=0x7fe30800e3c0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 shutdown_connections
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe31012ecc0 0x7fe3101c7460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe31012b530 0x7fe31008d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 --2- 172.21.15.171:0/1334891967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe31012e3a0 0x7fe31008d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 >> 172.21.15.171:0/1334891967 conn(0x7fe3100a0d70 msgr2=0x7fe31006e300 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.572+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 shutdown_connections
2024-03-29T09:08:25.572 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.573+0000 7fe318000700  1 -- 172.21.15.171:0/1334891967 wait complete.
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 >> v1:172.21.15.171:6816/44806 conn(0x7fbbd8047440 legacy=0x7fbbd8049900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf809c9f0 msgr2=0x7fbbf8130220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf809c9f0 0x7fbbf8130220 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbbec000c00 tx=0x7fbbec004750 comp rx=0 tx=0).stop
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 shutdown_connections
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf812ecc0 0x7fbbf8130ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbbf809c9f0 0x7fbbf8130220 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 --2- 172.21.15.171:0/3477026200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf812e3a0 0x7fbbf8130760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 >> 172.21.15.171:0/3477026200 conn(0x7fbbf809d530 msgr2=0x7fbbf8135180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.574+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 shutdown_connections
2024-03-29T09:08:25.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.575+0000 7fbbfea00700  1 -- 172.21.15.171:0/3477026200 wait complete.
2024-03-29T09:08:25.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.0
2024-03-29T09:08:25.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705831 for osd.2
2024-03-29T09:08:25.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.611+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96f0070960 con 0x7f96f00963d0
2024-03-29T09:08:25.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.611+0000 7f96ea000700  1 -- 172.21.15.171:0/1597472740 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96ec018020 con 0x7f96f00963d0
2024-03-29T09:08:25.610 INFO:teuthology.orchestra.run.smithi171.stdout:38654705832
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 >> v1:172.21.15.171:6816/44806 conn(0x7f96d4047490 legacy=0x7f96d4049950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f00963d0 msgr2=0x7f96f0090b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f00963d0 0x7f96f0090b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00cbe0 tx=0x7f96ec00cef0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 shutdown_connections
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f00963d0 0x7f96f0090b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f96f006d310 0x7f96f0090090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 --2- 172.21.15.171:0/1597472740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f006dcb0 0x7f96f00905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:25.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.613+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 >> 172.21.15.171:0/1597472740 conn(0x7f96f00978d0 msgr2=0x7f96f0125d00 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:25.614 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.614+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 shutdown_connections
2024-03-29T09:08:25.614 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:25.614+0000 7f96f8800700  1 -- 172.21.15.171:0/1597472740 wait complete.
2024-03-29T09:08:25.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705834 got 38654705832 for osd.1
2024-03-29T09:08:26.548 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T09:08:26.594 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T09:08:26.594 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T09:08:26.631 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T09:08:26.765 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.765+0000 7f37f3c00700  1  Processor -- start
2024-03-29T09:08:26.765 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.765+0000 7f37f3c00700  1 --  start start
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.766+0000 7f37f3c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec131840 0x7f37ec133c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.766+0000 7f37f3c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f37ec134170 0x7f37ec136560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.766+0000 7f37f3c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec071c20 con 0x7f37ec06f590
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.766+0000 7f37f3c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec070760 con 0x7f37ec134170
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.766+0000 7f37f3c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec071960 con 0x7f37ec131840
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.766+0000 7f37f1c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f37ec134170 0x7f37ec136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.767+0000 7f37f1c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f37ec134170 0x7f37ec136560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45828/0 (socket says 172.21.15.171:45828)
2024-03-29T09:08:26.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.767+0000 7f37f1c00700  1 -- 172.21.15.171:0/2497680016 learned_addr learned my addr 172.21.15.171:0/2497680016 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:26.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.767+0000 7f37ebe00700  1 --2- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec131840 0x7f37ec133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.767+0000 7f37f1c00700  1 -- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec131840 msgr2=0x7f37ec133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.767+0000 7f37f1c00700  1 --2- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec131840 0x7f37ec133c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.767+0000 7f37f1c00700  1 -- 172.21.15.171:0/2497680016 >> v1:172.21.15.171:6789/0 conn(0x7f37ec06f590 legacy=0x7f37ec06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.767+0000 7f37f1c00700  1 -- 172.21.15.171:0/2497680016 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec070fe0 con 0x7f37ec134170
2024-03-29T09:08:26.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.768+0000 7f37f1c00700  1 --2- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec136560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009e80 tx=0x7f37e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e647428507c06b0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.768+0000 7f37eb400700  1 -- 172.21.15.171:0/2497680016 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400e070 con 0x7f37ec134170
2024-03-29T09:08:26.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.768+0000 7f37eb400700  1 -- 172.21.15.171:0/2497680016 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e400b980 con 0x7f37ec134170
2024-03-29T09:08:26.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.768+0000 7f37eb400700  1 -- 172.21.15.171:0/2497680016 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400bd30 con 0x7f37ec134170
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 -- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 msgr2=0x7f37ec136560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 --2- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec136560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009e80 tx=0x7f37e400b330 comp rx=0 tx=0).stop
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 -- 172.21.15.171:0/2497680016 shutdown_connections
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 --2- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec136560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 --2- 172.21.15.171:0/2497680016 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec131840 0x7f37ec133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 -- 172.21.15.171:0/2497680016 >> 172.21.15.171:0/2497680016 conn(0x7f37ec09d5a0 msgr2=0x7f37ec09d9b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 -- 172.21.15.171:0/2497680016 shutdown_connections
2024-03-29T09:08:26.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.769+0000 7f37f3c00700  1 -- 172.21.15.171:0/2497680016 wait complete.
2024-03-29T09:08:26.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.771+0000 7f37f3c00700  1  Processor -- start
2024-03-29T09:08:26.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.771+0000 7f37f3c00700  1 --  start start
2024-03-29T09:08:26.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.772+0000 7f37f3c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec06f590 0x7f37ec06da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.772+0000 7f37f3c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37ec131840 0x7f37ec06dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.772+0000 7f37f3c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.772+0000 7f37f3c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec1265c0 con 0x7f37ec134170
2024-03-29T09:08:26.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.772+0000 7f37f3c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec127a00 con 0x7f37ec131840
2024-03-29T09:08:26.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.772+0000 7f37f3c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec135c50 con 0x7f37ec06f590
2024-03-29T09:08:26.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37ebe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37ec131840 0x7f37ec06dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37ebe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37ec131840 0x7f37ec06dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40722/0 (socket says 172.21.15.171:40722)
2024-03-29T09:08:26.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37ebe00700  1 -- 172.21.15.171:0/2019791039 learned_addr learned my addr 172.21.15.171:0/2019791039 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:26.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37f1c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37f1200700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec06f590 0x7f37ec06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37ebe00700  1 -- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec06f590 msgr2=0x7f37ec06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37ebe00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec06f590 0x7f37ec06da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.773+0000 7f37ebe00700  1 -- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 msgr2=0x7f37ec06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.774+0000 7f37ebe00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec06e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.774+0000 7f37ebe00700  1 -- 172.21.15.171:0/2019791039 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4009b30 con 0x7f37ec131840
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.774+0000 7f37f1c00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.774+0000 7f37ebe00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37ec131840 0x7f37ec06dfb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37d800e7e0 tx=0x7f37d800eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.774+0000 7f37e8c00700  1 -- 172.21.15.171:0/2019791039 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800c070 con 0x7f37ec131840
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.775+0000 7f37e8c00700  1 -- 172.21.15.171:0/2019791039 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8013610 con 0x7f37ec131840
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.775+0000 7f37e8c00700  1 -- 172.21.15.171:0/2019791039 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8013980 con 0x7f37ec131840
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.775+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ec071ee0 con 0x7f37ec131840
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.775+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec1271e0 con 0x7f37ec131840
2024-03-29T09:08:26.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.776+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ec0623e0 con 0x7f37ec131840
2024-03-29T09:08:26.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.777+0000 7f37e8c00700  1 -- 172.21.15.171:0/2019791039 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7f37d8013ae0 con 0x7f37ec131840
2024-03-29T09:08:26.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.778+0000 7f37e8c00700  1 -- 172.21.15.171:0/2019791039 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7f37d805c4a0 con 0x7f37ec131840
2024-03-29T09:08:26.781 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.782+0000 7f37e8c00700  1 -- 172.21.15.171:0/2019791039 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f37d803a140 con 0x7f37ec131840
2024-03-29T09:08:26.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.812+0000 7f58f3800700  1  Processor -- start
2024-03-29T09:08:26.812 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.812+0000 7efff4c00700  1  Processor -- start
2024-03-29T09:08:26.812 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.812+0000 7f58f3800700  1 --  start start
2024-03-29T09:08:26.812 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7efff4c00700  1 --  start start
2024-03-29T09:08:26.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f3800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58ec06d450 0x7f58ec06d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f3800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58ec06dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f3800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec06e2b0 con 0x7f58ec132ae0
2024-03-29T09:08:26.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f3800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec06ea20 con 0x7f58ec06d450
2024-03-29T09:08:26.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f3800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec06f790 con 0x7f58ec06ee80
2024-03-29T09:08:26.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f0e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58ec06d450 0x7f58ec06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f0e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58ec06d450 0x7f58ec06d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40728/0 (socket says 172.21.15.171:40728)
2024-03-29T09:08:26.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.813+0000 7f58f0e00700  1 -- 172.21.15.171:0/3981085781 learned_addr learned my addr 172.21.15.171:0/3981085781 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:26.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421446081 0 0) 0x7f58ec06e2b0 con 0x7f58ec132ae0
2024-03-29T09:08:26.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d40035b0 con 0x7f58ec132ae0
2024-03-29T09:08:26.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7efff4c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff012ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7efff4c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7efff012f130 0x7efff012b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7efff4c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012b6a0 0x7efff012bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7efff4c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff01258a0 con 0x7efff012f130
2024-03-29T09:08:26.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7efff4c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff01171a0 con 0x7efff012b6a0
2024-03-29T09:08:26.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.814+0000 7efff4c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff0071bc0 con 0x7efff012e6e0
2024-03-29T09:08:26.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7effed400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7efff012f130 0x7efff012b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7effed400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7efff012f130 0x7efff012b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45856/0 (socket says 172.21.15.171:45856)
2024-03-29T09:08:26.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7effed400700  1 -- 172.21.15.171:0/120180964 learned_addr learned my addr 172.21.15.171:0/120180964 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:26.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7effede00700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff012ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 <== mon.0 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210450073 0 0) 0x7f58d40035b0 con 0x7f58ec132ae0
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 msgr2=0x7f58ec06dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58ec06dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58ec06d450 msgr2=0x7f58ec06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58ec06d450 0x7f58ec06d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec072160 con 0x7f58ec132ae0
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 <== mon.0 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1029409515 0 0) 0x7f58e40019f0 con 0x7f58ec132ae0
2024-03-29T09:08:26.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 >> v1:172.21.15.171:6789/0 conn(0x7f58ec132ae0 legacy=0x7f58ec134ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58d4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4003fb0 0x7f58d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4004d90 0x7f58d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec06ea20 con 0x7f58d4004d90
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec06f790 con 0x7f58d4003fb0
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58d4014400 con 0x7f58ec06ee80
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58f0e00700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58d4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7f58f1800700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4004d90 0x7f58d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7f58ebe00700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4003fb0 0x7f58d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7effede00700  1 -- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012b6a0 msgr2=0x7efff012bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.815+0000 7effee800700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012b6a0 0x7efff012bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7effede00700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012b6a0 0x7efff012bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7effede00700  1 -- 172.21.15.171:0/120180964 >> v2:172.21.15.171:3300/0 conn(0x7efff012f130 msgr2=0x7efff012b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7effede00700  1 --2- 172.21.15.171:0/120180964 >> v2:172.21.15.171:3300/0 conn(0x7efff012f130 0x7efff012b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7effede00700  1 -- 172.21.15.171:0/120180964 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff012f530 con 0x7efff012e6e0
2024-03-29T09:08:26.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7effee800700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012b6a0 0x7efff012bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:26.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7f58f0e00700  1 -- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4003fb0 msgr2=0x7f58d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7f58f0e00700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4003fb0 0x7f58d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7f58f0e00700  1 -- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4004d90 msgr2=0x7f58d4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7f58f0e00700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4004d90 0x7f58d4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7f58f0e00700  1 -- 172.21.15.171:0/3981085781 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40035b0 con 0x7f58ec06ee80
2024-03-29T09:08:26.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7f58f1800700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4004d90 0x7f58d4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:26.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.816+0000 7effede00700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff012ebf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7effe8009840 tx=0x7effe8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=620947249617eadb server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.817+0000 7f58f0e00700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58d4003a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0741d0 tx=0x7f58d4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e893c438da578e server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.817+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0009e10 con 0x7f58ec06ee80
2024-03-29T09:08:26.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.817+0000 7effeca00700  1 -- 172.21.15.171:0/120180964 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011830 con 0x7efff012e6e0
2024-03-29T09:08:26.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.817+0000 7effeca00700  1 -- 172.21.15.171:0/120180964 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe8011990 con 0x7efff012e6e0
2024-03-29T09:08:26.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.817+0000 7effeca00700  1 -- 172.21.15.171:0/120180964 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011d20 con 0x7efff012e6e0
2024-03-29T09:08:26.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.817+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e000e6c0 con 0x7f58ec06ee80
2024-03-29T09:08:26.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.817+0000 7f58eb400700  1 -- 172.21.15.171:0/3981085781 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000ea50 con 0x7f58ec06ee80
2024-03-29T09:08:26.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 -- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 msgr2=0x7efff012ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff012ebf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7effe8009840 tx=0x7effe8009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:26.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 -- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 msgr2=0x7f58d4003a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58d4003a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0741d0 tx=0x7f58d4005880 comp rx=0 tx=0).stop
2024-03-29T09:08:26.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 -- 172.21.15.171:0/120180964 shutdown_connections
2024-03-29T09:08:26.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012b6a0 0x7efff012bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 --2- 172.21.15.171:0/120180964 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff012ebf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 --2- 172.21.15.171:0/120180964 >> v2:172.21.15.171:3300/0 conn(0x7efff012f130 0x7efff012b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.824 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 -- 172.21.15.171:0/120180964 >> 172.21.15.171:0/120180964 conn(0x7efff00a0ba0 msgr2=0x7efff00a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:26.824 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 -- 172.21.15.171:0/3981085781 shutdown_connections
2024-03-29T09:08:26.824 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4004d90 0x7f58d4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.824 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58d4003a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.824 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 --2- 172.21.15.171:0/3981085781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4003fb0 0x7f58d4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.824 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 -- 172.21.15.171:0/3981085781 >> 172.21.15.171:0/3981085781 conn(0x7f58ec09ba80 msgr2=0x7f58ec09c850 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:26.825 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 -- 172.21.15.171:0/120180964 shutdown_connections
2024-03-29T09:08:26.825 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7efff4c00700  1 -- 172.21.15.171:0/120180964 wait complete.
2024-03-29T09:08:26.825 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 -- 172.21.15.171:0/3981085781 shutdown_connections
2024-03-29T09:08:26.825 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.818+0000 7f58f3800700  1 -- 172.21.15.171:0/3981085781 wait complete.
2024-03-29T09:08:26.825 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.820+0000 7efff4c00700  1  Processor -- start
2024-03-29T09:08:26.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.820+0000 7f58f3800700  1  Processor -- start
2024-03-29T09:08:26.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.820+0000 7efff4c00700  1 --  start start
2024-03-29T09:08:26.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.820+0000 7f58f3800700  1 --  start start
2024-03-29T09:08:26.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.820+0000 7efff4c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efff012b6a0 0x7efff006c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.820+0000 7efff4c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.820+0000 7efff4c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012f130 0x7efff006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58f3800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4003fb0 0x7f58ec131f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58f3800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4004d90 0x7f58ec1324b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7efff4c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff006ea60 con 0x7efff012b6a0
2024-03-29T09:08:26.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7efff4c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff006fa30 con 0x7efff012f130
2024-03-29T09:08:26.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7efff4c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff0070000 con 0x7efff012e6e0
2024-03-29T09:08:26.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58f3800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58ec093ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58f3800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0968f0 con 0x7f58d4003fb0
2024-03-29T09:08:26.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58f3800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec095c80 con 0x7f58d4004d90
2024-03-29T09:08:26.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58f3800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec096610 con 0x7f58ec06ee80
2024-03-29T09:08:26.829 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7effed400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.829 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7effed400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:53878/0 (socket says 172.21.15.171:53878)
2024-03-29T09:08:26.829 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7effed400700  1 -- 172.21.15.171:0/2629554621 learned_addr learned my addr 172.21.15.171:0/2629554621 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:26.829 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7effede00700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efff012b6a0 0x7efff006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7effee800700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012f130 0x7efff006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7effed400700  1 -- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012f130 msgr2=0x7efff006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58ebe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4004d90 0x7f58ec1324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.821+0000 7f58f0e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4003fb0 0x7f58ec131f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f0e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4003fb0 0x7f58ec131f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:45884/0 (socket says 172.21.15.171:45884)
2024-03-29T09:08:26.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f0e00700  1 -- 172.21.15.171:0/4186161259 learned_addr learned my addr 172.21.15.171:0/4186161259 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:26.830 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f1800700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58ec093ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7effed400700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012f130 0x7efff006d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7effed400700  1 -- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efff012b6a0 msgr2=0x7efff006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7effed400700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efff012b6a0 0x7efff006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7effed400700  1 -- 172.21.15.171:0/2629554621 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80094a0 con 0x7efff012e6e0
2024-03-29T09:08:26.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7effed400700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff006cb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7effd800e8e0 tx=0x7effd800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f0e00700  1 -- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 msgr2=0x7f58ec093ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f0e00700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58ec093ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f0e00700  1 -- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4004d90 msgr2=0x7f58ec1324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f0e00700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4004d90 0x7f58ec1324b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f0e00700  1 -- 172.21.15.171:0/4186161259 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec09aad0 con 0x7f58d4003fb0
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58f1800700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58ec093ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7f58ebe00700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4004d90 0x7f58ec1324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.822+0000 7effe6000700  1 -- 172.21.15.171:0/2629554621 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800eee0 con 0x7efff012e6e0
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7effe6000700  1 -- 172.21.15.171:0/2629554621 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd800c850 con 0x7efff012e6e0
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7effe6000700  1 -- 172.21.15.171:0/2629554621 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800cbc0 con 0x7efff012e6e0
2024-03-29T09:08:26.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff006f200 con 0x7efff012e6e0
2024-03-29T09:08:26.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7f58f0e00700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4003fb0 0x7f58ec131f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58d4014590 tx=0x7f58e00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7f58e8c00700  1 -- 172.21.15.171:0/4186161259 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0013ab0 con 0x7f58d4003fb0
2024-03-29T09:08:26.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7f58e8c00700  1 -- 172.21.15.171:0/4186161259 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0013c30 con 0x7f58d4003fb0
2024-03-29T09:08:26.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7f58e8c00700  1 -- 172.21.15.171:0/4186161259 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e001c450 con 0x7f58d4003fb0
2024-03-29T09:08:26.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec0954c0 con 0x7f58d4003fb0
2024-03-29T09:08:26.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.823+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff01c35d0 con 0x7efff012e6e0
2024-03-29T09:08:26.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.824+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec0941d0 con 0x7f58d4003fb0
2024-03-29T09:08:26.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.825+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff006b810 con 0x7efff012e6e0
2024-03-29T09:08:26.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.825+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec0623e0 con 0x7f58d4003fb0
2024-03-29T09:08:26.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.825+0000 7effe6000700  1 -- 172.21.15.171:0/2629554621 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7effd800cd20 con 0x7efff012e6e0
2024-03-29T09:08:26.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.826+0000 7f58e8c00700  1 -- 172.21.15.171:0/4186161259 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7f58e001c5d0 con 0x7f58d4003fb0
2024-03-29T09:08:26.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.826+0000 7f58e8c00700  1 -- 172.21.15.171:0/4186161259 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7f58e005def0 con 0x7f58d4003fb0
2024-03-29T09:08:26.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.826+0000 7effe6000700  1 -- 172.21.15.171:0/2629554621 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7effd805c6d0 con 0x7efff012e6e0
2024-03-29T09:08:26.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.831+0000 7effe6000700  1 -- 172.21.15.171:0/2629554621 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7effd803a450 con 0x7efff012e6e0
2024-03-29T09:08:26.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.831+0000 7f58e8c00700  1 -- 172.21.15.171:0/4186161259 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f58e0004330 con 0x7f58d4003fb0
2024-03-29T09:08:26.889 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.890+0000 7fea44e00700  1  Processor -- start
2024-03-29T09:08:26.890 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.890+0000 7fea44e00700  1 --  start start
2024-03-29T09:08:26.890 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea44e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea4012b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.890 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea44e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012f010 0x7fea40136800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea44e00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea40067250 con 0x7fea4012e480
2024-03-29T09:08:26.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea44e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea400717c0 con 0x7fea4012b4d0
2024-03-29T09:08:26.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea44e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea40071a70 con 0x7fea4012f010
2024-03-29T09:08:26.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea3e800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012f010 0x7fea40136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea3d400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fea4012e480 0x7fea4012e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:50732/0 (socket says 172.21.15.171:50732)
2024-03-29T09:08:26.891 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.891+0000 7fea3d400700  1 -- 172.21.15.171:0/2358142356 learned_addr learned my addr 172.21.15.171:0/2358142356 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:26.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3de00700  1 --2- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea4012b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3ca00700  1 -- 172.21.15.171:0/2358142356 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137809024 0 0) 0x7fea40067250 con 0x7fea4012e480
2024-03-29T09:08:26.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3e800700  1 -- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 msgr2=0x7fea4012b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:26.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3e800700  1 --2- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea4012b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3e800700  1 -- 172.21.15.171:0/2358142356 >> v1:172.21.15.171:6789/0 conn(0x7fea4012e480 legacy=0x7fea4012e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.892 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3e800700  1 -- 172.21.15.171:0/2358142356 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4012bdf0 con 0x7fea4012f010
2024-03-29T09:08:26.893 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3de00700  1 --2- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea4012b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:26.893 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.892+0000 7fea3e800700  1 --2- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012f010 0x7fea40136800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea38009dc0 tx=0x7fea3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394609e8e551d666 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.893 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.893+0000 7fea3ca00700  1 -- 172.21.15.171:0/2358142356 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3800e070 con 0x7fea4012f010
2024-03-29T09:08:26.893 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.893+0000 7fea3ca00700  1 -- 172.21.15.171:0/2358142356 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3800bbd0 con 0x7fea4012f010
2024-03-29T09:08:26.893 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.893+0000 7fea3ca00700  1 -- 172.21.15.171:0/2358142356 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38012430 con 0x7fea4012f010
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.893+0000 7fea44e00700  1 -- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012f010 msgr2=0x7fea40136800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.893+0000 7fea44e00700  1 --2- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012f010 0x7fea40136800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea38009dc0 tx=0x7fea3800b330 comp rx=0 tx=0).stop
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.894+0000 7fea44e00700  1 -- 172.21.15.171:0/2358142356 shutdown_connections
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.894+0000 7fea44e00700  1 --2- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012f010 0x7fea40136800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.894+0000 7fea44e00700  1 --2- 172.21.15.171:0/2358142356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea4012b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.894+0000 7fea44e00700  1 -- 172.21.15.171:0/2358142356 >> 172.21.15.171:0/2358142356 conn(0x7fea4009d780 msgr2=0x7fea4009db90 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.894+0000 7fea44e00700  1 -- 172.21.15.171:0/2358142356 shutdown_connections
2024-03-29T09:08:26.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.894+0000 7fea44e00700  1 -- 172.21.15.171:0/2358142356 wait complete.
2024-03-29T09:08:26.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.896+0000 7fea44e00700  1  Processor -- start
2024-03-29T09:08:26.895 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.896+0000 7fea44e00700  1 --  start start
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea44e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea40134d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea44e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012e480 0x7fea401352d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea44e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4012f010 0x7fea40135810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea44e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea40133800 con 0x7fea4012f010
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea44e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea40133a40 con 0x7fea4012b4d0
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea44e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea40133f20 con 0x7fea4012e480
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea3d400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012e480 0x7fea401352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea3de00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea40134d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea3de00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea40134d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55834/0 (socket says 172.21.15.171:55834)
2024-03-29T09:08:26.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.897+0000 7fea3de00700  1 -- 172.21.15.171:0/2428979087 learned_addr learned my addr 172.21.15.171:0/2428979087 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:26.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3e800700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4012f010 0x7fea40135810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:26.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3de00700  1 -- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012e480 msgr2=0x7fea401352d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3de00700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012e480 0x7fea401352d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3de00700  1 -- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4012f010 msgr2=0x7fea40135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:26.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3de00700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4012f010 0x7fea40135810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:26.899 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3de00700  1 -- 172.21.15.171:0/2428979087 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38009a70 con 0x7fea4012b4d0
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3d400700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012e480 0x7fea401352d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3e800700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4012f010 0x7fea40135810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.898+0000 7fea3de00700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea40134d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea3000e810 tx=0x7fea3000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.899+0000 7fea36000700  1 -- 172.21.15.171:0/2428979087 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30004230 con 0x7fea4012b4d0
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.899+0000 7fea36000700  1 -- 172.21.15.171:0/2428979087 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300043b0 con 0x7fea4012b4d0
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.899+0000 7fea36000700  1 -- 172.21.15.171:0/2428979087 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300038e0 con 0x7fea4012b4d0
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.899+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea40132dd0 con 0x7fea4012b4d0
2024-03-29T09:08:26.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.899+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea401c3080 con 0x7fea4012b4d0
2024-03-29T09:08:26.901 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.901+0000 7fea36000700  1 -- 172.21.15.171:0/2428979087 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7fea30003a40 con 0x7fea4012b4d0
2024-03-29T09:08:26.901 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.901+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea40134b20 con 0x7fea4012b4d0
2024-03-29T09:08:26.901 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.902+0000 7fea36000700  1 -- 172.21.15.171:0/2428979087 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2967+0+0 (secure 0 0 0) 0x7fea3005c1b0 con 0x7fea4012b4d0
2024-03-29T09:08:26.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:26.909+0000 7fea36000700  1 -- 172.21.15.171:0/2428979087 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fea30039f10 con 0x7fea4012b4d0
2024-03-29T09:08:27.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.015+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58ec0748d0 con 0x7f58d4003fb0
2024-03-29T09:08:27.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.016+0000 7f58e8c00700  1 -- 172.21.15.171:0/4186161259 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58e002c020 con 0x7f58d4003fb0
2024-03-29T09:08:27.015 INFO:teuthology.orchestra.run.smithi171.stdout:38654705834
2024-03-29T09:08:27.016 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.017+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37ec0748d0 con 0x7f37ec131840
2024-03-29T09:08:27.016 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.017+0000 7f37e8c00700  1 -- 172.21.15.171:0/2019791039 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37d803d760 con 0x7f37ec131840
2024-03-29T09:08:27.016 INFO:teuthology.orchestra.run.smithi171.stdout:38654705834
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 >> v1:172.21.15.171:6816/44806 conn(0x7f58cc047560 legacy=0x7f58cc049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4003fb0 msgr2=0x7f58ec131f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4003fb0 0x7f58ec131f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58d4014590 tx=0x7f58e00047c0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 shutdown_connections
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f58ec06ee80 0x7f58ec093ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d4003fb0 0x7f58ec131f70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 --2- 172.21.15.171:0/4186161259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d4004d90 0x7f58ec1324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 >> 172.21.15.171:0/4186161259 conn(0x7f58ec09ba80 msgr2=0x7f58ec08cfe0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 shutdown_connections
2024-03-29T09:08:27.019 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.018+0000 7f58f3800700  1 -- 172.21.15.171:0/4186161259 wait complete.
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 >> v1:172.21.15.171:6816/44806 conn(0x7f37cc047560 legacy=0x7f37cc049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37ec131840 msgr2=0x7f37ec06dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37ec131840 0x7f37ec06dfb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37d800e7e0 tx=0x7f37d800eaf0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 shutdown_connections
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37ec134170 0x7f37ec06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f37ec06f590 0x7f37ec06da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 --2- 172.21.15.171:0/2019791039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37ec131840 0x7f37ec06dfb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 >> 172.21.15.171:0/2019791039 conn(0x7f37ec09d5a0 msgr2=0x7f37ec135080 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 shutdown_connections
2024-03-29T09:08:27.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.020+0000 7f37f3c00700  1 -- 172.21.15.171:0/2019791039 wait complete.
2024-03-29T09:08:27.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.023+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efff00623e0 con 0x7efff012e6e0
2024-03-29T09:08:27.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.023+0000 7effe6000700  1 -- 172.21.15.171:0/2629554621 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effd8017070 con 0x7efff012e6e0
2024-03-29T09:08:27.023 INFO:teuthology.orchestra.run.smithi171.stdout:38654705834
2024-03-29T09:08:27.026 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.026+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 >> v1:172.21.15.171:6816/44806 conn(0x7effcc0475b0 legacy=0x7effcc049a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.026 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.026+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 msgr2=0x7efff006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.026 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.026+0000 7efff4c00700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff006cb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7effd800e8e0 tx=0x7effd800eca0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.026 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.027+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 shutdown_connections
2024-03-29T09:08:27.026 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.027+0000 7efff4c00700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efff012f130 0x7efff006d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.027+0000 7efff4c00700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efff012b6a0 0x7efff006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.027+0000 7efff4c00700  1 --2- 172.21.15.171:0/2629554621 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7efff012e6e0 0x7efff006cb90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.027+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 >> 172.21.15.171:0/2629554621 conn(0x7efff00a0ba0 msgr2=0x7efff0129040 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.027+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 shutdown_connections
2024-03-29T09:08:27.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.027+0000 7efff4c00700  1 -- 172.21.15.171:0/2629554621 wait complete.
2024-03-29T09:08:27.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705834 for osd.3
2024-03-29T09:08:27.041 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:27.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705834 for osd.2
2024-03-29T09:08:27.047 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:27.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705833 got 38654705834 for osd.0
2024-03-29T09:08:27.052 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:27.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.100+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea400623e0 con 0x7fea4012b4d0
2024-03-29T09:08:27.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.100+0000 7fea36000700  1 -- 172.21.15.171:0/2428979087 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea3000f040 con 0x7fea4012b4d0
2024-03-29T09:08:27.100 INFO:teuthology.orchestra.run.smithi171.stdout:38654705835
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 >> v1:172.21.15.171:6816/44806 conn(0x7fea20047560 legacy=0x7fea20049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 msgr2=0x7fea40134d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea40134d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea3000e810 tx=0x7fea3000eb20 comp rx=0 tx=0).stop
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 shutdown_connections
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea4012f010 0x7fea40135810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea4012b4d0 0x7fea40134d90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 --2- 172.21.15.171:0/2428979087 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fea4012e480 0x7fea401352d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 >> 172.21.15.171:0/2428979087 conn(0x7fea4009d780 msgr2=0x7fea4012c900 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.102+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 shutdown_connections
2024-03-29T09:08:27.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.103+0000 7fea44e00700  1 -- 172.21.15.171:0/2428979087 wait complete.
2024-03-29T09:08:27.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705834 got 38654705835 for osd.1
2024-03-29T09:08:27.120 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:27.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean
2024-03-29T09:08:27.121 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:27.312 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.313+0000 7f448a400700  1  Processor -- start
2024-03-29T09:08:27.313 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.313+0000 7f448a400700  1 --  start start
2024-03-29T09:08:27.314 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f448a400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448412b500 0x7f448412b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.314 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f448a400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f448406e420 0x7f448406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f448a400700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484072680 con 0x7f448406eda0
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f448a400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4484098a80 con 0x7f448406e420
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f448a400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4484070b20 con 0x7f448412b500
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f4483400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448412b500 0x7f448412b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f4482a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f448406e420 0x7f448406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f4483400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448412b500 0x7f448412b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55844/0 (socket says 172.21.15.171:55844)
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f4482a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f448406e420 0x7f448406e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59718/0 (socket says 172.21.15.171:59718)
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f4483400700  1 -- 172.21.15.171:0/3833412569 learned_addr learned my addr 172.21.15.171:0/3833412569 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f4483400700  1 -- 172.21.15.171:0/3833412569 >> v2:172.21.15.171:3300/0 conn(0x7f448406e420 msgr2=0x7f448406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.314+0000 7f4483400700  1 --2- 172.21.15.171:0/3833412569 >> v2:172.21.15.171:3300/0 conn(0x7f448406e420 0x7f448406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.315+0000 7f4483400700  1 -- 172.21.15.171:0/3833412569 >> v1:172.21.15.171:6789/0 conn(0x7f448406eda0 legacy=0x7f4484132400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.315 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.315+0000 7f4483400700  1 -- 172.21.15.171:0/3833412569 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448412b0d0 con 0x7f448412b500
2024-03-29T09:08:27.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.315+0000 7f4482a00700  1 --2- 172.21.15.171:0/3833412569 >> v2:172.21.15.171:3300/0 conn(0x7f448406e420 0x7f448406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:27.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.315+0000 7f4483400700  1 --2- 172.21.15.171:0/3833412569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448412b500 0x7f448412b8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f447400bb90 tx=0x7f447400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494e2bce31046556 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:27.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.315+0000 7f4482000700  1 -- 172.21.15.171:0/3833412569 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400dd30 con 0x7f448412b500
2024-03-29T09:08:27.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.315+0000 7f4482000700  1 -- 172.21.15.171:0/3833412569 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447400de90 con 0x7f448412b500
2024-03-29T09:08:27.316 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.315+0000 7f4482000700  1 -- 172.21.15.171:0/3833412569 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474010690 con 0x7f448412b500
2024-03-29T09:08:27.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 -- 172.21.15.171:0/3833412569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448412b500 msgr2=0x7f448412b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 --2- 172.21.15.171:0/3833412569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448412b500 0x7f448412b8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f447400bb90 tx=0x7f447400bea0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 -- 172.21.15.171:0/3833412569 shutdown_connections
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 --2- 172.21.15.171:0/3833412569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448412b500 0x7f448412b8e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 --2- 172.21.15.171:0/3833412569 >> v2:172.21.15.171:3300/0 conn(0x7f448406e420 0x7f448406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 -- 172.21.15.171:0/3833412569 >> 172.21.15.171:0/3833412569 conn(0x7f44840978d0 msgr2=0x7f4484097ce0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 -- 172.21.15.171:0/3833412569 shutdown_connections
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.316+0000 7f448a400700  1 -- 172.21.15.171:0/3833412569 wait complete.
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.317+0000 7f448a400700  1  Processor -- start
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.317+0000 7f448a400700  1 --  start start
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f448a400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f448406e420 0x7f448408f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f448a400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448406eda0 0x7f448408f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f448a400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448412b500 0x7f448408fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.319 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f448a400700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4484091d70 con 0x7f448412b500
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f448a400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448412a8e0 con 0x7f448406eda0
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f448a400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4484092170 con 0x7f448406e420
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f4482a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448406eda0 0x7f448408f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f4483400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f448406e420 0x7f448408f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f4482a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448406eda0 0x7f448408f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55852/0 (socket says 172.21.15.171:55852)
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f4482a00700  1 -- 172.21.15.171:0/2086613688 learned_addr learned my addr 172.21.15.171:0/2086613688 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f4483e00700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448412b500 0x7f448408fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.318+0000 7f4482a00700  1 -- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f448406e420 msgr2=0x7f448408f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f4482a00700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f448406e420 0x7f448408f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f4482a00700  1 -- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448412b500 msgr2=0x7f448408fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f4482a00700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448412b500 0x7f448408fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f4482a00700  1 -- 172.21.15.171:0/2086613688 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700094a0 con 0x7f448406eda0
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f4483400700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f448406e420 0x7f448408f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f4482a00700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448406eda0 0x7f448408f920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f447000ebe0 tx=0x7f447000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:27.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f447b400700  1 -- 172.21.15.171:0/2086613688 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000c850 con 0x7f448406eda0
2024-03-29T09:08:27.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f447b400700  1 -- 172.21.15.171:0/2086613688 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000c9b0 con 0x7f448406eda0
2024-03-29T09:08:27.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447400b7f0 con 0x7f448406eda0
2024-03-29T09:08:27.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f447b400700  1 -- 172.21.15.171:0/2086613688 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000cd40 con 0x7f448406eda0
2024-03-29T09:08:27.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.319+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4484090880 con 0x7f448406eda0
2024-03-29T09:08:27.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.320+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44840623e0 con 0x7f448406eda0
2024-03-29T09:08:27.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.321+0000 7f447b400700  1 -- 172.21.15.171:0/2086613688 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7f4470013470 con 0x7f448406eda0
2024-03-29T09:08:27.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.321+0000 7f447b400700  1 -- 172.21.15.171:0/2086613688 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2950+0+0 (secure 0 0 0) 0x7f447005c890 con 0x7f448406eda0
2024-03-29T09:08:27.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.325+0000 7f447b400700  1 -- 172.21.15.171:0/2086613688 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f447003a4c0 con 0x7f448406eda0
2024-03-29T09:08:27.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.491+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f448406fc20 con 0x7f4464047560
2024-03-29T09:08:27.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.493+0000 7f447b400700  1 -- 172.21.15.171:0/2086613688 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+39411 (unknown 2965378022 0 3410847044) 0x7f447400db30 con 0x7f4464047560
2024-03-29T09:08:27.495 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:27.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 >> v1:172.21.15.171:6816/44806 conn(0x7f4464047560 legacy=0x7f4464049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448406eda0 msgr2=0x7f448408f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448406eda0 0x7f448408f920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f447000ebe0 tx=0x7f447000eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 shutdown_connections
2024-03-29T09:08:27.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448412b500 0x7f448408fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f448406e420 0x7f448408f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 --2- 172.21.15.171:0/2086613688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448406eda0 0x7f448408f920 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 >> 172.21.15.171:0/2086613688 conn(0x7f44840978d0 msgr2=0x7f4484125b40 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 shutdown_connections
2024-03-29T09:08:27.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.495+0000 7f448a400700  1 -- 172.21.15.171:0/2086613688 wait complete.
2024-03-29T09:08:27.497 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:27.512 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-03-29T09:08:27.074578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188856,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298504,"statfs":{"total":386547056640,"available":385329668096,"internally_reserved":0,"allocated":483328,"data_stored":132060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556305+0000","last_change":"2024-03-29T08:54:29.570074+0000","last_active":"2024-03-29T08:54:34.556305+0000","last_peered":"2024-03-29T08:54:34.556305+0000","last_clean":"2024-03-29T08:54:34.556305+0000","last_became_active":"2024-03-29T08:54:29.569664+0000","last_became_peered":"2024-03-29T08:54:29.569664+0000","last_unstale":"2024-03-29T08:54:34.556305+0000","last_undegraded":"2024-03-29T08:54:34.556305+0000","last_fullsized":"2024-03-29T08:54:34.556305+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556502+0000","last_change":"2024-03-29T08:54:29.572552+0000","last_active":"2024-03-29T08:54:34.556502+0000","last_peered":"2024-03-29T08:54:34.556502+0000","last_clean":"2024-03-29T08:54:34.556502+0000","last_became_active":"2024-03-29T08:54:29.569749+0000","last_became_peered":"2024-03-29T08:54:29.569749+0000","last_unstale":"2024-03-29T08:54:34.556502+0000","last_undegraded":"2024-03-29T08:54:34.556502+0000","last_fullsized":"2024-03-29T08:54:34.556502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556182+0000","last_change":"2024-03-29T08:54:29.570245+0000","last_active":"2024-03-29T08:54:34.556182+0000","last_peered":"2024-03-29T08:54:34.556182+0000","last_clean":"2024-03-29T08:54:34.556182+0000","last_became_active":"2024-03-29T08:54:29.569819+0000","last_became_peered":"2024-03-29T08:54:29.569819+0000","last_unstale":"2024-03-29T08:54:34.556182+0000","last_undegraded":"2024-03-29T08:54:34.556182+0000","last_fullsized":"2024-03-29T08:54:34.556182+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556214+0000","last_change":"2024-03-29T08:54:29.549849+0000","last_active":"2024-03-29T08:54:34.556214+0000","last_peered":"2024-03-29T08:54:34.556214+0000","last_clean":"2024-03-29T08:54:34.556214+0000","last_became_active":"2024-03-29T08:54:29.548886+0000","last_became_peered":"2024-03-29T08:54:29.548886+0000","last_unstale":"2024-03-29T08:54:34.556214+0000","last_undegraded":"2024-03-29T08:54:34.556214+0000","last_fullsized":"2024-03-29T08:54:34.556214+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556491+0000","last_change":"2024-03-29T08:54:29.570495+0000","last_active":"2024-03-29T08:54:34.556491+0000","last_peered":"2024-03-29T08:54:34.556491+0000","last_clean":"2024-03-29T08:54:34.556491+0000","last_became_active":"2024-03-29T08:54:29.570203+0000","last_became_peered":"2024-03-29T08:54:29.570203+0000","last_unstale":"2024-03-29T08:54:34.556491+0000","last_undegraded":"2024-03-29T08:54:34.556491+0000","last_fullsized":"2024-03-29T08:54:34.556491+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556329+0000","last_change":"2024-03-29T08:54:29.549619+0000","last_active":"2024-03-29T08:54:34.556329+0000","last_peered":"2024-03-29T08:54:34.556329+0000","last_clean":"2024-03-29T08:54:34.556329+0000","last_became_active":"2024-03-29T08:54:29.549209+0000","last_became_peered":"2024-03-29T08:54:29.549209+0000","last_unstale":"2024-03-29T08:54:34.556329+0000","last_undegraded":"2024-03-29T08:54:34.556329+0000","last_fullsized":"2024-03-29T08:54:34.556329+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.555337+0000","last_change":"2024-03-29T08:54:29.546972+0000","last_active":"2024-03-29T08:54:34.555337+0000","last_peered":"2024-03-29T08:54:34.555337+0000","last_clean":"2024-03-29T08:54:34.555337+0000","last_became_active":"2024-03-29T08:54:29.546652+0000","last_became_peered":"2024-03-29T08:54:29.546652+0000","last_unstale":"2024-03-29T08:54:34.555337+0000","last_undegraded":"2024-03-29T08:54:34.555337+0000","last_fullsized":"2024-03-29T08:54:34.555337+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556135+0000","last_change":"2024-03-29T08:54:29.551516+0000","last_active":"2024-03-29T08:54:34.556135+0000","last_peered":"2024-03-29T08:54:34.556135+0000","last_clean":"2024-03-29T08:54:34.556135+0000","last_became_active":"2024-03-29T08:54:29.551142+0000","last_became_peered":"2024-03-29T08:54:29.551142+0000","last_unstale":"2024-03-29T08:54:34.556135+0000","last_undegraded":"2024-03-29T08:54:34.556135+0000","last_fullsized":"2024-03-29T08:54:34.556135+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556497+0000","last_change":"2024-03-29T08:54:29.572921+0000","last_active":"2024-03-29T08:54:34.556497+0000","last_peered":"2024-03-29T08:54:34.556497+0000","last_clean":"2024-03-29T08:54:34.556497+0000","last_became_active":"2024-03-29T08:54:29.571269+0000","last_became_peered":"2024-03-29T08:54:29.571269+0000","last_unstale":"2024-03-29T08:54:34.556497+0000","last_undegraded":"2024-03-29T08:54:34.556497+0000","last_fullsized":"2024-03-29T08:54:34.556497+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705834,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.441,"15min":0.435},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.49099999999999999,"15min":0.498},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.50900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30499999999999999},"max":{"1min":0.48799999999999999,"5min":0.57699999999999996,"15min":0.58799999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.505,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.46600000000000003,"15min":0.47699999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.53000000000000003,"5min":0.63,"15min":0.63},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.52300000000000002,"5min":0.63800000000000001,"15min":0.66700000000000004},"last":0.46100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705834,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 29 09:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.42199999999999999,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28799999999999998},"max":{"1min":0.437,"5min":0.65800000000000003,"15min":0.69599999999999995},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.48399999999999999,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.31900000000000001},"max":{"1min":0.45500000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.36799999999999999}]},{"osd":1,"last update":"Fri Mar 29 09:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.42299999999999999,"15min":0.44400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.49099999999999999,"5min":0.63,"15min":0.65400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.44600000000000001,"5min":0.63800000000000001,"15min":0.69099999999999995},"last":0.308}]},{"osd":3,"last update":"Fri Mar 29 09:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32200000000000001},"max":{"1min":0.5,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47299999999999998,"15min":0.48899999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.46600000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.34999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705834,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.25800000000000001},"max":{"1min":0.46100000000000002,"5min":0.67300000000000004,"15min":0.68600000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.505,"15min":0.51300000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.48399999999999999,"5min":0.68500000000000005,"15min":0.71499999999999997},"last":0.86199999999999999}]},{"osd":2,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.435,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.48799999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.443,"15min":0.45600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.45600000000000002,"5min":0.65100000000000002,"15min":0.72799999999999998},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.48399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.46800000000000003,"5min":0.66800000000000004,"15min":0.67700000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.48099999999999998,"15min":0.495},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.45500000000000002,"5min":0.65200000000000002,"15min":0.77300000000000002},"last":0.92700000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705835,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 29 09:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.439,"15min":0.44500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.498,"5min":0.628,"15min":0.628},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.56100000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Mar 29 09:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.54200000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.51200000000000001,"5min":0.64700000000000002,"15min":0.75600000000000001},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Mar 29 09:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.505,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.58699999999999997,"5min":0.70499999999999996,"15min":0.70599999999999996},"last":0.497},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.53000000000000003,"5min":0.65400000000000003,"15min":0.66500000000000004},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:27.513 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:27.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.707+0000 7f174ea00700  1  Processor -- start
2024-03-29T09:08:27.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.707+0000 7f174ea00700  1 --  start start
2024-03-29T09:08:27.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f174ea00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f174812ee90 0x7f1748133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f174ea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1748133c60 0x7f1748136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f174ea00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1748071520 con 0x7f174812e3a0
2024-03-29T09:08:27.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f174ea00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748070d80 con 0x7f174812ee90
2024-03-29T09:08:27.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f174ea00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480722b0 con 0x7f1748133c60
2024-03-29T09:08:27.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1747400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f174812ee90 0x7f1748133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f174ca00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1748133c60 0x7f1748136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1747400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f174812ee90 0x7f1748133720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59738/0 (socket says 172.21.15.171:59738)
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1747400700  1 -- 172.21.15.171:0/3340741477 learned_addr learned my addr 172.21.15.171:0/3340741477 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1747400700  1 -- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1748133c60 msgr2=0x7f1748136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1747400700  1 --2- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1748133c60 0x7f1748136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1747400700  1 -- 172.21.15.171:0/3340741477 >> v1:172.21.15.171:6789/0 conn(0x7f174812e3a0 legacy=0x7f174812e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1747400700  1 -- 172.21.15.171:0/3340741477 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748071b40 con 0x7f174812ee90
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f174ca00700  1 --2- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1748133c60 0x7f1748136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.708+0000 7f1746a00700  1 -- 172.21.15.171:0/3340741477 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955336497 0 0) 0x7f1748071520 con 0x7f174812e3a0
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.709+0000 7f1747400700  1 --2- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f174812ee90 0x7f1748133720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17340098f0 tx=0x7f1734009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9ea53e5e6d7ed9 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.709+0000 7f1746a00700  1 -- 172.21.15.171:0/3340741477 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734011830 con 0x7f174812ee90
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.709+0000 7f1746a00700  1 -- 172.21.15.171:0/3340741477 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734011990 con 0x7f174812ee90
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.709+0000 7f1746a00700  1 -- 172.21.15.171:0/3340741477 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734011d20 con 0x7f174812ee90
2024-03-29T09:08:27.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.709+0000 7f174ea00700  1 -- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f174812ee90 msgr2=0x7f1748133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.709+0000 7f174ea00700  1 --2- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f174812ee90 0x7f1748133720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17340098f0 tx=0x7f1734009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:27.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.710+0000 7f174ea00700  1 -- 172.21.15.171:0/3340741477 shutdown_connections
2024-03-29T09:08:27.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.710+0000 7f174ea00700  1 --2- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1748133c60 0x7f1748136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.710+0000 7f174ea00700  1 --2- 172.21.15.171:0/3340741477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f174812ee90 0x7f1748133720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.710+0000 7f174ea00700  1 -- 172.21.15.171:0/3340741477 >> 172.21.15.171:0/3340741477 conn(0x7f17480a0d70 msgr2=0x7f17480a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.710+0000 7f174ea00700  1 -- 172.21.15.171:0/3340741477 shutdown_connections
2024-03-29T09:08:27.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.710+0000 7f174ea00700  1 -- 172.21.15.171:0/3340741477 wait complete.
2024-03-29T09:08:27.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.711+0000 7f174ea00700  1  Processor -- start
2024-03-29T09:08:27.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.711+0000 7f174ea00700  1 --  start start
2024-03-29T09:08:27.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ea00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f174812e3a0 0x7f1748124f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f174812ee90 0x7f1748125690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1748133c60 0x7f1748125bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ea00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748126b50 con 0x7f1748133c60
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ea00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174812b2b0 con 0x7f174812ee90
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ea00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1748127fb0 con 0x7f174812e3a0
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1748133c60 0x7f1748125bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1748133c60 0x7f1748125bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59754/0 (socket says 172.21.15.171:59754)
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 -- 172.21.15.171:0/1117597042 learned_addr learned my addr 172.21.15.171:0/1117597042 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f1747400700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f174812ee90 0x7f1748125690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f1747e00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f174812e3a0 0x7f1748124f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 -- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f174812e3a0 msgr2=0x7f1748124f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f174812e3a0 0x7f1748124f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 -- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f174812ee90 msgr2=0x7f1748125690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f174812ee90 0x7f1748125690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f174ca00700  1 -- 172.21.15.171:0/1117597042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740009a70 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.712+0000 7f1747400700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f174812ee90 0x7f1748125690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.713+0000 7f174ca00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1748133c60 0x7f1748125bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f174000efb0 tx=0x7f174000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.713+0000 7f173fe00700  1 -- 172.21.15.171:0/1117597042 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000cc90 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.713+0000 7f173fe00700  1 -- 172.21.15.171:0/1117597042 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000f040 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.713+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1734009550 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.713+0000 7f173fe00700  1 -- 172.21.15.171:0/1117597042 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740014480 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.713+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17481275e0 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.714+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17481171d0 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.714+0000 7f173fe00700  1 -- 172.21.15.171:0/1117597042 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7f17400145e0 con 0x7f1748133c60
2024-03-29T09:08:27.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.715+0000 7f173fe00700  1 -- 172.21.15.171:0/1117597042 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2950+0+0 (secure 0 0 0) 0x7f174005d400 con 0x7f1748133c60
2024-03-29T09:08:27.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.718+0000 7f173fe00700  1 -- 172.21.15.171:0/1117597042 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f174003aec0 con 0x7f1748133c60
2024-03-29T09:08:27.883 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.884+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17480748d0 con 0x7f1728047560
2024-03-29T09:08:27.885 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.886+0000 7f173fe00700  1 -- 172.21.15.171:0/1117597042 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+39411 (unknown 2965378022 0 3410847044) 0x7f17480748d0 con 0x7f1728047560
2024-03-29T09:08:27.886 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:27.887 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.887+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 >> v1:172.21.15.171:6816/44806 conn(0x7f1728047560 legacy=0x7f1728049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.887 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.887+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1748133c60 msgr2=0x7f1748125bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:27.887 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.887+0000 7f174ea00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1748133c60 0x7f1748125bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f174000efb0 tx=0x7f174000c3a0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.887 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.888+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 shutdown_connections
2024-03-29T09:08:27.887 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.888+0000 7f174ea00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1748133c60 0x7f1748125bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.888 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.888+0000 7f174ea00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f174812e3a0 0x7f1748124f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.888 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.888+0000 7f174ea00700  1 --2- 172.21.15.171:0/1117597042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f174812ee90 0x7f1748125690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:27.888 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.888+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 >> 172.21.15.171:0/1117597042 conn(0x7f17480a0d70 msgr2=0x7f1748120580 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:27.888 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.888+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 shutdown_connections
2024-03-29T09:08:27.888 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:27.888+0000 7f174ea00700  1 -- 172.21.15.171:0/1117597042 wait complete.
2024-03-29T09:08:27.888 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:27.905 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-03-29T09:08:27.074578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188856,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298504,"statfs":{"total":386547056640,"available":385329668096,"internally_reserved":0,"allocated":483328,"data_stored":132060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556305+0000","last_change":"2024-03-29T08:54:29.570074+0000","last_active":"2024-03-29T08:54:34.556305+0000","last_peered":"2024-03-29T08:54:34.556305+0000","last_clean":"2024-03-29T08:54:34.556305+0000","last_became_active":"2024-03-29T08:54:29.569664+0000","last_became_peered":"2024-03-29T08:54:29.569664+0000","last_unstale":"2024-03-29T08:54:34.556305+0000","last_undegraded":"2024-03-29T08:54:34.556305+0000","last_fullsized":"2024-03-29T08:54:34.556305+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556502+0000","last_change":"2024-03-29T08:54:29.572552+0000","last_active":"2024-03-29T08:54:34.556502+0000","last_peered":"2024-03-29T08:54:34.556502+0000","last_clean":"2024-03-29T08:54:34.556502+0000","last_became_active":"2024-03-29T08:54:29.569749+0000","last_became_peered":"2024-03-29T08:54:29.569749+0000","last_unstale":"2024-03-29T08:54:34.556502+0000","last_undegraded":"2024-03-29T08:54:34.556502+0000","last_fullsized":"2024-03-29T08:54:34.556502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556182+0000","last_change":"2024-03-29T08:54:29.570245+0000","last_active":"2024-03-29T08:54:34.556182+0000","last_peered":"2024-03-29T08:54:34.556182+0000","last_clean":"2024-03-29T08:54:34.556182+0000","last_became_active":"2024-03-29T08:54:29.569819+0000","last_became_peered":"2024-03-29T08:54:29.569819+0000","last_unstale":"2024-03-29T08:54:34.556182+0000","last_undegraded":"2024-03-29T08:54:34.556182+0000","last_fullsized":"2024-03-29T08:54:34.556182+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556214+0000","last_change":"2024-03-29T08:54:29.549849+0000","last_active":"2024-03-29T08:54:34.556214+0000","last_peered":"2024-03-29T08:54:34.556214+0000","last_clean":"2024-03-29T08:54:34.556214+0000","last_became_active":"2024-03-29T08:54:29.548886+0000","last_became_peered":"2024-03-29T08:54:29.548886+0000","last_unstale":"2024-03-29T08:54:34.556214+0000","last_undegraded":"2024-03-29T08:54:34.556214+0000","last_fullsized":"2024-03-29T08:54:34.556214+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556491+0000","last_change":"2024-03-29T08:54:29.570495+0000","last_active":"2024-03-29T08:54:34.556491+0000","last_peered":"2024-03-29T08:54:34.556491+0000","last_clean":"2024-03-29T08:54:34.556491+0000","last_became_active":"2024-03-29T08:54:29.570203+0000","last_became_peered":"2024-03-29T08:54:29.570203+0000","last_unstale":"2024-03-29T08:54:34.556491+0000","last_undegraded":"2024-03-29T08:54:34.556491+0000","last_fullsized":"2024-03-29T08:54:34.556491+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556329+0000","last_change":"2024-03-29T08:54:29.549619+0000","last_active":"2024-03-29T08:54:34.556329+0000","last_peered":"2024-03-29T08:54:34.556329+0000","last_clean":"2024-03-29T08:54:34.556329+0000","last_became_active":"2024-03-29T08:54:29.549209+0000","last_became_peered":"2024-03-29T08:54:29.549209+0000","last_unstale":"2024-03-29T08:54:34.556329+0000","last_undegraded":"2024-03-29T08:54:34.556329+0000","last_fullsized":"2024-03-29T08:54:34.556329+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.555337+0000","last_change":"2024-03-29T08:54:29.546972+0000","last_active":"2024-03-29T08:54:34.555337+0000","last_peered":"2024-03-29T08:54:34.555337+0000","last_clean":"2024-03-29T08:54:34.555337+0000","last_became_active":"2024-03-29T08:54:29.546652+0000","last_became_peered":"2024-03-29T08:54:29.546652+0000","last_unstale":"2024-03-29T08:54:34.555337+0000","last_undegraded":"2024-03-29T08:54:34.555337+0000","last_fullsized":"2024-03-29T08:54:34.555337+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556135+0000","last_change":"2024-03-29T08:54:29.551516+0000","last_active":"2024-03-29T08:54:34.556135+0000","last_peered":"2024-03-29T08:54:34.556135+0000","last_clean":"2024-03-29T08:54:34.556135+0000","last_became_active":"2024-03-29T08:54:29.551142+0000","last_became_peered":"2024-03-29T08:54:29.551142+0000","last_unstale":"2024-03-29T08:54:34.556135+0000","last_undegraded":"2024-03-29T08:54:34.556135+0000","last_fullsized":"2024-03-29T08:54:34.556135+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-03-29T08:54:34.556497+0000","last_change":"2024-03-29T08:54:29.572921+0000","last_active":"2024-03-29T08:54:34.556497+0000","last_peered":"2024-03-29T08:54:34.556497+0000","last_clean":"2024-03-29T08:54:34.556497+0000","last_became_active":"2024-03-29T08:54:29.571269+0000","last_became_peered":"2024-03-29T08:54:29.571269+0000","last_unstale":"2024-03-29T08:54:34.556497+0000","last_undegraded":"2024-03-29T08:54:34.556497+0000","last_fullsized":"2024-03-29T08:54:34.556497+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705834,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.441,"15min":0.435},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.49099999999999999,"15min":0.498},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.50900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30499999999999999},"max":{"1min":0.48799999999999999,"5min":0.57699999999999996,"15min":0.58799999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.505,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.46600000000000003,"15min":0.47699999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.53000000000000003,"5min":0.63,"15min":0.63},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.52300000000000002,"5min":0.63800000000000001,"15min":0.66700000000000004},"last":0.46100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705834,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 29 09:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.42199999999999999,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28799999999999998},"max":{"1min":0.437,"5min":0.65800000000000003,"15min":0.69599999999999995},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.48399999999999999,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.31900000000000001},"max":{"1min":0.45500000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.36799999999999999}]},{"osd":1,"last update":"Fri Mar 29 09:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.42299999999999999,"15min":0.44400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.49099999999999999,"5min":0.63,"15min":0.65400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.44600000000000001,"5min":0.63800000000000001,"15min":0.69099999999999995},"last":0.308}]},{"osd":3,"last update":"Fri Mar 29 09:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.438,"15min":0.46200000000000002},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32200000000000001},"max":{"1min":0.5,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47299999999999998,"15min":0.48899999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.46600000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.34999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705834,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.25800000000000001},"max":{"1min":0.46100000000000002,"5min":0.67300000000000004,"15min":0.68600000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.505,"15min":0.51300000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.48399999999999999,"5min":0.68500000000000005,"15min":0.71499999999999997},"last":0.86199999999999999}]},{"osd":2,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.435,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.48799999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.443,"15min":0.45600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.45600000000000002,"5min":0.65100000000000002,"15min":0.72799999999999998},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Mar 29 09:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.48399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.46800000000000003,"5min":0.66800000000000004,"15min":0.67700000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.48099999999999998,"15min":0.495},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.45500000000000002,"5min":0.65200000000000002,"15min":0.77300000000000002},"last":0.92700000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705835,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297216,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074624,"statfs":{"total":96636764160,"available":96332414976,"internally_reserved":0,"allocated":122880,"data_stored":33837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 29 09:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.439,"15min":0.44500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.498,"5min":0.628,"15min":0.628},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.45000000000000001,"15min":0.45500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.56100000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Mar 29 09:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.54200000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35099999999999998},"max":{"1min":0.51200000000000001,"5min":0.64700000000000002,"15min":0.75600000000000001},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Mar 29 09:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.505,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.58699999999999997,"5min":0.70499999999999996,"15min":0.70599999999999996},"last":0.497},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.53000000000000003,"5min":0.65400000000000003,"15min":0.66500000000000004},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:27.906 INFO:tasks.ceph.ceph_manager.ceph:clean!
2024-03-29T09:08:27.906 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy...
2024-03-29T09:08:27.907 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy
2024-03-29T09:08:27.907 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json
2024-03-29T09:08:28.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.105+0000 7f992d000700  1  Processor -- start
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.105+0000 7f992d000700  1 --  start start
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f992d000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f992812ee90 0x7f9928133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f992d000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9928133c60 0x7f9928136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f992d000700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9928071520 con 0x7f992812e3a0
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f992d000700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9928070d80 con 0x7f992812ee90
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f992d000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99280722b0 con 0x7f9928133c60
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f9925400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f992812ee90 0x7f9928133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f9925400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f992812ee90 0x7f9928133720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59758/0 (socket says 172.21.15.171:59758)
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f9925e00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f992812e3a0 0x7f992812e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:50774/0 (socket says 172.21.15.171:50774)
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f9926800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9928133c60 0x7f9928136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.106+0000 7f9925400700  1 -- 172.21.15.171:0/3052614280 learned_addr learned my addr 172.21.15.171:0/3052614280 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9925400700  1 -- 172.21.15.171:0/3052614280 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9928133c60 msgr2=0x7f9928136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9925400700  1 --2- 172.21.15.171:0/3052614280 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9928133c60 0x7f9928136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9925400700  1 -- 172.21.15.171:0/3052614280 >> v1:172.21.15.171:6789/0 conn(0x7f992812e3a0 legacy=0x7f992812e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9925400700  1 -- 172.21.15.171:0/3052614280 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9928071b40 con 0x7f992812ee90
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9925400700  1 --2- 172.21.15.171:0/3052614280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f9928133720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f99140098f0 tx=0x7f9914009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bb1b7275228df2 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9924a00700  1 -- 172.21.15.171:0/3052614280 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914011830 con 0x7f992812ee90
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9924a00700  1 -- 172.21.15.171:0/3052614280 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914011990 con 0x7f992812ee90
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.107+0000 7f9924a00700  1 -- 172.21.15.171:0/3052614280 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914011d20 con 0x7f992812ee90
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 -- 172.21.15.171:0/3052614280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 msgr2=0x7f9928133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 --2- 172.21.15.171:0/3052614280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f9928133720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f99140098f0 tx=0x7f9914009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 -- 172.21.15.171:0/3052614280 shutdown_connections
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 --2- 172.21.15.171:0/3052614280 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9928133c60 0x7f9928136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 --2- 172.21.15.171:0/3052614280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f9928133720 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 -- 172.21.15.171:0/3052614280 >> 172.21.15.171:0/3052614280 conn(0x7f99280a0d70 msgr2=0x7f99280a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:28.110 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 -- 172.21.15.171:0/3052614280 shutdown_connections
2024-03-29T09:08:28.110 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.108+0000 7f992d000700  1 -- 172.21.15.171:0/3052614280 wait complete.
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.110+0000 7f992d000700  1  Processor -- start
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.110+0000 7f992d000700  1 --  start start
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f992d000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f992812e3a0 0x7f992812f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f992d000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f992812f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f992d000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9928133c60 0x7f992812fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f992d000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99281323b0 con 0x7f992812ee90
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f992d000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9928130cd0 con 0x7f9928133c60
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f992d000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9928130890 con 0x7f992812e3a0
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f9925e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f992812e3a0 0x7f992812f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f9926800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9928133c60 0x7f992812fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f9926800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9928133c60 0x7f992812fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55874/0 (socket says 172.21.15.171:55874)
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f9926800700  1 -- 172.21.15.171:0/140335338 learned_addr learned my addr 172.21.15.171:0/140335338 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.111+0000 7f9925400700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f992812f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9926800700  1 -- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f992812e3a0 msgr2=0x7f992812f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9926800700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f992812e3a0 0x7f992812f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9926800700  1 -- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 msgr2=0x7f992812f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9926800700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f992812f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9926800700  1 -- 172.21.15.171:0/140335338 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009550 con 0x7f9928133c60
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9925400700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f992812f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9925e00700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f992812e3a0 0x7f992812f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f9926800700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9928133c60 0x7f992812fec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9920009e30 tx=0x7f992000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f991e000700  1 -- 172.21.15.171:0/140335338 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920009ca0 con 0x7f9928133c60
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f991e000700  1 -- 172.21.15.171:0/140335338 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992000f040 con 0x7f9928133c60
2024-03-29T09:08:28.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9928135f60 con 0x7f9928133c60
2024-03-29T09:08:28.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.112+0000 7f991e000700  1 -- 172.21.15.171:0/140335338 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920014480 con 0x7f9928133c60
2024-03-29T09:08:28.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.113+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9928132f80 con 0x7f9928133c60
2024-03-29T09:08:28.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.114+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99281171d0 con 0x7f9928133c60
2024-03-29T09:08:28.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.114+0000 7f991e000700  1 -- 172.21.15.171:0/140335338 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7f99200145e0 con 0x7f9928133c60
2024-03-29T09:08:28.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.115+0000 7f991e000700  1 -- 172.21.15.171:0/140335338 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f992005d410 con 0x7f9928133c60
2024-03-29T09:08:28.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.119+0000 7f991e000700  1 -- 172.21.15.171:0/140335338 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f992003aec0 con 0x7f9928133c60
2024-03-29T09:08:28.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.353+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f992812a4a0 con 0x7f9928133c60
2024-03-29T09:08:28.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.353+0000 7f991e000700  1 -- 172.21.15.171:0/140335338 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0  v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9920018070 con 0x7f9928133c60
2024-03-29T09:08:28.353 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:28.353 INFO:teuthology.orchestra.run.smithi171.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]}
2024-03-29T09:08:28.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 >> v1:172.21.15.171:6816/44806 conn(0x7f9908047560 legacy=0x7f9908049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9928133c60 msgr2=0x7f992812fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9928133c60 0x7f992812fec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9920009e30 tx=0x7f992000c3a0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 shutdown_connections
2024-03-29T09:08:28.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9928133c60 0x7f992812fec0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f992812e3a0 0x7f992812f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 --2- 172.21.15.171:0/140335338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f992812ee90 0x7f992812f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 >> 172.21.15.171:0/140335338 conn(0x7f99280a0d70 msgr2=0x7f992812d300 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:28.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.355+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 shutdown_connections
2024-03-29T09:08:28.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.356+0000 7f992d000700  1 -- 172.21.15.171:0/140335338 wait complete.
2024-03-29T09:08:28.377 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done
2024-03-29T09:08:28.377 INFO:teuthology.run_tasks:Running task ceph.restart...
2024-03-29T09:08:28.389 DEBUG:tasks.ceph.osd.0:waiting for process to exit
2024-03-29T09:08:28.389 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:28.429 INFO:tasks.ceph.osd.0:Stopped
2024-03-29T09:08:28.429 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0
2024-03-29T09:08:28.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.664+0000 7fa5ae800700  1  Processor -- start
2024-03-29T09:08:28.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.664+0000 7fa5ae800700  1 --  start start
2024-03-29T09:08:28.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.664+0000 7fa5ae800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a812b500 0x7fa5a812b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.664+0000 7fa5ae800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a8133410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.664+0000 7fa5ae800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a8070440 con 0x7fa5a806e420
2024-03-29T09:08:28.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.664+0000 7fa5ae800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8072680 con 0x7fa5a812b500
2024-03-29T09:08:28.664 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.664+0000 7fa5ae800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8098a80 con 0x7fa5a806ef70
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a812b500 0x7fa5a812b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a8133410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a6a00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fa5a806e420 0x7fa5a806e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:50784/0 (socket says 172.21.15.171:50784)
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a6a00700  1 -- 172.21.15.171:0/3497593179 learned_addr learned my addr 172.21.15.171:0/3497593179 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a6000700  1 -- 172.21.15.171:0/3497593179 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409988665 0 0) 0x7fa5a8070440 con 0x7fa5a806e420
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a6000700  1 -- 172.21.15.171:0/3497593179 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa58c0057c0 con 0x7fa5a806e420
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7400700  1 -- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 msgr2=0x7fa5a8133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7400700  1 --2- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a8133410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7400700  1 -- 172.21.15.171:0/3497593179 >> v1:172.21.15.171:6789/0 conn(0x7fa5a806e420 legacy=0x7fa5a806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7400700  1 -- 172.21.15.171:0/3497593179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8070b20 con 0x7fa5a812b500
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7e00700  1 --2- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a8133410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.665+0000 7fa5a7400700  1 --2- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a812b500 0x7fa5a812b8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa598009870 tx=0x7fa598009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47bc55341c42f15 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5a6000700  1 -- 172.21.15.171:0/3497593179 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011830 con 0x7fa5a812b500
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5a6000700  1 -- 172.21.15.171:0/3497593179 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa598011990 con 0x7fa5a812b500
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5a6000700  1 -- 172.21.15.171:0/3497593179 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011d20 con 0x7fa5a812b500
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 -- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a812b500 msgr2=0x7fa5a812b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 --2- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a812b500 0x7fa5a812b8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa598009870 tx=0x7fa598009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 -- 172.21.15.171:0/3497593179 shutdown_connections
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 --2- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a8133410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 --2- 172.21.15.171:0/3497593179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a812b500 0x7fa5a812b8e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 -- 172.21.15.171:0/3497593179 >> 172.21.15.171:0/3497593179 conn(0x7fa5a80978d0 msgr2=0x7fa5a8097ce0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 -- 172.21.15.171:0/3497593179 shutdown_connections
2024-03-29T09:08:28.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.666+0000 7fa5ae800700  1 -- 172.21.15.171:0/3497593179 wait complete.
2024-03-29T09:08:28.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.668+0000 7fa5ae800700  1  Processor -- start
2024-03-29T09:08:28.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.668+0000 7fa5ae800700  1 --  start start
2024-03-29T09:08:28.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5ae800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a806e420 0x7fa5a81c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5ae800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a81c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5ae800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a812b500 0x7fa5a8125b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5ae800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8133480 con 0x7fa5a812b500
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5ae800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81282d0 con 0x7fa5a806e420
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5ae800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81286a0 con 0x7fa5a806ef70
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5a7400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a806e420 0x7fa5a81c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.669+0000 7fa5a7400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a806e420 0x7fa5a81c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55916/0 (socket says 172.21.15.171:55916)
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7400700  1 -- 172.21.15.171:0/1269948164 learned_addr learned my addr 172.21.15.171:0/1269948164 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a6a00700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a81c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7e00700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a812b500 0x7fa5a8125b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7400700  1 -- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 msgr2=0x7fa5a81c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7400700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a81c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7400700  1 -- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a812b500 msgr2=0x7fa5a8125b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7400700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a812b500 0x7fa5a8125b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:28.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7400700  1 -- 172.21.15.171:0/1269948164 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0009a70 con 0x7fa5a806e420
2024-03-29T09:08:28.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5a7400700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a806e420 0x7fa5a81c3360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa598009bc0 tx=0x7fa598004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:28.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa59f400700  1 -- 172.21.15.171:0/1269948164 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598004450 con 0x7fa5a806e420
2024-03-29T09:08:28.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa59f400700  1 -- 172.21.15.171:0/1269948164 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5980045b0 con 0x7fa5a806e420
2024-03-29T09:08:28.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa59f400700  1 -- 172.21.15.171:0/1269948164 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980038c0 con 0x7fa5a806e420
2024-03-29T09:08:28.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.670+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5980094a0 con 0x7fa5a806e420
2024-03-29T09:08:28.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.671+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a81c3de0 con 0x7fa5a806e420
2024-03-29T09:08:28.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.672+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a8127dd0 con 0x7fa5a806e420
2024-03-29T09:08:28.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.672+0000 7fa59f400700  1 -- 172.21.15.171:0/1269948164 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7fa598003a20 con 0x7fa5a806e420
2024-03-29T09:08:28.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.672+0000 7fa59f400700  1 -- 172.21.15.171:0/1269948164 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fa59805d340 con 0x7fa5a806e420
2024-03-29T09:08:28.675 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.676+0000 7fa59f400700  1 -- 172.21.15.171:0/1269948164 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fa59805c420 con 0x7fa5a806e420
2024-03-29T09:08:28.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:28.859+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7fa5a80623e0 con 0x7fa5a806e420
2024-03-29T09:08:28.859 INFO:tasks.ceph.mon.a.smithi171.stderr:2024-03-29T09:08:28.860+0000 7f0240600700 -1 mon.a@0(leader).osd e16 definitely_dead 0
2024-03-29T09:08:29.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.102+0000 7fa59f400700  1 -- 172.21.15.171:0/1269948164 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0.  v17) v1 ==== 89+0+0 (secure 0 0 0) 0x7fa598028020 con 0x7fa5a806e420
2024-03-29T09:08:29.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 >> v1:172.21.15.171:6816/44806 conn(0x7fa588047560 legacy=0x7fa588049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:29.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a806e420 msgr2=0x7fa5a81c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:29.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a806e420 0x7fa5a81c3360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa598009bc0 tx=0x7fa598004750 comp rx=0 tx=0).stop
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 shutdown_connections
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a812b500 0x7fa5a8125b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a806e420 0x7fa5a81c3360 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 --2- 172.21.15.171:0/1269948164 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa5a806ef70 0x7fa5a81c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 >> 172.21.15.171:0/1269948164 conn(0x7fa5a80978d0 msgr2=0x7fa5a806c1b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 shutdown_connections
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.105+0000 7fa5ae800700  1 -- 172.21.15.171:0/1269948164 wait complete.
2024-03-29T09:08:29.105 INFO:teuthology.orchestra.run.smithi171.stderr:marked down osd.0.
2024-03-29T09:08:29.122 INFO:tasks.ceph.osd.0:Restarting daemon
2024-03-29T09:08:29.123 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0
2024-03-29T09:08:29.126 INFO:tasks.ceph.osd.0:Started
2024-03-29T09:08:29.127 DEBUG:tasks.ceph.osd.1:waiting for process to exit
2024-03-29T09:08:29.127 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:29.172 INFO:tasks.ceph.osd.1:Stopped
2024-03-29T09:08:29.172 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1
2024-03-29T09:08:29.367 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.368+0000 7f9f99600700  1  Processor -- start
2024-03-29T09:08:29.367 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.368+0000 7f9f99600700  1 --  start start
2024-03-29T09:08:29.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f99600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412e3a0 0x7f9f9412e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:29.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f99600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9412ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:29.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f99600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940715b0 con 0x7f9f9412b360
2024-03-29T09:08:29.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f99600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94070d80 con 0x7f9f9412e3a0
2024-03-29T09:08:29.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f99600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940722b0 con 0x7f9f9412ecc0
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412e3a0 0x7f9f9412e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412e3a0 0x7f9f9412e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55938/0 (socket says 172.21.15.171:55938)
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92a00700  1 -- 172.21.15.171:0/731706950 learned_addr learned my addr 172.21.15.171:0/731706950 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9412ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92a00700  1 -- 172.21.15.171:0/731706950 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 msgr2=0x7f9f9412ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92a00700  1 --2- 172.21.15.171:0/731706950 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9412ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92a00700  1 -- 172.21.15.171:0/731706950 >> v1:172.21.15.171:6789/0 conn(0x7f9f9412b360 legacy=0x7f9f94135730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f92a00700  1 -- 172.21.15.171:0/731706950 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94071b40 con 0x7f9f9412e3a0
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.369+0000 7f9f91600700  1 -- 172.21.15.171:0/731706950 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772402866 0 0) 0x7f9f940715b0 con 0x7f9f9412b360
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f92a00700  1 --2- 172.21.15.171:0/731706950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412e3a0 0x7f9f9412e780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009920 tx=0x7f9f84009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=751b1aa6b87ae9a4 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f91600700  1 -- 172.21.15.171:0/731706950 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011830 con 0x7f9f9412e3a0
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f91600700  1 -- 172.21.15.171:0/731706950 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84011990 con 0x7f9f9412e3a0
2024-03-29T09:08:29.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f91600700  1 -- 172.21.15.171:0/731706950 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011d20 con 0x7f9f9412e3a0
2024-03-29T09:08:29.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f99600700  1 -- 172.21.15.171:0/731706950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412e3a0 msgr2=0x7f9f9412e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:29.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f99600700  1 --2- 172.21.15.171:0/731706950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412e3a0 0x7f9f9412e780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009920 tx=0x7f9f84009c30 comp rx=0 tx=0).stop
2024-03-29T09:08:29.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f99600700  1 -- 172.21.15.171:0/731706950 shutdown_connections
2024-03-29T09:08:29.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f99600700  1 --2- 172.21.15.171:0/731706950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412e3a0 0x7f9f9412e780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f99600700  1 --2- 172.21.15.171:0/731706950 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9412ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.370+0000 7f9f99600700  1 -- 172.21.15.171:0/731706950 >> 172.21.15.171:0/731706950 conn(0x7f9f940a0d70 msgr2=0x7f9f940a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:29.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.371+0000 7f9f99600700  1 -- 172.21.15.171:0/731706950 shutdown_connections
2024-03-29T09:08:29.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.371+0000 7f9f99600700  1 -- 172.21.15.171:0/731706950 wait complete.
2024-03-29T09:08:29.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.372+0000 7f9f99600700  1  Processor -- start
2024-03-29T09:08:29.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.373+0000 7f9f99600700  1 --  start start
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.373+0000 7f9f99600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412b360 0x7f9f941c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.373+0000 7f9f99600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9412e3a0 0x7f9f941c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.373+0000 7f9f99600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9411a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.373+0000 7f9f99600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9412abc0 con 0x7f9f9412e3a0
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.373+0000 7f9f99600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9411d4b0 con 0x7f9f9412b360
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.373+0000 7f9f99600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9411d710 con 0x7f9f9412ecc0
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412b360 0x7f9f941c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412b360 0x7f9f941c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55950/0 (socket says 172.21.15.171:55950)
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 -- 172.21.15.171:0/276210549 learned_addr learned my addr 172.21.15.171:0/276210549 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92000700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9412e3a0 0x7f9f941c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f93400700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9411a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 -- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 msgr2=0x7f9f9411a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:29.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9411a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 -- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9412e3a0 msgr2=0x7f9f941c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:29.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9412e3a0 0x7f9f941c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:29.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 -- 172.21.15.171:0/276210549 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009550 con 0x7f9f9412b360
2024-03-29T09:08:29.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.374+0000 7f9f92a00700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412b360 0x7f9f941c34b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000c00 tx=0x7f9f84004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.375+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84004450 con 0x7f9f9412b360
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.375+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f840045b0 con 0x7f9f9412b360
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.375+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840038a0 con 0x7f9f9412b360
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.375+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9411c360 con 0x7f9f9412b360
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.375+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9411a5c0 con 0x7f9f9412b360
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.376+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f941171d0 con 0x7f9f9412b360
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.376+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 8) v1 ==== 55148+0+0 (secure 0 0 0) 0x7f9f84003a00 con 0x7f9f9412b360
2024-03-29T09:08:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.377+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f9f84021030 con 0x7f9f9412b360
2024-03-29T09:08:29.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.381+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f9f84028580 con 0x7f9f9412b360
2024-03-29T09:08:29.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:29.560+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f9f9412ea80 con 0x7f9f9412b360
2024-03-29T09:08:29.560 INFO:tasks.ceph.mon.a.smithi171.stderr:2024-03-29T09:08:29.561+0000 7f0240600700 -1 mon.a@0(leader).osd e17 definitely_dead 0
2024-03-29T09:08:29.787 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T09:08:29.788+0000 7ffb0abbc640 -1 Falling back to public interface
2024-03-29T09:08:30.110 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.110+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f9f84028950 con 0x7f9f9412b360
2024-03-29T09:08:30.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.112+0000 7f9f8aa00700  1 -- 172.21.15.171:0/276210549 <== mon.1 v2:172.21.15.171:3301/0 8 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1.  v18) v1 ==== 89+0+0 (secure 0 0 0) 0x7f9f84013840 con 0x7f9f9412b360
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 >> v1:172.21.15.171:6816/44806 conn(0x7f9f74047560 legacy=0x7f9f74049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412b360 msgr2=0x7f9f941c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412b360 0x7f9f941c34b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000c00 tx=0x7f9f84004750 comp rx=0 tx=0).stop
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 shutdown_connections
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9f9412ecc0 0x7f9f9411a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9412b360 0x7f9f941c34b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 --2- 172.21.15.171:0/276210549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9412e3a0 0x7f9f941c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 >> 172.21.15.171:0/276210549 conn(0x7f9f940a0d70 msgr2=0x7f9f9406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.114+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 shutdown_connections
2024-03-29T09:08:30.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.115+0000 7f9f99600700  1 -- 172.21.15.171:0/276210549 wait complete.
2024-03-29T09:08:30.115 INFO:teuthology.orchestra.run.smithi171.stderr:marked down osd.1.
2024-03-29T09:08:30.133 INFO:tasks.ceph.osd.1:Restarting daemon
2024-03-29T09:08:30.133 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1
2024-03-29T09:08:30.137 INFO:tasks.ceph.osd.1:Started
2024-03-29T09:08:30.137 DEBUG:tasks.ceph.osd.2:waiting for process to exit
2024-03-29T09:08:30.137 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:30.173 INFO:tasks.ceph.osd.2:Stopped
2024-03-29T09:08:30.173 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2
2024-03-29T09:08:30.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.410+0000 7f2f5e000700  1  Processor -- start
2024-03-29T09:08:30.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f5e000700  1 --  start start
2024-03-29T09:08:30.412 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f5e000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f5812e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f5e000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f2f5812ecc0 0x7f2f5812ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f5e000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812b360 0x7f2f5812b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f5e000700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f58071520 con 0x7f2f5812ecc0
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f5e000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58070d80 con 0x7f2f5812e3a0
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f5e000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580722b0 con 0x7f2f5812b360
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.411+0000 7f2f57400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f5812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f5812e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55958/0 (socket says 172.21.15.171:55958)
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f56a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f2f5812ecc0 0x7f2f5812ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812b360 0x7f2f5812b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 -- 172.21.15.171:0/3095092183 learned_addr learned my addr 172.21.15.171:0/3095092183 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 -- 172.21.15.171:0/3095092183 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812b360 msgr2=0x7f2f5812b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 --2- 172.21.15.171:0/3095092183 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812b360 0x7f2f5812b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.413 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 -- 172.21.15.171:0/3095092183 >> v2:172.21.15.171:3300/0 conn(0x7f2f5812ecc0 msgr2=0x7f2f5812ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 --2- 172.21.15.171:0/3095092183 >> v2:172.21.15.171:3300/0 conn(0x7f2f5812ecc0 0x7f2f5812ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 -- 172.21.15.171:0/3095092183 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58071b40 con 0x7f2f5812e3a0
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f57400700  1 --2- 172.21.15.171:0/3095092183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f5812e780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f480098f0 tx=0x7f2f48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f78d4fa6dec2f08 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.412+0000 7f2f56000700  1 -- 172.21.15.171:0/3095092183 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48011830 con 0x7f2f5812e3a0
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f56000700  1 -- 172.21.15.171:0/3095092183 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48011990 con 0x7f2f5812e3a0
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f56000700  1 -- 172.21.15.171:0/3095092183 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48011d20 con 0x7f2f5812e3a0
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 -- 172.21.15.171:0/3095092183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 msgr2=0x7f2f5812e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3095092183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f5812e780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f480098f0 tx=0x7f2f48009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 -- 172.21.15.171:0/3095092183 shutdown_connections
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3095092183 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812b360 0x7f2f5812b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3095092183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f5812e780 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3095092183 >> v2:172.21.15.171:3300/0 conn(0x7f2f5812ecc0 0x7f2f5812ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 -- 172.21.15.171:0/3095092183 >> 172.21.15.171:0/3095092183 conn(0x7f2f580a0d70 msgr2=0x7f2f580a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:30.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 -- 172.21.15.171:0/3095092183 shutdown_connections
2024-03-29T09:08:30.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.413+0000 7f2f5e000700  1 -- 172.21.15.171:0/3095092183 wait complete.
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1  Processor -- start
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1 --  start start
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f5812b360 0x7f2f581bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f581c00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812ecc0 0x7f2f581c0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58134ba0 con 0x7f2f5812b360
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58133270 con 0x7f2f5812e3a0
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.415+0000 7f2f5e000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f581343c0 con 0x7f2f5812ecc0
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812ecc0 0x7f2f581c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:30.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f5812b360 0x7f2f581bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f56a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f581c00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f5812b360 0x7f2f581bfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59854/0 (socket says 172.21.15.171:59854)
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812ecc0 0x7f2f581c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45856/0 (socket says 172.21.15.171:45856)
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 -- 172.21.15.171:0/3177638549 learned_addr learned my addr 172.21.15.171:0/3177638549 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 -- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812ecc0 msgr2=0x7f2f581c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812ecc0 0x7f2f581c0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 -- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 msgr2=0x7f2f581c00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f581c00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 -- 172.21.15.171:0/3177638549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48009550 con 0x7f2f5812b360
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f56a00700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f581c00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.416+0000 7f2f57400700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f5812b360 0x7f2f581bfb90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f48000c00 tx=0x7f2f48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.417+0000 7f2f4f400700  1 -- 172.21.15.171:0/3177638549 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48004240 con 0x7f2f5812b360
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.417+0000 7f2f4f400700  1 -- 172.21.15.171:0/3177638549 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4801f070 con 0x7f2f5812b360
2024-03-29T09:08:30.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.417+0000 7f2f4f400700  1 -- 172.21.15.171:0/3177638549 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480045e0 con 0x7f2f5812b360
2024-03-29T09:08:30.419 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.417+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f58134640 con 0x7f2f5812b360
2024-03-29T09:08:30.419 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.417+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f581c3270 con 0x7f2f5812b360
2024-03-29T09:08:30.419 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.418+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58133fe0 con 0x7f2f5812b360
2024-03-29T09:08:30.419 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.418+0000 7f2f4f400700  1 -- 172.21.15.171:0/3177638549 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f2f48021030 con 0x7f2f5812b360
2024-03-29T09:08:30.419 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.419+0000 7f2f4f400700  1 -- 172.21.15.171:0/3177638549 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f2f4805d980 con 0x7f2f5812b360
2024-03-29T09:08:30.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.423+0000 7f2f4f400700  1 -- 172.21.15.171:0/3177638549 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f2f48025b60 con 0x7f2f5812b360
2024-03-29T09:08:30.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:30.603+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f2f581171d0 con 0x7f2f5812b360
2024-03-29T09:08:30.603 INFO:tasks.ceph.mon.a.smithi171.stderr:2024-03-29T09:08:30.603+0000 7f0240600700 -1 mon.a@0(leader).osd e18 definitely_dead 0
2024-03-29T09:08:30.792 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T09:08:30.793+0000 7f0c9dbd6640 -1 Falling back to public interface
2024-03-29T09:08:31.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.112+0000 7f2f4f400700  1 -- 172.21.15.171:0/3177638549 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2.  v19) v1 ==== 89+0+0 (secure 0 0 0) 0x7f2f48015020 con 0x7f2f5812b360
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 >> v1:172.21.15.171:6816/44806 conn(0x7f2f380475f0 legacy=0x7f2f38049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f5812b360 msgr2=0x7f2f581bfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f5812b360 0x7f2f581bfb90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f48000c00 tx=0x7f2f48004750 comp rx=0 tx=0).stop
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 shutdown_connections
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2f5812ecc0 0x7f2f581c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f5812b360 0x7f2f581bfb90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 --2- 172.21.15.171:0/3177638549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f5812e3a0 0x7f2f581c00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 >> 172.21.15.171:0/3177638549 conn(0x7f2f580a0d70 msgr2=0x7f2f5806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 shutdown_connections
2024-03-29T09:08:31.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.115+0000 7f2f5e000700  1 -- 172.21.15.171:0/3177638549 wait complete.
2024-03-29T09:08:31.116 INFO:teuthology.orchestra.run.smithi171.stderr:marked down osd.2.
2024-03-29T09:08:31.133 INFO:tasks.ceph.osd.2:Restarting daemon
2024-03-29T09:08:31.134 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2
2024-03-29T09:08:31.138 INFO:tasks.ceph.osd.2:Started
2024-03-29T09:08:31.138 DEBUG:tasks.ceph.osd.3:waiting for process to exit
2024-03-29T09:08:31.138 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:08:31.185 INFO:tasks.ceph.osd.3:Stopped
2024-03-29T09:08:31.186 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3
2024-03-29T09:08:31.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.383+0000 7fa08c200700  1  Processor -- start
2024-03-29T09:08:31.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.383+0000 7fa08c200700  1 --  start start
2024-03-29T09:08:31.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08c200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa08406d6c0 0x7fa08406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:31.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08c200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fa08406dfe0 0x7fa08406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:31.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08c200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa0841329e0 0x7fa084134dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:31.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08c200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08406f9c0 con 0x7fa08406dfe0
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08c200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08406f420 con 0x7fa08406d6c0
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08c200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa08406fbf0 con 0x7fa0841329e0
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fa08406dfe0 0x7fa08406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08a200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa0841329e0 0x7fa084134dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa089800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa08406d6c0 0x7fa08406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fa08406dfe0 0x7fa08406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59862/0 (socket says 172.21.15.171:59862)
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 -- 172.21.15.171:0/2491776507 learned_addr learned my addr 172.21.15.171:0/2491776507 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 -- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa0841329e0 msgr2=0x7fa084134dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa0841329e0 0x7fa084134dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 -- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa08406d6c0 msgr2=0x7fa08406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa08406d6c0 0x7fa08406daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa088e00700  1 -- 172.21.15.171:0/2491776507 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084135310 con 0x7fa08406dfe0
2024-03-29T09:08:31.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.384+0000 7fa08a200700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa0841329e0 0x7fa084134dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:31.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.385+0000 7fa088e00700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 0x7fa08406e3e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0700098f0 tx=0x7fa070009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc19e65ae0868d9 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:31.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.385+0000 7fa083e00700  1 -- 172.21.15.171:0/2491776507 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070011830 con 0x7fa08406dfe0
2024-03-29T09:08:31.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.385+0000 7fa083e00700  1 -- 172.21.15.171:0/2491776507 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070011990 con 0x7fa08406dfe0
2024-03-29T09:08:31.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.385+0000 7fa083e00700  1 -- 172.21.15.171:0/2491776507 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070011d20 con 0x7fa08406dfe0
2024-03-29T09:08:31.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.385+0000 7fa08c200700  1 -- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 msgr2=0x7fa08406e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.385+0000 7fa08c200700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 0x7fa08406e3e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0700098f0 tx=0x7fa070009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.386+0000 7fa08c200700  1 -- 172.21.15.171:0/2491776507 shutdown_connections
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.386+0000 7fa08c200700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa0841329e0 0x7fa084134dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.386+0000 7fa08c200700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa08406d6c0 0x7fa08406daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.386+0000 7fa08c200700  1 --2- 172.21.15.171:0/2491776507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 0x7fa08406e3e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.386+0000 7fa08c200700  1 -- 172.21.15.171:0/2491776507 >> 172.21.15.171:0/2491776507 conn(0x7fa0840994a0 msgr2=0x7fa0840998b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.386+0000 7fa08c200700  1 -- 172.21.15.171:0/2491776507 shutdown_connections
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.386+0000 7fa08c200700  1 -- 172.21.15.171:0/2491776507 wait complete.
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.387+0000 7fa08c200700  1  Processor -- start
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.387+0000 7fa08c200700  1 --  start start
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa08c200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa08406d6c0 0x7fa0841bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:31.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa08c200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 0x7fa0841c00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa08c200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0841329e0 0x7fa0841c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa08c200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084094750 con 0x7fa08406dfe0
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa08c200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa084094c90 con 0x7fa0841329e0
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa08c200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa084094490 con 0x7fa08406d6c0
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa089800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa08406d6c0 0x7fa0841bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa089800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa08406d6c0 0x7fa0841bfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45894/0 (socket says 172.21.15.171:45894)
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa089800700  1 -- 172.21.15.171:0/4028931736 learned_addr learned my addr 172.21.15.171:0/4028931736 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa088e00700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 0x7fa0841c00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa08a200700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0841329e0 0x7fa0841c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa089800700  1 -- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0841329e0 msgr2=0x7fa0841c0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.388+0000 7fa089800700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0841329e0 0x7fa0841c0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa089800700  1 -- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 msgr2=0x7fa0841c00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:31.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa089800700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 0x7fa0841c00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:31.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa089800700  1 -- 172.21.15.171:0/4028931736 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c009a70 con 0x7fa08406d6c0
2024-03-29T09:08:31.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa089800700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa08406d6c0 0x7fa0841bfba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa07800e9e0 tx=0x7fa07800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:31.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa081600700  1 -- 172.21.15.171:0/4028931736 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078009710 con 0x7fa08406d6c0
2024-03-29T09:08:31.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa081600700  1 -- 172.21.15.171:0/4028931736 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07800ee80 con 0x7fa08406d6c0
2024-03-29T09:08:31.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa081600700  1 -- 172.21.15.171:0/4028931736 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800ca50 con 0x7fa08406d6c0
2024-03-29T09:08:31.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa070009550 con 0x7fa08406d6c0
2024-03-29T09:08:31.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.389+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0840950f0 con 0x7fa08406d6c0
2024-03-29T09:08:31.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.390+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0840623e0 con 0x7fa08406d6c0
2024-03-29T09:08:31.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.391+0000 7fa081600700  1 -- 172.21.15.171:0/4028931736 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fa07800cbb0 con 0x7fa08406d6c0
2024-03-29T09:08:31.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.391+0000 7fa081600700  1 -- 172.21.15.171:0/4028931736 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fa07805c7d0 con 0x7fa08406d6c0
2024-03-29T09:08:31.395 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.396+0000 7fa081600700  1 -- 172.21.15.171:0/4028931736 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fa07803a480 con 0x7fa08406d6c0
2024-03-29T09:08:31.578 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:31.579+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fa084070ae0 con 0x7fa08406d6c0
2024-03-29T09:08:31.579 INFO:tasks.ceph.mon.a.smithi171.stderr:2024-03-29T09:08:31.580+0000 7f0240600700 -1 mon.a@0(leader).osd e19 definitely_dead 0
2024-03-29T09:08:31.798 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T09:08:31.799+0000 7f4942cbf640 -1 Falling back to public interface
2024-03-29T09:08:32.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.120+0000 7fa081600700  1 -- 172.21.15.171:0/4028931736 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3.  v20) v1 ==== 89+0+0 (secure 0 0 0) 0x7fa078017030 con 0x7fa08406d6c0
2024-03-29T09:08:32.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.122+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 >> v1:172.21.15.171:6816/44806 conn(0x7fa0640475f0 legacy=0x7fa064049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.122+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa08406d6c0 msgr2=0x7fa0841bfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.122+0000 7fa08c200700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa08406d6c0 0x7fa0841bfba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa07800e9e0 tx=0x7fa07800ecf0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.122+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 shutdown_connections
2024-03-29T09:08:32.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.122+0000 7fa08c200700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0841329e0 0x7fa0841c0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.122+0000 7fa08c200700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fa08406d6c0 0x7fa0841bfba0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.122+0000 7fa08c200700  1 --2- 172.21.15.171:0/4028931736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa08406dfe0 0x7fa0841c00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.123+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 >> 172.21.15.171:0/4028931736 conn(0x7fa0840994a0 msgr2=0x7fa08409c750 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:32.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.123+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 shutdown_connections
2024-03-29T09:08:32.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.123+0000 7fa08c200700  1 -- 172.21.15.171:0/4028931736 wait complete.
2024-03-29T09:08:32.123 INFO:teuthology.orchestra.run.smithi171.stderr:marked down osd.3.
2024-03-29T09:08:32.141 INFO:tasks.ceph.osd.3:Restarting daemon
2024-03-29T09:08:32.141 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3
2024-03-29T09:08:32.145 INFO:tasks.ceph.osd.3:Started
2024-03-29T09:08:32.145 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up
2024-03-29T09:08:32.145 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:32.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.344+0000 7f8732000700  1  Processor -- start
2024-03-29T09:08:32.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.345+0000 7f8732000700  1 --  start start
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.345+0000 7f8732000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c12ee90 0x7f872c133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.345+0000 7f8732000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f872c133c60 0x7f872c136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.345+0000 7f8732000700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c071520 con 0x7f872c12e3a0
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.345+0000 7f8732000700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c070d80 con 0x7f872c133c60
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.345+0000 7f8732000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0722b0 con 0x7f872c12ee90
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.345+0000 7f872aa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c12ee90 0x7f872c133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872be00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f872c133c60 0x7f872c136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872b400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f872c12e3a0 0x7f872c12e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:50818/0 (socket says 172.21.15.171:50818)
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872b400700  1 -- 172.21.15.171:0/2661142318 learned_addr learned my addr 172.21.15.171:0/2661142318 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872aa00700  1 -- 172.21.15.171:0/2661142318 >> v2:172.21.15.171:3300/0 conn(0x7f872c133c60 msgr2=0x7f872c136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872aa00700  1 --2- 172.21.15.171:0/2661142318 >> v2:172.21.15.171:3300/0 conn(0x7f872c133c60 0x7f872c136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872aa00700  1 -- 172.21.15.171:0/2661142318 >> v1:172.21.15.171:6789/0 conn(0x7f872c12e3a0 legacy=0x7f872c12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872aa00700  1 -- 172.21.15.171:0/2661142318 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c071b40 con 0x7f872c12ee90
2024-03-29T09:08:32.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872a000700  1 -- 172.21.15.171:0/2661142318 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210563448 0 0) 0x7f872c071520 con 0x7f872c12e3a0
2024-03-29T09:08:32.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872be00700  1 --2- 172.21.15.171:0/2661142318 >> v2:172.21.15.171:3300/0 conn(0x7f872c133c60 0x7f872c136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:32.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872aa00700  1 --2- 172.21.15.171:0/2661142318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c12ee90 0x7f872c133720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8718009870 tx=0x7f8718009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e75eab865340ccb server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:32.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872a000700  1 -- 172.21.15.171:0/2661142318 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718011830 con 0x7f872c12ee90
2024-03-29T09:08:32.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.346+0000 7f872a000700  1 -- 172.21.15.171:0/2661142318 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718011990 con 0x7f872c12ee90
2024-03-29T09:08:32.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f872a000700  1 -- 172.21.15.171:0/2661142318 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718011d20 con 0x7f872c12ee90
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 -- 172.21.15.171:0/2661142318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c12ee90 msgr2=0x7f872c133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 --2- 172.21.15.171:0/2661142318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c12ee90 0x7f872c133720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8718009870 tx=0x7f8718009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 -- 172.21.15.171:0/2661142318 shutdown_connections
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 --2- 172.21.15.171:0/2661142318 >> v2:172.21.15.171:3300/0 conn(0x7f872c133c60 0x7f872c136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 --2- 172.21.15.171:0/2661142318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c12ee90 0x7f872c133720 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 -- 172.21.15.171:0/2661142318 >> 172.21.15.171:0/2661142318 conn(0x7f872c0a0d70 msgr2=0x7f872c0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 -- 172.21.15.171:0/2661142318 shutdown_connections
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.347+0000 7f8732000700  1 -- 172.21.15.171:0/2661142318 wait complete.
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.348+0000 7f8732000700  1  Processor -- start
2024-03-29T09:08:32.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f8732000700  1 --  start start
2024-03-29T09:08:32.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f8732000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f872c12e3a0 0x7f872c121b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:32.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f8732000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f872c12ee90 0x7f872c1220d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:32.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f8732000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c133c60 0x7f872c1c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:32.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f8732000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c124000 con 0x7f872c12e3a0
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f8732000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c122cd0 con 0x7f872c133c60
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f8732000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872c121740 con 0x7f872c12ee90
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f872b400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f872c12e3a0 0x7f872c121b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f872aa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f872c12ee90 0x7f872c1220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f872b400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f872c12e3a0 0x7f872c121b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59886/0 (socket says 172.21.15.171:59886)
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f872be00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c133c60 0x7f872c1c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.349+0000 7f872b400700  1 -- 172.21.15.171:0/2716884083 learned_addr learned my addr 172.21.15.171:0/2716884083 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f872aa00700  1 -- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c133c60 msgr2=0x7f872c1c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f872aa00700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c133c60 0x7f872c1c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f872aa00700  1 -- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f872c12e3a0 msgr2=0x7f872c121b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f872aa00700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f872c12e3a0 0x7f872c121b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f872aa00700  1 -- 172.21.15.171:0/2716884083 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009a70 con 0x7f872c12ee90
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f872be00700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c133c60 0x7f872c1c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:32.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f872aa00700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f872c12ee90 0x7f872c1220d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8718016000 tx=0x7f8718004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:32.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.350+0000 7f8723400700  1 -- 172.21.15.171:0/2716884083 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180036a0 con 0x7f872c12ee90
2024-03-29T09:08:32.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.351+0000 7f8723400700  1 -- 172.21.15.171:0/2716884083 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871801f070 con 0x7f872c12ee90
2024-03-29T09:08:32.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.351+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87180094a0 con 0x7f872c12ee90
2024-03-29T09:08:32.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.351+0000 7f8723400700  1 -- 172.21.15.171:0/2716884083 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718003a40 con 0x7f872c12ee90
2024-03-29T09:08:32.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.351+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c123bb0 con 0x7f872c12ee90
2024-03-29T09:08:32.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.352+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c1171d0 con 0x7f872c12ee90
2024-03-29T09:08:32.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.352+0000 7f8723400700  1 -- 172.21.15.171:0/2716884083 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f8718003ba0 con 0x7f872c12ee90
2024-03-29T09:08:32.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.352+0000 7f8723400700  1 -- 172.21.15.171:0/2716884083 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f8718021070 con 0x7f872c12ee90
2024-03-29T09:08:32.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.356+0000 7f8723400700  1 -- 172.21.15.171:0/2716884083 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f8718006510 con 0x7f872c12ee90
2024-03-29T09:08:32.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.532+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872c0623e0 con 0x7f872c12ee90
2024-03-29T09:08:32.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.533+0000 7f8723400700  1 -- 172.21.15.171:0/2716884083 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v20) v1 ==== 74+0+8357 (secure 0 0 0) 0x7f8718015030 con 0x7f872c12ee90
2024-03-29T09:08:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":20,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T09:08:32.109013+0000","last_up_change":"2024-03-29T09:08:32.109013+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":39169}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":39169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":39169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":39169}]},"public_addr":"172.21.15.171:6800/39169","cluster_addr":"172.21.15.171:6801/39169","heartbeat_back_addr":"172.21.15.171:6803/39169","heartbeat_front_addr":"172.21.15.171:6802/39169","state":["exists"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":39170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":39170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":39170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":39170}]},"public_addr":"172.21.15.171:6804/39170","cluster_addr":"172.21.15.171:6805/39170","heartbeat_back_addr":"172.21.15.171:6807/39170","heartbeat_front_addr":"172.21.15.171:6806/39170","state":["exists"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":39179}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":39179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":39179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":39179}]},"public_addr":"172.21.15.171:6809/39179","cluster_addr":"172.21.15.171:6811/39179","heartbeat_back_addr":"172.21.15.171:6815/39179","heartbeat_front_addr":"172.21.15.171:6814/39179","state":["exists"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":39186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":39186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":39186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":39186}]},"public_addr":"172.21.15.171:6808/39186","cluster_addr":"172.21.15.171:6810/39186","heartbeat_back_addr":"172.21.15.171:6813/39186","heartbeat_front_addr":"172.21.15.171:6812/39186","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":19},{"osd":3,"down_stamp":"2024-03-29T09:08:32.109013+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:0/4094087308":"2024-03-30T09:08:24.052102+0000","172.21.15.171:0/4287724647":"2024-03-30T09:08:24.052102+0000","172.21.15.171:6816/38531":"2024-03-30T09:08:24.052102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 >> v1:172.21.15.171:6816/44806 conn(0x7f870c0475f0 legacy=0x7f870c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f872c12ee90 msgr2=0x7f872c1220d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f872c12ee90 0x7f872c1220d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8718016000 tx=0x7f8718004750 comp rx=0 tx=0).stop
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 shutdown_connections
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f872c133c60 0x7f872c1c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f872c12e3a0 0x7f872c121b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 --2- 172.21.15.171:0/2716884083 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f872c12ee90 0x7f872c1220d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.535+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 >> 172.21.15.171:0/2716884083 conn(0x7f872c0a0d70 msgr2=0x7f872c12c780 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:32.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.536+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 shutdown_connections
2024-03-29T09:08:32.536 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:32.536+0000 7f8732000700  1 -- 172.21.15.171:0/2716884083 wait complete.
2024-03-29T09:08:32.803 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T09:08:32.804+0000 7f2f603ae640 -1 Falling back to public interface
2024-03-29T09:08:33.575 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T09:08:33.576+0000 7ffb0abbc640 -1 osd.0 0 read_superblock omap replica is missing.
2024-03-29T09:08:33.603 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T09:08:33.604+0000 7ffb0abbc640 -1 osd.0 16 log_to_monitors true
2024-03-29T09:08:34.606 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T09:08:34.607+0000 7f0c9dbd6640 -1 osd.1 0 read_superblock omap replica is missing.
2024-03-29T09:08:34.640 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T09:08:34.641+0000 7f0c9dbd6640 -1 osd.1 16 log_to_monitors true
2024-03-29T09:08:35.222 INFO:tasks.ceph.osd.0.smithi171.stderr:2024-03-29T09:08:35.223+0000 7ffaee000700 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T09:08:35.554 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:35.569 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T09:08:35.570+0000 7f4942cbf640 -1 osd.2 0 read_superblock omap replica is missing.
2024-03-29T09:08:35.604 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T09:08:35.604+0000 7f4942cbf640 -1 osd.2 18 log_to_monitors true
2024-03-29T09:08:35.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.812+0000 7f5069200700  1  Processor -- start
2024-03-29T09:08:35.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.812+0000 7f5069200700  1 --  start start
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.813+0000 7f5069200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5064070370 0x7f506412e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.813+0000 7f5069200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506412ea20 0x7f506412acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.813+0000 7f5069200700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5064070de0 con 0x7f506412ee80
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.813+0000 7f5069200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50640713e0 con 0x7f506412ea20
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.813+0000 7f5069200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5064071920 con 0x7f5064070370
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.814+0000 7f5063400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5064070370 0x7f506412e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.814+0000 7f5062a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506412ea20 0x7f506412acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:35.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.814+0000 7f5062a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506412ea20 0x7f506412acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:55998/0 (socket says 172.21.15.171:55998)
2024-03-29T09:08:35.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.814+0000 7f5063e00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f506412ee80 0x7f506412b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:50844/0 (socket says 172.21.15.171:50844)
2024-03-29T09:08:35.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.814+0000 7f5062a00700  1 -- 172.21.15.171:0/2064440713 learned_addr learned my addr 172.21.15.171:0/2064440713 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062a00700  1 -- 172.21.15.171:0/2064440713 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5064070370 msgr2=0x7f506412e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062a00700  1 --2- 172.21.15.171:0/2064440713 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5064070370 0x7f506412e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062a00700  1 -- 172.21.15.171:0/2064440713 >> v1:172.21.15.171:6789/0 conn(0x7f506412ee80 legacy=0x7f506412b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062a00700  1 -- 172.21.15.171:0/2064440713 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064072090 con 0x7f506412ea20
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062000700  1 -- 172.21.15.171:0/2064440713 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4454737 0 0) 0x7f5064070de0 con 0x7f506412ee80
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062a00700  1 --2- 172.21.15.171:0/2064440713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506412ea20 0x7f506412acf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f504c009920 tx=0x7f504c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734a134d3b4bfb68 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062000700  1 -- 172.21.15.171:0/2064440713 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c011830 con 0x7f506412ea20
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062000700  1 -- 172.21.15.171:0/2064440713 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c011990 con 0x7f506412ea20
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.815+0000 7f5062000700  1 -- 172.21.15.171:0/2064440713 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c011d20 con 0x7f506412ea20
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 -- 172.21.15.171:0/2064440713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506412ea20 msgr2=0x7f506412acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:35.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 --2- 172.21.15.171:0/2064440713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506412ea20 0x7f506412acf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f504c009920 tx=0x7f504c009c30 comp rx=0 tx=0).stop
2024-03-29T09:08:35.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 -- 172.21.15.171:0/2064440713 shutdown_connections
2024-03-29T09:08:35.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 --2- 172.21.15.171:0/2064440713 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5064070370 0x7f506412e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:35.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 --2- 172.21.15.171:0/2064440713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506412ea20 0x7f506412acf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:35.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 -- 172.21.15.171:0/2064440713 >> 172.21.15.171:0/2064440713 conn(0x7f50640a0ac0 msgr2=0x7f50640a0ed0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:35.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 -- 172.21.15.171:0/2064440713 shutdown_connections
2024-03-29T09:08:35.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.816+0000 7f5069200700  1 -- 172.21.15.171:0/2064440713 wait complete.
2024-03-29T09:08:35.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.818+0000 7f5069200700  1  Processor -- start
2024-03-29T09:08:35.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.818+0000 7f5069200700  1 --  start start
2024-03-29T09:08:35.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5069200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5064070370 0x7f506406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:35.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5069200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506412ea20 0x7f506406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:35.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5069200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f506412ee80 0x7f506406d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5069200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506406e9d0 con 0x7f506412ea20
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5069200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506406ffc0 con 0x7f5064070370
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5069200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f506406f390 con 0x7f506412ee80
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5063400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5064070370 0x7f506406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5063400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5064070370 0x7f506406c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:56006/0 (socket says 172.21.15.171:56006)
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5063400700  1 -- 172.21.15.171:0/1863837971 learned_addr learned my addr 172.21.15.171:0/1863837971 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.819+0000 7f5062a00700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506412ea20 0x7f506406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.820+0000 7f5063400700  1 -- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f506412ee80 msgr2=0x7f506406d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:35.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.820+0000 7f5063400700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f506412ee80 0x7f506406d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:35.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.820+0000 7f5063400700  1 -- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506412ea20 msgr2=0x7f506406ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:35.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.820+0000 7f5063400700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506412ea20 0x7f506406ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:35.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.820+0000 7f5063400700  1 -- 172.21.15.171:0/1863837971 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c009550 con 0x7f5064070370
2024-03-29T09:08:35.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.820+0000 7f5063400700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5064070370 0x7f506406c780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f505400e9b0 tx=0x7f505400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:35.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.820+0000 7f505b400700  1 -- 172.21.15.171:0/1863837971 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054009710 con 0x7f5064070370
2024-03-29T09:08:35.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.821+0000 7f505b400700  1 -- 172.21.15.171:0/1863837971 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505400c850 con 0x7f5064070370
2024-03-29T09:08:35.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.821+0000 7f505b400700  1 -- 172.21.15.171:0/1863837971 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400cbc0 con 0x7f5064070370
2024-03-29T09:08:35.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.821+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506406f890 con 0x7f5064070370
2024-03-29T09:08:35.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.821+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50641c2e60 con 0x7f5064070370
2024-03-29T09:08:35.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.822+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506406fa20 con 0x7f5064070370
2024-03-29T09:08:35.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.823+0000 7f505b400700  1 -- 172.21.15.171:0/1863837971 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f505400cd20 con 0x7f5064070370
2024-03-29T09:08:35.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.824+0000 7f505b400700  1 -- 172.21.15.171:0/1863837971 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f505405c8c0 con 0x7f5064070370
2024-03-29T09:08:35.829 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:35.830+0000 7f505b400700  1 -- 172.21.15.171:0/1863837971 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f506406fa20 con 0x7f5064070370
2024-03-29T09:08:36.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.125+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f506406fa20 con 0x7f5064070370
2024-03-29T09:08:36.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.126+0000 7f505b400700  1 -- 172.21.15.171:0/1863837971 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v22) v1 ==== 74+0+8357 (secure 0 0 0) 0x7f506406fa20 con 0x7f5064070370
2024-03-29T09:08:36.125 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:36.125 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":22,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T09:08:35.123787+0000","last_up_change":"2024-03-29T09:08:32.109013+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":39169}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":39169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":39169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":39169}]},"public_addr":"172.21.15.171:6800/39169","cluster_addr":"172.21.15.171:6801/39169","heartbeat_back_addr":"172.21.15.171:6803/39169","heartbeat_front_addr":"172.21.15.171:6802/39169","state":["exists"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":39170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":39170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":39170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":39170}]},"public_addr":"172.21.15.171:6804/39170","cluster_addr":"172.21.15.171:6805/39170","heartbeat_back_addr":"172.21.15.171:6807/39170","heartbeat_front_addr":"172.21.15.171:6806/39170","state":["exists"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":39179}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":39179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":39179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":39179}]},"public_addr":"172.21.15.171:6809/39179","cluster_addr":"172.21.15.171:6811/39179","heartbeat_back_addr":"172.21.15.171:6815/39179","heartbeat_front_addr":"172.21.15.171:6814/39179","state":["exists"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":39186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":39186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":39186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":39186}]},"public_addr":"172.21.15.171:6808/39186","cluster_addr":"172.21.15.171:6810/39186","heartbeat_back_addr":"172.21.15.171:6813/39186","heartbeat_front_addr":"172.21.15.171:6812/39186","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":19},{"osd":3,"down_stamp":"2024-03-29T09:08:32.109013+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:0/4094087308":"2024-03-30T09:08:24.052102+0000","172.21.15.171:0/4287724647":"2024-03-30T09:08:24.052102+0000","172.21.15.171:6816/38531":"2024-03-30T09:08:24.052102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 >> v1:172.21.15.171:6816/44806 conn(0x7f50400475f0 legacy=0x7f5040049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5064070370 msgr2=0x7f506406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5064070370 0x7f506406c780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f505400e9b0 tx=0x7f505400ecc0 comp rx=0 tx=0).stop
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 shutdown_connections
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f506412ee80 0x7f506406d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5064070370 0x7f506406c780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 --2- 172.21.15.171:0/1863837971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506412ea20 0x7f506406ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 >> 172.21.15.171:0/1863837971 conn(0x7f50640a0ac0 msgr2=0x7f5064124830 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 shutdown_connections
2024-03-29T09:08:36.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:36.128+0000 7f5069200700  1 -- 172.21.15.171:0/1863837971 wait complete.
2024-03-29T09:08:36.286 INFO:tasks.ceph.osd.1.smithi171.stderr:2024-03-29T09:08:36.287+0000 7f0c81000700 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T09:08:36.576 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T09:08:36.576+0000 7f2f603ae640 -1 osd.3 0 read_superblock omap replica is missing.
2024-03-29T09:08:36.602 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T09:08:36.602+0000 7f2f603ae640 -1 osd.3 19 log_to_monitors true
2024-03-29T09:08:37.349 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-03-29T09:08:37.350+0000 7f4926200700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T09:08:38.297 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-03-29T09:08:38.298+0000 7f2f43800700 -1 osd.3 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory
2024-03-29T09:08:39.151 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:39.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.355+0000 7f5597600700  1  Processor -- start
2024-03-29T09:08:39.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.355+0000 7f5597600700  1 --  start start
2024-03-29T09:08:39.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5597600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006e460 0x7f559006e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5597600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f559006ed80 0x7f55901328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5597600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559006d120 con 0x7f5590132e10
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5597600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559006ce40 con 0x7f559006e460
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5597600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559006c5b0 con 0x7f559006ed80
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5594c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006e460 0x7f559006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f558fe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f559006ed80 0x7f55901328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5594c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006e460 0x7f559006e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42348/0 (socket says 172.21.15.171:42348)
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.356+0000 7f5594c00700  1 -- 172.21.15.171:0/1182599403 learned_addr learned my addr 172.21.15.171:0/1182599403 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f5594c00700  1 -- 172.21.15.171:0/1182599403 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f559006ed80 msgr2=0x7f55901328d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f5594c00700  1 --2- 172.21.15.171:0/1182599403 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f559006ed80 0x7f55901328d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f5594c00700  1 -- 172.21.15.171:0/1182599403 >> v1:172.21.15.171:6789/0 conn(0x7f5590132e10 legacy=0x7f5590135200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f5594c00700  1 -- 172.21.15.171:0/1182599403 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559006f690 con 0x7f559006e460
2024-03-29T09:08:39.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f5594c00700  1 --2- 172.21.15.171:0/1182599403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006e460 0x7f559006e840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5584009920 tx=0x7f5584009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b522c1d72557f0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:39.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f558f400700  1 -- 172.21.15.171:0/1182599403 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584011830 con 0x7f559006e460
2024-03-29T09:08:39.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f558f400700  1 -- 172.21.15.171:0/1182599403 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5584011990 con 0x7f559006e460
2024-03-29T09:08:39.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.357+0000 7f558f400700  1 -- 172.21.15.171:0/1182599403 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584011d20 con 0x7f559006e460
2024-03-29T09:08:39.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 -- 172.21.15.171:0/1182599403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006e460 msgr2=0x7f559006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 --2- 172.21.15.171:0/1182599403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006e460 0x7f559006e840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5584009920 tx=0x7f5584009c30 comp rx=0 tx=0).stop
2024-03-29T09:08:39.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 -- 172.21.15.171:0/1182599403 shutdown_connections
2024-03-29T09:08:39.360 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 --2- 172.21.15.171:0/1182599403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006e460 0x7f559006e840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 --2- 172.21.15.171:0/1182599403 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f559006ed80 0x7f55901328d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 -- 172.21.15.171:0/1182599403 >> 172.21.15.171:0/1182599403 conn(0x7f559009a230 msgr2=0x7f559009a640 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 -- 172.21.15.171:0/1182599403 shutdown_connections
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.358+0000 7f5597600700  1 -- 172.21.15.171:0/1182599403 wait complete.
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.359+0000 7f5597600700  1  Processor -- start
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.359+0000 7f5597600700  1 --  start start
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5597600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f559006e460 0x7f5590095080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5597600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006ed80 0x7f55900955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5597600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5590132e10 0x7f5590095b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5597600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55900968e0 con 0x7f559006e460
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5597600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55900972e0 con 0x7f559006ed80
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5597600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5590123600 con 0x7f5590132e10
2024-03-29T09:08:39.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5594c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f559006e460 0x7f5590095080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5594c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f559006e460 0x7f5590095080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39110/0 (socket says 172.21.15.171:39110)
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5594c00700  1 -- 172.21.15.171:0/2428849211 learned_addr learned my addr 172.21.15.171:0/2428849211 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f558fe00700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006ed80 0x7f55900955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5595600700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5590132e10 0x7f5590095b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5594c00700  1 -- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5590132e10 msgr2=0x7f5590095b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5594c00700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5590132e10 0x7f5590095b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5594c00700  1 -- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006ed80 msgr2=0x7f55900955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.360+0000 7f5594c00700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006ed80 0x7f55900955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f5594c00700  1 -- 172.21.15.171:0/2428849211 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584009550 con 0x7f559006e460
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f5595600700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5590132e10 0x7f5590095b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f558fe00700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006ed80 0x7f55900955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f5594c00700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f559006e460 0x7f5590095080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5584000c00 tx=0x7f5584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:39.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f558cc00700  1 -- 172.21.15.171:0/2428849211 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584004510 con 0x7f559006e460
2024-03-29T09:08:39.363 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f558cc00700  1 -- 172.21.15.171:0/2428849211 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55840036a0 con 0x7f559006e460
2024-03-29T09:08:39.363 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f558cc00700  1 -- 172.21.15.171:0/2428849211 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584003a10 con 0x7f559006e460
2024-03-29T09:08:39.363 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55900714f0 con 0x7f559006e460
2024-03-29T09:08:39.363 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.361+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5590122ef0 con 0x7f559006e460
2024-03-29T09:08:39.363 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.362+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5590090b80 con 0x7f559006e460
2024-03-29T09:08:39.363 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.362+0000 7f558cc00700  1 -- 172.21.15.171:0/2428849211 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f5584003b70 con 0x7f559006e460
2024-03-29T09:08:39.364 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.363+0000 7f558cc00700  1 -- 172.21.15.171:0/2428849211 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f5584021030 con 0x7f559006e460
2024-03-29T09:08:39.366 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.367+0000 7f558cc00700  1 -- 172.21.15.171:0/2428849211 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f5584028030 con 0x7f559006e460
2024-03-29T09:08:39.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.546+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5590132c40 con 0x7f559006e460
2024-03-29T09:08:39.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.547+0000 7f558cc00700  1 -- 172.21.15.171:0/2428849211 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v26) v1 ==== 74+0+8812 (secure 0 0 0) 0x7f5584015030 con 0x7f559006e460
2024-03-29T09:08:39.547 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:39.547 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":26,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T09:08:39.240872+0000","last_up_change":"2024-03-29T09:08:39.240872+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":46596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":46596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":46596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":46596}]},"public_addr":"172.21.15.171:6800/46596","cluster_addr":"172.21.15.171:6801/46596","heartbeat_back_addr":"172.21.15.171:6803/46596","heartbeat_front_addr":"172.21.15.171:6802/46596","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":24,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":46686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":46686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":46686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":46686}]},"public_addr":"172.21.15.171:6804/46686","cluster_addr":"172.21.15.171:6805/46686","heartbeat_back_addr":"172.21.15.171:6807/46686","heartbeat_front_addr":"172.21.15.171:6806/46686","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":46803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":46803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":46803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":46803}]},"public_addr":"172.21.15.171:6808/46803","cluster_addr":"172.21.15.171:6809/46803","heartbeat_back_addr":"172.21.15.171:6811/46803","heartbeat_front_addr":"172.21.15.171:6810/46803","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":26,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":46965}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":46965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":46965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":46965}]},"public_addr":"172.21.15.171:6812/46965","cluster_addr":"172.21.15.171:6813/46965","heartbeat_back_addr":"172.21.15.171:6815/46965","heartbeat_front_addr":"172.21.15.171:6814/46965","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":19},{"osd":3,"down_stamp":"2024-03-29T09:08:32.109013+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:0/4094087308":"2024-03-30T09:08:24.052102+0000","172.21.15.171:0/4287724647":"2024-03-30T09:08:24.052102+0000","172.21.15.171:6816/38531":"2024-03-30T09:08:24.052102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:39.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.549+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 >> v1:172.21.15.171:6816/44806 conn(0x7f5570047620 legacy=0x7f5570049ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.549+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f559006e460 msgr2=0x7f5590095080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.549+0000 7f5597600700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f559006e460 0x7f5590095080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5584000c00 tx=0x7f5584004750 comp rx=0 tx=0).stop
2024-03-29T09:08:39.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.550+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 shutdown_connections
2024-03-29T09:08:39.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.550+0000 7f5597600700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5590132e10 0x7f5590095b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.550 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.550+0000 7f5597600700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f559006e460 0x7f5590095080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.550 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.550+0000 7f5597600700  1 --2- 172.21.15.171:0/2428849211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f559006ed80 0x7f55900955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.550 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.550+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 >> 172.21.15.171:0/2428849211 conn(0x7f559009a230 msgr2=0x7f55900998c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:39.550 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.550+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 shutdown_connections
2024-03-29T09:08:39.550 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.550+0000 7f5597600700  1 -- 172.21.15.171:0/2428849211 wait complete.
2024-03-29T09:08:39.567 INFO:tasks.ceph.ceph_manager.ceph:all up!
2024-03-29T09:08:39.568 INFO:teuthology.run_tasks:Running task exec...
2024-03-29T09:08:39.583 INFO:teuthology.task.exec:Executing custom commands...
2024-03-29T09:08:39.583 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T09:08:39.584 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions'
2024-03-29T09:08:39.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.775+0000 7fcd0c600700  1  Processor -- start
2024-03-29T09:08:39.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.776+0000 7fcd0c600700  1 --  start start
2024-03-29T09:08:39.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.776+0000 7fcd0c600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd0406e380 0x7fcd0406e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.776+0000 7fcd0c600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fcd0406eca0 0x7fcd04132b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.776+0000 7fcd0c600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd04071c60 con 0x7fcd04133050
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.776+0000 7fcd0c600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd04067440 con 0x7fcd0406eca0
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.776+0000 7fcd0c600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0409e8b0 con 0x7fcd0406e380
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd0406e380 0x7fcd0406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd0406e380 0x7fcd0406e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45274/0 (socket says 172.21.15.171:45274)
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 -- 172.21.15.171:0/3270782687 learned_addr learned my addr 172.21.15.171:0/3270782687 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09200700  1 --2- 172.21.15.171:0/3270782687 >> v2:172.21.15.171:3300/0 conn(0x7fcd0406eca0 0x7fcd04132b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 -- 172.21.15.171:0/3270782687 >> v2:172.21.15.171:3300/0 conn(0x7fcd0406eca0 msgr2=0x7fcd04132b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 --2- 172.21.15.171:0/3270782687 >> v2:172.21.15.171:3300/0 conn(0x7fcd0406eca0 0x7fcd04132b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 -- 172.21.15.171:0/3270782687 >> v1:172.21.15.171:6789/0 conn(0x7fcd04133050 legacy=0x7fcd04135440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 -- 172.21.15.171:0/3270782687 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0406c5b0 con 0x7fcd0406e380
2024-03-29T09:08:39.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.777+0000 7fcd09c00700  1 --2- 172.21.15.171:0/3270782687 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd0406e380 0x7fcd0406e760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fccf80098f0 tx=0x7fccf8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64bbe70f45cae70 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:39.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd03e00700  1 -- 172.21.15.171:0/3270782687 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011830 con 0x7fcd0406e380
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd03e00700  1 -- 172.21.15.171:0/3270782687 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8011990 con 0x7fcd0406e380
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd03e00700  1 -- 172.21.15.171:0/3270782687 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011d20 con 0x7fcd0406e380
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd0c600700  1 -- 172.21.15.171:0/3270782687 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd0406e380 msgr2=0x7fcd0406e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd0c600700  1 --2- 172.21.15.171:0/3270782687 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd0406e380 0x7fcd0406e760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fccf80098f0 tx=0x7fccf8009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd0c600700  1 -- 172.21.15.171:0/3270782687 shutdown_connections
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd0c600700  1 --2- 172.21.15.171:0/3270782687 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd0406e380 0x7fcd0406e760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd0c600700  1 --2- 172.21.15.171:0/3270782687 >> v2:172.21.15.171:3300/0 conn(0x7fcd0406eca0 0x7fcd04132b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.778+0000 7fcd0c600700  1 -- 172.21.15.171:0/3270782687 >> 172.21.15.171:0/3270782687 conn(0x7fcd0409dd90 msgr2=0x7fcd0409e1a0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.779+0000 7fcd0c600700  1 -- 172.21.15.171:0/3270782687 shutdown_connections
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.779+0000 7fcd0c600700  1 -- 172.21.15.171:0/3270782687 wait complete.
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.780+0000 7fcd0c600700  1  Processor -- start
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.780+0000 7fcd0c600700  1 --  start start
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.780+0000 7fcd0c600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0406e380 0x7fcd04131400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.780+0000 7fcd0c600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0406eca0 0x7fcd04131940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd0c600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd04133050 0x7fcd041c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd0c600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd041324d0 con 0x7fcd0406e380
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd0c600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0408f590 con 0x7fcd0406eca0
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd0c600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04132ac0 con 0x7fcd04133050
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd09c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0406e380 0x7fcd04131400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd09c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0406e380 0x7fcd04131400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39138/0 (socket says 172.21.15.171:39138)
2024-03-29T09:08:39.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd09c00700  1 -- 172.21.15.171:0/2138311629 learned_addr learned my addr 172.21.15.171:0/2138311629 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd0a600700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd04133050 0x7fcd041c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd09200700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0406eca0 0x7fcd04131940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.781+0000 7fcd09c00700  1 -- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd04133050 msgr2=0x7fcd041c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd09c00700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd04133050 0x7fcd041c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd09c00700  1 -- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0406eca0 msgr2=0x7fcd04131940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd09c00700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0406eca0 0x7fcd04131940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd09c00700  1 -- 172.21.15.171:0/2138311629 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009550 con 0x7fcd0406e380
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd09200700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0406eca0 0x7fcd04131940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd0a600700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd04133050 0x7fcd041c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd09c00700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0406e380 0x7fcd04131400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fccf8000c00 tx=0x7fccf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd01600700  1 -- 172.21.15.171:0/2138311629 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80036a0 con 0x7fcd0406e380
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd01600700  1 -- 172.21.15.171:0/2138311629 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8003800 con 0x7fcd0406e380
2024-03-29T09:08:39.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd0c600700  1 -- 172.21.15.171:0/2138311629 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd04090870 con 0x7fcd0406e380
2024-03-29T09:08:39.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd01600700  1 -- 172.21.15.171:0/2138311629 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8003bd0 con 0x7fcd0406e380
2024-03-29T09:08:39.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.782+0000 7fcd0c600700  1 -- 172.21.15.171:0/2138311629 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd04090140 con 0x7fcd0406e380
2024-03-29T09:08:39.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.784+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd80052f0 con 0x7fcd0406e380
2024-03-29T09:08:39.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.785+0000 7fcd01600700  1 -- 172.21.15.171:0/2138311629 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fccf8021070 con 0x7fcd0406e380
2024-03-29T09:08:39.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.785+0000 7fcd01600700  1 -- 172.21.15.171:0/2138311629 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fccf805dd10 con 0x7fcd0406e380
2024-03-29T09:08:39.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:39.790+0000 7fcd01600700  1 -- 172.21.15.171:0/2138311629 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fccf805ce00 con 0x7fcd0406e380
2024-03-29T09:08:40.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.059+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fccd8005870 con 0x7fcd0406e380
2024-03-29T09:08:40.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.060+0000 7fcd01600700  1 -- 172.21.15.171:0/2138311629 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0  v0) v1 ==== 56+0+507 (secure 0 0 0) 0x7fccf8015030 con 0x7fcd0406e380
2024-03-29T09:08:40.059 INFO:teuthology.orchestra.run.smithi171.stdout:{
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    "mon": {
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:        "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)": 3
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    },
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    "mgr": {
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:        "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)": 2
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    },
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    "osd": {
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:        "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)": 4
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    },
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    "overall": {
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:        "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)": 9
2024-03-29T09:08:40.060 INFO:teuthology.orchestra.run.smithi171.stdout:    }
2024-03-29T09:08:40.061 INFO:teuthology.orchestra.run.smithi171.stdout:}
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 >> v1:172.21.15.171:6816/44806 conn(0x7fcce40475f0 legacy=0x7fcce4049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0406e380 msgr2=0x7fcd04131400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0406e380 0x7fcd04131400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fccf8000c00 tx=0x7fccf8004750 comp rx=0 tx=0).stop
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 shutdown_connections
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcd04133050 0x7fcd041c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0406e380 0x7fcd04131400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 --2- 172.21.15.171:0/2138311629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0406eca0 0x7fcd04131940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 >> 172.21.15.171:0/2138311629 conn(0x7fcd0409dd90 msgr2=0x7fcd04099270 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 shutdown_connections
2024-03-29T09:08:40.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.062+0000 7fccf6a00700  1 -- 172.21.15.171:0/2138311629 wait complete.
2024-03-29T09:08:40.079 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty'
2024-03-29T09:08:40.268 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.269+0000 7f5195200700  1  Processor -- start
2024-03-29T09:08:40.268 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.269+0000 7f5195200700  1 --  start start
2024-03-29T09:08:40.271 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.269+0000 7f5195200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519006d000 0x7f519006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.269+0000 7f5195200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f519012e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.269+0000 7f5195200700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519006ed80 con 0x7f519012e960
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.269+0000 7f5195200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5190066660 con 0x7f519006d000
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.269+0000 7f5195200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51900a0b00 con 0x7f519006d920
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518d400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f519012e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518de00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519006d000 0x7f519006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518d400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f519012e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45288/0 (socket says 172.21.15.171:45288)
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518d400700  1 -- 172.21.15.171:0/2516452473 learned_addr learned my addr 172.21.15.171:0/2516452473 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518e800700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f519012e960 0x7f519012ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59024/0 (socket says 172.21.15.171:59024)
2024-03-29T09:08:40.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518de00700  1 -- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 msgr2=0x7f519012e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518de00700  1 --2- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f519012e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518de00700  1 -- 172.21.15.171:0/2516452473 >> v1:172.21.15.171:6789/0 conn(0x7f519012e960 legacy=0x7f519012ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518de00700  1 -- 172.21.15.171:0/2516452473 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519006dd60 con 0x7f519006d000
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518d400700  1 --2- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f519012e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518ca00700  1 -- 172.21.15.171:0/2516452473 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127854771 0 0) 0x7f519006ed80 con 0x7f519012e960
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.270+0000 7f518de00700  1 --2- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519006d000 0x7f519006d3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5180009870 tx=0x7f5180009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278c50f23bfbe7d1 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f518ca00700  1 -- 172.21.15.171:0/2516452473 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011830 con 0x7f519006d000
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f518ca00700  1 -- 172.21.15.171:0/2516452473 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5180011990 con 0x7f519006d000
2024-03-29T09:08:40.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f518ca00700  1 -- 172.21.15.171:0/2516452473 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011d20 con 0x7f519006d000
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 -- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519006d000 msgr2=0x7f519006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 --2- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519006d000 0x7f519006d3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5180009870 tx=0x7f5180009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 -- 172.21.15.171:0/2516452473 shutdown_connections
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 --2- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519006d000 0x7f519006d3e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 --2- 172.21.15.171:0/2516452473 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f519012e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 -- 172.21.15.171:0/2516452473 >> 172.21.15.171:0/2516452473 conn(0x7f51900a0e50 msgr2=0x7f51900a1260 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 -- 172.21.15.171:0/2516452473 shutdown_connections
2024-03-29T09:08:40.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.271+0000 7f5195200700  1 -- 172.21.15.171:0/2516452473 wait complete.
2024-03-29T09:08:40.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1  Processor -- start
2024-03-29T09:08:40.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1 --  start start
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f519006d000 0x7f519012fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f5190130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519012e960 0x7f51901c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5190132dc0 con 0x7f519006d000
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5190130c90 con 0x7f519012e960
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.273+0000 7f5195200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5190131220 con 0x7f519006d920
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518de00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f519006d000 0x7f519012fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518de00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f519006d000 0x7f519012fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39142/0 (socket says 172.21.15.171:39142)
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518de00700  1 -- 172.21.15.171:0/2825172206 learned_addr learned my addr 172.21.15.171:0/2825172206 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518e800700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519012e960 0x7f51901c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518d400700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f5190130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518d400700  1 -- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519012e960 msgr2=0x7f51901c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518d400700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519012e960 0x7f51901c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518d400700  1 -- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f519006d000 msgr2=0x7f519012fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518d400700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f519006d000 0x7f519012fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518d400700  1 -- 172.21.15.171:0/2825172206 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c009550 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518de00700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f519006d000 0x7f519012fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.274+0000 7f518d400700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f5190130100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f517c00e9a0 tx=0x7f517c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.275+0000 7f5186000700  1 -- 172.21.15.171:0/2825172206 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c004240 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.275+0000 7f5186000700  1 -- 172.21.15.171:0/2825172206 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0043a0 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.275+0000 7f5186000700  1 -- 172.21.15.171:0/2825172206 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0036a0 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.275+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51800094a0 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.275+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5190132130 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.276+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519012cab0 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.276+0000 7f5186000700  1 -- 172.21.15.171:0/2825172206 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f517c003800 con 0x7f519006d920
2024-03-29T09:08:40.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.277+0000 7f5186000700  1 -- 172.21.15.171:0/2825172206 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f517c05c9c0 con 0x7f519006d920
2024-03-29T09:08:40.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.281+0000 7f5186000700  1 -- 172.21.15.171:0/2825172206 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f517c03a400 con 0x7f519006d920
2024-03-29T09:08:40.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.454+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f519006f290 con 0x7f519006d920
2024-03-29T09:08:40.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.455+0000 7f5186000700  1 -- 172.21.15.171:0/2825172206 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0  v27) v1 ==== 81+0+16410 (secure 0 0 0) 0x7f517c03dbf0 con 0x7f519006d920
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:{
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:    "epoch": 27,
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:    "fsid": "5d11de56-0552-4a0a-9c9b-c107a7eaf7f9",
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:    "created": "2024-03-29T08:54:18.344251+0000",
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:    "modified": "2024-03-29T09:08:40.244963+0000",
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:    "last_up_change": "2024-03-29T09:08:39.240872+0000",
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:    "last_in_change": "2024-03-29T08:54:20.297263+0000",
2024-03-29T09:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout:    "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "flags_num": 5799936,
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "flags_set": [
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:        "pglog_hardlimit",
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:        "purged_snapdirs",
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:        "recovery_deletes",
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:        "sortbitwise"
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    ],
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "crush_version": 8,
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "full_ratio": 0.94999998807907104,
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "backfillfull_ratio": 0.89999997615814209,
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "nearfull_ratio": 0.85000002384185791,
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "cluster_snapshot": "",
2024-03-29T09:08:40.456 INFO:teuthology.orchestra.run.smithi171.stdout:    "pool_max": 2,
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:    "max_osd": 4,
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:    "require_min_compat_client": "pacific",
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:    "min_compat_client": "jewel",
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:    "require_osd_release": "pacific",
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:    "allow_crimson": false,
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:    "pools": [
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "pool": 1,
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "pool_name": ".mgr",
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "create_time": "2024-03-29T08:54:27.580138+0000",
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "flags": 1,
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "flags_names": "hashpspool",
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "type": 1,
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "size": 2,
2024-03-29T09:08:40.457 INFO:teuthology.orchestra.run.smithi171.stdout:            "min_size": 1,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "crush_rule": 0,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_count": 0,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_target": 0,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_barrier": 0,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_mandatory_member": 2147483647,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "object_hash": 2,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_autoscale_mode": "off",
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_num": 1,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_placement_num": 1,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_placement_num_target": 1,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_num_target": 1,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_num_pending": 1,
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_pg_merge_meta": {
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:                "source_pgid": "0.0",
2024-03-29T09:08:40.458 INFO:teuthology.orchestra.run.smithi171.stdout:                "ready_epoch": 0,
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:                "last_epoch_started": 0,
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:                "last_epoch_clean": 0,
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:                "source_version": "0'0",
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:                "target_version": "0'0"
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_change": "16",
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_force_op_resend": "0",
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_force_op_resend_prenautilus": "0",
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_force_op_resend_preluminous": "0",
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "auid": 0,
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "snap_mode": "selfmanaged",
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "snap_seq": 0,
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "snap_epoch": 0,
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "pool_snaps": [],
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "removed_snaps": "[]",
2024-03-29T09:08:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:            "quota_max_bytes": 0,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "quota_max_objects": 0,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "tiers": [],
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "tier_of": -1,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "read_tier": -1,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "write_tier": -1,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_mode": "none",
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "target_max_bytes": 0,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "target_max_objects": 0,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_target_dirty_ratio_micro": 400000,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_target_dirty_high_ratio_micro": 600000,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_target_full_ratio_micro": 800000,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_min_flush_age": 0,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_min_evict_age": 0,
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "erasure_code_profile": "",
2024-03-29T09:08:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_params": {
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:                "type": "none"
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_period": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_count": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "use_gmt_hitset": true,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "min_read_recency_for_promote": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "min_write_recency_for_promote": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_grade_decay_rate": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_search_last_n": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "grade_table": [],
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "stripe_width": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "expected_num_objects": 0,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "fast_read": false,
2024-03-29T09:08:40.461 INFO:teuthology.orchestra.run.smithi171.stdout:            "options": {
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "pg_num_max": 32,
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "pg_num_min": 1
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:            "application_metadata": {
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "mgr": {},
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "mgr_devicehealth": {}
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:            "read_balance": {
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "score_acting": 4,
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "score_stable": 4,
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "optimal_score": 0.5,
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "raw_score_acting": 2,
2024-03-29T09:08:40.462 INFO:teuthology.orchestra.run.smithi171.stdout:                "raw_score_stable": 2,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:                "primary_affinity_weighted": 1,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:                "average_primary_affinity": 1,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:                "average_primary_affinity_weighted": 1
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            }
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:        },
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "pool": 2,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "pool_name": "rbd",
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "create_time": "2024-03-29T08:54:28.529901+0000",
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "flags": 1,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "flags_names": "hashpspool",
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "type": 1,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "size": 2,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "min_size": 1,
2024-03-29T09:08:40.463 INFO:teuthology.orchestra.run.smithi171.stdout:            "crush_rule": 0,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_count": 0,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_target": 0,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_barrier": 0,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "peering_crush_bucket_mandatory_member": 2147483647,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "object_hash": 2,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_autoscale_mode": "off",
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_num": 8,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_placement_num": 8,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_placement_num_target": 8,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_num_target": 8,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "pg_num_pending": 8,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_pg_merge_meta": {
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:                "source_pgid": "0.0",
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:                "ready_epoch": 0,
2024-03-29T09:08:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:                "last_epoch_started": 0,
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:                "last_epoch_clean": 0,
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:                "source_version": "0'0",
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:                "target_version": "0'0"
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_change": "12",
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_force_op_resend": "0",
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_force_op_resend_prenautilus": "0",
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_force_op_resend_preluminous": "0",
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "auid": 0,
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "snap_mode": "selfmanaged",
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "snap_seq": 0,
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "snap_epoch": 0,
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "pool_snaps": [],
2024-03-29T09:08:40.465 INFO:teuthology.orchestra.run.smithi171.stdout:            "removed_snaps": "[]",
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "quota_max_bytes": 0,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "quota_max_objects": 0,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "tiers": [],
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "tier_of": -1,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "read_tier": -1,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "write_tier": -1,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_mode": "none",
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "target_max_bytes": 0,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "target_max_objects": 0,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_target_dirty_ratio_micro": 400000,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_target_dirty_high_ratio_micro": 600000,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_target_full_ratio_micro": 800000,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_min_flush_age": 0,
2024-03-29T09:08:40.466 INFO:teuthology.orchestra.run.smithi171.stdout:            "cache_min_evict_age": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "erasure_code_profile": "",
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_params": {
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:                "type": "none"
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_period": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_count": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "use_gmt_hitset": true,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "min_read_recency_for_promote": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "min_write_recency_for_promote": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_grade_decay_rate": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "hit_set_search_last_n": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "grade_table": [],
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "stripe_width": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "expected_num_objects": 0,
2024-03-29T09:08:40.467 INFO:teuthology.orchestra.run.smithi171.stdout:            "fast_read": false,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:            "options": {},
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:            "application_metadata": {
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "rbd": {}
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:            "read_balance": {
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "score_acting": 2.5,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "score_stable": 2.5,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "optimal_score": 1,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "raw_score_acting": 2.5,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "raw_score_stable": 2.5,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "primary_affinity_weighted": 1,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "average_primary_affinity": 1,
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:                "average_primary_affinity_weighted": 1
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:            }
2024-03-29T09:08:40.468 INFO:teuthology.orchestra.run.smithi171.stdout:        }
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:    ],
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:    "osds": [
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 0,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "uuid": "cd8f3f88-2404-4aef-9bc1-bbb395180f89",
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "up": 1,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "in": 1,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "weight": 1,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "primary_affinity": 1,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_begin": 9,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_end": 16,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_from": 23,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_thru": 23,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_at": 17,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "lost_at": 0,
2024-03-29T09:08:40.469 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addrs": {
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6800",
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46596
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addrs": {
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.470 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6801",
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46596
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addrs": {
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6803",
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46596
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.471 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addrs": {
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6802",
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46596
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addr": "172.21.15.171:6800/46596",
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addr": "172.21.15.171:6801/46596",
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addr": "172.21.15.171:6803/46596",
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addr": "172.21.15.171:6802/46596",
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:            "state": [
2024-03-29T09:08:40.472 INFO:teuthology.orchestra.run.smithi171.stdout:                "exists",
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:                "up"
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            ]
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:        },
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 1,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "uuid": "f2edc853-e433-4c25-a9a7-0c412db5d352",
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "up": 1,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "in": 1,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "weight": 1,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "primary_affinity": 1,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_begin": 9,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_end": 16,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_from": 24,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_thru": 24,
2024-03-29T09:08:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_at": 18,
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:            "lost_at": 0,
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addrs": {
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6804",
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46686
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addrs": {
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.474 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6805",
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46686
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addrs": {
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.475 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6807",
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46686
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addrs": {
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.476 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6806",
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46686
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addr": "172.21.15.171:6804/46686",
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addr": "172.21.15.171:6805/46686",
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addr": "172.21.15.171:6807/46686",
2024-03-29T09:08:40.477 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addr": "172.21.15.171:6806/46686",
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:            "state": [
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:                "exists",
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:                "up"
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:            ]
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:        },
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 2,
2024-03-29T09:08:40.478 INFO:teuthology.orchestra.run.smithi171.stdout:            "uuid": "c1f904d8-4070-4c18-b06a-fd252f0b0378",
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "up": 1,
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "in": 1,
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "weight": 1,
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "primary_affinity": 1,
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_begin": 9,
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_end": 18,
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_from": 25,
2024-03-29T09:08:40.479 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_thru": 26,
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_at": 19,
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:            "lost_at": 0,
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addrs": {
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6808",
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46803
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.480 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addrs": {
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6809",
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46803
2024-03-29T09:08:40.481 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addrs": {
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6811",
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46803
2024-03-29T09:08:40.482 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addrs": {
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6810",
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46803
2024-03-29T09:08:40.483 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addr": "172.21.15.171:6808/46803",
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addr": "172.21.15.171:6809/46803",
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addr": "172.21.15.171:6811/46803",
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addr": "172.21.15.171:6810/46803",
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:            "state": [
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:                "exists",
2024-03-29T09:08:40.484 INFO:teuthology.orchestra.run.smithi171.stdout:                "up"
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:            ]
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:        },
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 3,
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:            "uuid": "809786b2-3806-4467-bd9d-01455bdcd876",
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:            "up": 1,
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:            "in": 1,
2024-03-29T09:08:40.485 INFO:teuthology.orchestra.run.smithi171.stdout:            "weight": 1,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "primary_affinity": 1,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_begin": 9,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_clean_end": 19,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_from": 26,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "up_thru": 26,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_at": 20,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "lost_at": 0,
2024-03-29T09:08:40.486 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addrs": {
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6812",
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46965
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addrs": {
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6813",
2024-03-29T09:08:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46965
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addrs": {
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6815",
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46965
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addrs": {
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                "addrvec": [
2024-03-29T09:08:40.488 INFO:teuthology.orchestra.run.smithi171.stdout:                    {
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:                        "type": "v1",
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:                        "addr": "172.21.15.171:6814",
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:                        "nonce": 46965
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:                    }
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:                ]
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:            },
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:            "public_addr": "172.21.15.171:6812/46965",
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:            "cluster_addr": "172.21.15.171:6813/46965",
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_back_addr": "172.21.15.171:6815/46965",
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:            "heartbeat_front_addr": "172.21.15.171:6814/46965",
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:            "state": [
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:                "exists",
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:                "up"
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:            ]
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:        }
2024-03-29T09:08:40.489 INFO:teuthology.orchestra.run.smithi171.stdout:    ],
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:    "osd_xinfo": [
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 0,
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_stamp": "0.000000",
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_probability": 0,
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_interval": 0,
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "features": 4540138322906710015,
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "old_weight": 0,
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_purged_snaps_scrub": "2024-03-29T08:54:25.830481+0000",
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "dead_epoch": 17
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:        },
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.490 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 1,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_stamp": "0.000000",
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_probability": 0,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_interval": 0,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "features": 4540138322906710015,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "old_weight": 0,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_purged_snaps_scrub": "2024-03-29T08:54:25.931512+0000",
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "dead_epoch": 18
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:        },
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 2,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_stamp": "0.000000",
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_probability": 0,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_interval": 0,
2024-03-29T09:08:40.491 INFO:teuthology.orchestra.run.smithi171.stdout:            "features": 4540138322906710015,
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "old_weight": 0,
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_purged_snaps_scrub": "2024-03-29T08:54:25.924038+0000",
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "dead_epoch": 19
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:        },
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:        {
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "osd": 3,
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "down_stamp": "2024-03-29T09:08:32.109013+0000",
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_probability": 0,
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "laggy_interval": 0,
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "features": 4540138322906710015,
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "old_weight": 0,
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "last_purged_snaps_scrub": "2024-03-29T08:54:25.887945+0000",
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:            "dead_epoch": 0
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:        }
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:    ],
2024-03-29T09:08:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:    "pg_upmap": [],
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    "pg_upmap_items": [],
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    "pg_upmap_primaries": [],
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    "pg_temp": [],
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    "primary_temp": [],
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    "blocklist": {
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:        "172.21.15.171:0/4094087308": "2024-03-30T09:08:24.052102+0000",
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:        "172.21.15.171:0/4287724647": "2024-03-30T09:08:24.052102+0000",
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:        "172.21.15.171:6816/38531": "2024-03-30T09:08:24.052102+0000"
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    },
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    "range_blocklist": {},
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:    "erasure_code_profiles": {
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:        "default": {
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:            "crush-failure-domain": "osd",
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:            "k": "2",
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:            "m": "1",
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:            "plugin": "jerasure",
2024-03-29T09:08:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:            "technique": "reed_sol_van"
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:        }
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    },
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    "removed_snaps_queue": [],
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    "new_removed_snaps": [],
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    "new_purged_snaps": [],
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    "crush_node_flags": {},
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    "device_class_flags": {},
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    "stretch_mode": {
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:        "stretch_mode_enabled": false,
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:        "stretch_bucket_count": 0,
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:        "degraded_stretch_mode": 0,
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:        "recovering_stretch_mode": 0,
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:        "stretch_mode_bucket": 0
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:    }
2024-03-29T09:08:40.494 INFO:teuthology.orchestra.run.smithi171.stdout:}
2024-03-29T09:08:40.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.457+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 >> v1:172.21.15.171:6816/44806 conn(0x7f51700475f0 legacy=0x7f5170049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.457+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 msgr2=0x7f5190130100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.457+0000 7f5195200700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f5190130100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f517c00e9a0 tx=0x7f517c00ecb0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.458+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 shutdown_connections
2024-03-29T09:08:40.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.458+0000 7f5195200700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f519012e960 0x7f51901c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.458+0000 7f5195200700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f519006d000 0x7f519012fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.458+0000 7f5195200700  1 --2- 172.21.15.171:0/2825172206 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f519006d920 0x7f5190130100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.458+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 >> 172.21.15.171:0/2825172206 conn(0x7f51900a0e50 msgr2=0x7f519009d6f0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:40.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.458+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 shutdown_connections
2024-03-29T09:08:40.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.458+0000 7f5195200700  1 -- 172.21.15.171:0/2825172206 wait complete.
2024-03-29T09:08:40.497 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump'
2024-03-29T09:08:40.684 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.685+0000 7f1aa8c00700  1  Processor -- start
2024-03-29T09:08:40.685 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.685+0000 7f1aa8c00700  1 --  start start
2024-03-29T09:08:40.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.685+0000 7f1aa8c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412cbd0 0x7f1aa4131440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa8c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa4131980 0x7f1aa4133d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa8c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa4071320 con 0x7f1aa412c0e0
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa8c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4071e40 con 0x7f1aa412cbd0
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa8c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa409f9e0 con 0x7f1aa4131980
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa1e00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f1aa412c0e0 0x7f1aa412c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59036/0 (socket says 172.21.15.171:59036)
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa1e00700  1 -- 172.21.15.171:0/1988754220 learned_addr learned my addr 172.21.15.171:0/1988754220 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa2800700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa4131980 0x7f1aa4133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa1400700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412cbd0 0x7f1aa4131440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa2800700  1 -- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412cbd0 msgr2=0x7f1aa4131440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa2800700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412cbd0 0x7f1aa4131440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa2800700  1 -- 172.21.15.171:0/1988754220 >> v1:172.21.15.171:6789/0 conn(0x7f1aa412c0e0 legacy=0x7f1aa412c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa2800700  1 -- 172.21.15.171:0/1988754220 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa40717b0 con 0x7f1aa4131980
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa1400700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412cbd0 0x7f1aa4131440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.686+0000 7f1aa0a00700  1 -- 172.21.15.171:0/1988754220 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411785242 0 0) 0x7f1aa4071320 con 0x7f1aa412c0e0
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.687+0000 7f1aa2800700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa4131980 0x7f1aa4133d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009df0 tx=0x7f1a9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327499e2c0745bac server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.687+0000 7f1aa0a00700  1 -- 172.21.15.171:0/1988754220 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00e070 con 0x7f1aa4131980
2024-03-29T09:08:40.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.687+0000 7f1aa0a00700  1 -- 172.21.15.171:0/1988754220 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00bae0 con 0x7f1aa4131980
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.687+0000 7f1aa0a00700  1 -- 172.21.15.171:0/1988754220 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00be90 con 0x7f1aa4131980
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.687+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa4131980 msgr2=0x7f1aa4133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.687+0000 7f1aa8c00700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa4131980 0x7f1aa4133d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009df0 tx=0x7f1a9c00b330 comp rx=0 tx=0).stop
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.688+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1988754220 shutdown_connections
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.688+0000 7f1aa8c00700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa4131980 0x7f1aa4133d70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.688+0000 7f1aa8c00700  1 --2- 172.21.15.171:0/1988754220 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412cbd0 0x7f1aa4131440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.688+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1988754220 >> 172.21.15.171:0/1988754220 conn(0x7f1aa409c960 msgr2=0x7f1aa409cd70 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.688+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1988754220 shutdown_connections
2024-03-29T09:08:40.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.688+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1988754220 wait complete.
2024-03-29T09:08:40.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.689+0000 7f1aa8c00700  1  Processor -- start
2024-03-29T09:08:40.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.689+0000 7f1aa8c00700  1 --  start start
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa8c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412c0e0 0x7f1aa406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa8c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa412cbd0 0x7f1aa406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa8c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4131980 0x7f1aa406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa8c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa408b720 con 0x7f1aa4131980
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa8c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa406f4e0 con 0x7f1aa412c0e0
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa8c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa408b000 con 0x7f1aa412cbd0
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412c0e0 0x7f1aa406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa412cbd0 0x7f1aa406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa412cbd0 0x7f1aa406d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45306/0 (socket says 172.21.15.171:45306)
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 -- 172.21.15.171:0/1842913460 learned_addr learned my addr 172.21.15.171:0/1842913460 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa2800700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4131980 0x7f1aa406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 -- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412c0e0 msgr2=0x7f1aa406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412c0e0 0x7f1aa406d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 -- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4131980 msgr2=0x7f1aa406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4131980 0x7f1aa406ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1400700  1 -- 172.21.15.171:0/1842913460 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900094a0 con 0x7f1aa412cbd0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.690+0000 7f1aa1e00700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412c0e0 0x7f1aa406d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.691+0000 7f1aa1400700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa412cbd0 0x7f1aa406d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000ebe0 tx=0x7f1a9000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.691+0000 7f1a9a000700  1 -- 172.21.15.171:0/1842913460 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000c850 con 0x7f1aa412cbd0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.691+0000 7f1a9a000700  1 -- 172.21.15.171:0/1842913460 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9000c9b0 con 0x7f1aa412cbd0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.691+0000 7f1a9a000700  1 -- 172.21.15.171:0/1842913460 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000cd40 con 0x7f1aa412cbd0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.691+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c009a70 con 0x7f1aa412cbd0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.691+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa406eb00 con 0x7f1aa412cbd0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.692+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa40623e0 con 0x7f1aa412cbd0
2024-03-29T09:08:40.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.692+0000 7f1a9a000700  1 -- 172.21.15.171:0/1842913460 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f1a90013470 con 0x7f1aa412cbd0
2024-03-29T09:08:40.694 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.693+0000 7f1a9a000700  1 -- 172.21.15.171:0/1842913460 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f1a9005ccc0 con 0x7f1aa412cbd0
2024-03-29T09:08:40.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.696+0000 7f1a9a000700  1 -- 172.21.15.171:0/1842913460 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f1a90063080 con 0x7f1aa412cbd0
2024-03-29T09:08:40.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.894+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1aa4129290 con 0x7f1aa412cbd0
2024-03-29T09:08:40.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.895+0000 7f1a9a000700  1 -- 172.21.15.171:0/1842913460 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) v1 ==== 75+0+358 (secure 0 0 0) 0x7f1a90017030 con 0x7f1aa412cbd0
2024-03-29T09:08:40.895 INFO:teuthology.orchestra.run.smithi171.stdout:e1
2024-03-29T09:08:40.895 INFO:teuthology.orchestra.run.smithi171.stdout:enable_multiple, ever_enabled_multiple: 1,1
2024-03-29T09:08:40.895 INFO:teuthology.orchestra.run.smithi171.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
2024-03-29T09:08:40.895 INFO:teuthology.orchestra.run.smithi171.stdout:legacy client fscid: -1
2024-03-29T09:08:40.895 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:40.895 INFO:teuthology.orchestra.run.smithi171.stdout:No filesystems configured
2024-03-29T09:08:40.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 >> v1:172.21.15.171:6816/44806 conn(0x7f1a84047620 legacy=0x7f1a84049ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa412cbd0 msgr2=0x7f1aa406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:40.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa412cbd0 0x7f1aa406d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000ebe0 tx=0x7f1a9000eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 shutdown_connections
2024-03-29T09:08:40.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4131980 0x7f1aa406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa412c0e0 0x7f1aa406d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 --2- 172.21.15.171:0/1842913460 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f1aa412cbd0 0x7f1aa406d990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:40.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 >> 172.21.15.171:0/1842913460 conn(0x7f1aa409c960 msgr2=0x7f1aa412a440 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:40.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 shutdown_connections
2024-03-29T09:08:40.898 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:40.897+0000 7f1aa8c00700  1 -- 172.21.15.171:0/1842913460 wait complete.
2024-03-29T09:08:40.898 INFO:teuthology.orchestra.run.smithi171.stderr:dumped fsmap epoch 1
2024-03-29T09:08:40.914 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release quincy'
2024-03-29T09:08:41.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.100+0000 7f5c22600700  1  Processor -- start
2024-03-29T09:08:41.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.100+0000 7f5c22600700  1 --  start start
2024-03-29T09:08:41.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c22600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c06d000 0x7f5c1c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:41.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c22600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d920 0x7f5c1c12e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:41.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c22600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f5c1c12e960 0x7f5c1c12ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c22600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c066660 con 0x7f5c1c12e960
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c22600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0a0b00 con 0x7f5c1c06d000
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c22600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c06ed80 con 0x7f5c1c06d920
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c1b400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c06d000 0x7f5c1c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c1aa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d920 0x7f5c1c12e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c1be00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f5c1c12e960 0x7f5c1c12ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c1b400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c06d000 0x7f5c1c06d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42426/0 (socket says 172.21.15.171:42426)
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.101+0000 7f5c1b400700  1 -- 172.21.15.171:0/2762017654 learned_addr learned my addr 172.21.15.171:0/2762017654 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1b400700  1 -- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d920 msgr2=0x7f5c1c12e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1b400700  1 --2- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d920 0x7f5c1c12e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1b400700  1 -- 172.21.15.171:0/2762017654 >> v2:172.21.15.171:3300/0 conn(0x7f5c1c12e960 msgr2=0x7f5c1c12ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1b400700  1 --2- 172.21.15.171:0/2762017654 >> v2:172.21.15.171:3300/0 conn(0x7f5c1c12e960 0x7f5c1c12ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1b400700  1 -- 172.21.15.171:0/2762017654 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c12f320 con 0x7f5c1c06d000
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1aa00700  1 --2- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d920 0x7f5c1c12e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:41.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1b400700  1 --2- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c06d000 0x7f5c1c06d3e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098f0 tx=0x7f5c0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99ee5db3f8dc9b78 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:41.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1a000700  1 -- 172.21.15.171:0/2762017654 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c011830 con 0x7f5c1c06d000
2024-03-29T09:08:41.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1a000700  1 -- 172.21.15.171:0/2762017654 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c011990 con 0x7f5c1c06d000
2024-03-29T09:08:41.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.102+0000 7f5c1a000700  1 -- 172.21.15.171:0/2762017654 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c011d20 con 0x7f5c1c06d000
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 -- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c06d000 msgr2=0x7f5c1c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 --2- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c06d000 0x7f5c1c06d3e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098f0 tx=0x7f5c0c009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 -- 172.21.15.171:0/2762017654 shutdown_connections
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 --2- 172.21.15.171:0/2762017654 >> v2:172.21.15.171:3300/0 conn(0x7f5c1c12e960 0x7f5c1c12ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 --2- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c06d000 0x7f5c1c06d3e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 --2- 172.21.15.171:0/2762017654 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d920 0x7f5c1c12e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 -- 172.21.15.171:0/2762017654 >> 172.21.15.171:0/2762017654 conn(0x7f5c1c0a0e50 msgr2=0x7f5c1c0a1260 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 -- 172.21.15.171:0/2762017654 shutdown_connections
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.103+0000 7f5c22600700  1 -- 172.21.15.171:0/2762017654 wait complete.
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.104+0000 7f5c22600700  1  Processor -- start
2024-03-29T09:08:41.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.104+0000 7f5c22600700  1 --  start start
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c22600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d000 0x7f5c1c131b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c22600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c1c06d920 0x7f5c1c132040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c22600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c12e960 0x7f5c1c132580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c22600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c134c50 con 0x7f5c1c06d920
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c22600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c1352e0 con 0x7f5c1c12e960
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c22600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c1354a0 con 0x7f5c1c06d000
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c1b400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d000 0x7f5c1c131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c1be00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c12e960 0x7f5c1c132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c1aa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c1c06d920 0x7f5c1c132040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c1b400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d000 0x7f5c1c131b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45312/0 (socket says 172.21.15.171:45312)
2024-03-29T09:08:41.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.105+0000 7f5c1b400700  1 -- 172.21.15.171:0/101750487 learned_addr learned my addr 172.21.15.171:0/101750487 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c1b400700  1 -- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c12e960 msgr2=0x7f5c1c132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c1b400700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c12e960 0x7f5c1c132580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c1b400700  1 -- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c1c06d920 msgr2=0x7f5c1c132040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c1b400700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c1c06d920 0x7f5c1c132040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c1b400700  1 -- 172.21.15.171:0/101750487 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c080094a0 con 0x7f5c1c06d000
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c1be00700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c12e960 0x7f5c1c132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c1b400700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d000 0x7f5c1c131b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000c00 tx=0x7f5c0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c13400700  1 -- 172.21.15.171:0/101750487 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c004240 con 0x7f5c1c06d000
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c13400700  1 -- 172.21.15.171:0/101750487 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c01f070 con 0x7f5c1c06d000
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c009550 con 0x7f5c1c06d000
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c13400700  1 -- 172.21.15.171:0/101750487 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0045e0 con 0x7f5c1c06d000
2024-03-29T09:08:41.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.106+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c134760 con 0x7f5c1c06d000
2024-03-29T09:08:41.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.107+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c0623e0 con 0x7f5c1c06d000
2024-03-29T09:08:41.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.108+0000 7f5c13400700  1 -- 172.21.15.171:0/101750487 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f5c0c021030 con 0x7f5c1c06d000
2024-03-29T09:08:41.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.108+0000 7f5c13400700  1 -- 172.21.15.171:0/101750487 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f5c0c05d980 con 0x7f5c1c06d000
2024-03-29T09:08:41.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.112+0000 7f5c13400700  1 -- 172.21.15.171:0/101750487 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f5c0c025b60 con 0x7f5c1c06d000
2024-03-29T09:08:41.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:41.295+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "quincy"} v 0) v1 -- 0x7f5c1c067c30 con 0x7f5c1c06d000
2024-03-29T09:08:42.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.275+0000 7f5c13400700  1 -- 172.21.15.171:0/101750487 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "quincy"}]=0  v28) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5c0c015020 con 0x7f5c1c06d000
2024-03-29T09:08:42.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 >> v1:172.21.15.171:6816/44806 conn(0x7f5bfc0475f0 legacy=0x7f5bfc049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d000 msgr2=0x7f5c1c131b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d000 0x7f5c1c131b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000c00 tx=0x7f5c0c004750 comp rx=0 tx=0).stop
2024-03-29T09:08:42.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 shutdown_connections
2024-03-29T09:08:42.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c1c12e960 0x7f5c1c132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f5c1c06d000 0x7f5c1c131b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 --2- 172.21.15.171:0/101750487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c1c06d920 0x7f5c1c132040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.278+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 >> 172.21.15.171:0/101750487 conn(0x7f5c1c0a0e50 msgr2=0x7f5c1c09a8e0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:42.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.279+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 shutdown_connections
2024-03-29T09:08:42.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.279+0000 7f5c22600700  1 -- 172.21.15.171:0/101750487 wait complete.
2024-03-29T09:08:42.298 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done'
2024-03-29T09:08:42.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.489+0000 7fbb3ec00700  1  Processor -- start
2024-03-29T09:08:42.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.490+0000 7fbb3ec00700  1 --  start start
2024-03-29T09:08:42.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.490+0000 7fbb3ec00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d000 0x7fbb3806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.490+0000 7fbb3ec00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3812eb30 0x7fbb3812efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.490+0000 7fbb3ec00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3806ed80 con 0x7fbb3806d920
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.490+0000 7fbb3ec00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38066660 con 0x7fbb3812eb30
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.490+0000 7fbb3ec00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380a0b00 con 0x7fbb3806d000
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d000 0x7fbb3806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb3cc00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3812eb30 0x7fbb3812efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fbb3806d920 0x7fbb3812e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59052/0 (socket says 172.21.15.171:59052)
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37400700  1 -- 172.21.15.171:0/30817707 learned_addr learned my addr 172.21.15.171:0/30817707 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37e00700  1 -- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3812eb30 msgr2=0x7fbb3812efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37e00700  1 --2- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3812eb30 0x7fbb3812efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37e00700  1 -- 172.21.15.171:0/30817707 >> v1:172.21.15.171:6789/0 conn(0x7fbb3806d920 legacy=0x7fbb3812e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37e00700  1 -- 172.21.15.171:0/30817707 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3806dd60 con 0x7fbb3806d000
2024-03-29T09:08:42.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb3cc00700  1 --2- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3812eb30 0x7fbb3812efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:42.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb36a00700  1 -- 172.21.15.171:0/30817707 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090844871 0 0) 0x7fbb3806ed80 con 0x7fbb3806d920
2024-03-29T09:08:42.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.491+0000 7fbb37e00700  1 --2- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d000 0x7fbb3806d3e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009870 tx=0x7fbb28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=144ce4aeb73ffe10 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:42.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb36a00700  1 -- 172.21.15.171:0/30817707 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28011830 con 0x7fbb3806d000
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb36a00700  1 -- 172.21.15.171:0/30817707 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28011990 con 0x7fbb3806d000
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb36a00700  1 -- 172.21.15.171:0/30817707 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28011d20 con 0x7fbb3806d000
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 -- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d000 msgr2=0x7fbb3806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 --2- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d000 0x7fbb3806d3e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009870 tx=0x7fbb28009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 -- 172.21.15.171:0/30817707 shutdown_connections
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 --2- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d000 0x7fbb3806d3e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 --2- 172.21.15.171:0/30817707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3812eb30 0x7fbb3812efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 -- 172.21.15.171:0/30817707 >> 172.21.15.171:0/30817707 conn(0x7fbb380a0e50 msgr2=0x7fbb380a1260 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 -- 172.21.15.171:0/30817707 shutdown_connections
2024-03-29T09:08:42.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.492+0000 7fbb3ec00700  1 -- 172.21.15.171:0/30817707 wait complete.
2024-03-29T09:08:42.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.494+0000 7fbb3ec00700  1  Processor -- start
2024-03-29T09:08:42.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.494+0000 7fbb3ec00700  1 --  start start
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb3ec00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3806d000 0x7fbb38097b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb3ec00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d920 0x7fbb38098080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb3ec00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3812eb30 0x7fbb381c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb3ec00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38099af0 con 0x7fbb3812eb30
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb3ec00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3809b270 con 0x7fbb3806d000
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb3ec00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3809aad0 con 0x7fbb3806d920
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb37400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d920 0x7fbb38098080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb37e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3806d000 0x7fbb38097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb3cc00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3812eb30 0x7fbb381c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb37e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3806d000 0x7fbb38097b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42450/0 (socket says 172.21.15.171:42450)
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.495+0000 7fbb37e00700  1 -- 172.21.15.171:0/1345611615 learned_addr learned my addr 172.21.15.171:0/1345611615 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb3cc00700  1 -- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d920 msgr2=0x7fbb38098080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb3cc00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d920 0x7fbb38098080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb3cc00700  1 -- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3806d000 msgr2=0x7fbb38097b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb3cc00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3806d000 0x7fbb38097b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb3cc00700  1 -- 172.21.15.171:0/1345611615 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30009a70 con 0x7fbb3812eb30
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb37400700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d920 0x7fbb38098080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb37e00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3806d000 0x7fbb38097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb3cc00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3812eb30 0x7fbb381c2f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000efc0 tx=0x7fbb3000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb2fe00700  1 -- 172.21.15.171:0/1345611615 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000ca90 con 0x7fbb3812eb30
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb2fe00700  1 -- 172.21.15.171:0/1345611615 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3000f040 con 0x7fbb3812eb30
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb280094a0 con 0x7fbb3812eb30
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.496+0000 7fbb2fe00700  1 -- 172.21.15.171:0/1345611615 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000ce50 con 0x7fbb3812eb30
2024-03-29T09:08:42.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.497+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3809a380 con 0x7fbb3812eb30
2024-03-29T09:08:42.498 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.498+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3809a600 con 0x7fbb3812eb30
2024-03-29T09:08:42.498 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.498+0000 7fbb2fe00700  1 -- 172.21.15.171:0/1345611615 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fbb30014480 con 0x7fbb3812eb30
2024-03-29T09:08:42.498 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.498+0000 7fbb2fe00700  1 -- 172.21.15.171:0/1345611615 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fbb3005cd00 con 0x7fbb3812eb30
2024-03-29T09:08:42.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.502+0000 7fbb2fe00700  1 -- 172.21.15.171:0/1345611615 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fbb3003a6e0 con 0x7fbb3812eb30
2024-03-29T09:08:42.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.671+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fbb3806f2a0 con 0x7fbb3812eb30
2024-03-29T09:08:42.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.671+0000 7fbb2fe00700  1 -- 172.21.15.171:0/1345611615 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0  v28) v1 ==== 59+0+9 (secure 0 0 0) 0x7fbb30018070 con 0x7fbb3812eb30
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.673+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 >> v1:172.21.15.171:6816/44806 conn(0x7fbb180475f0 legacy=0x7fbb18049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.673+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3812eb30 msgr2=0x7fbb381c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.673+0000 7fbb3ec00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3812eb30 0x7fbb381c2f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000efc0 tx=0x7fbb3000c3a0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.673+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 shutdown_connections
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.673+0000 7fbb3ec00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3812eb30 0x7fbb381c2f10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.673+0000 7fbb3ec00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3806d000 0x7fbb38097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.673+0000 7fbb3ec00700  1 --2- 172.21.15.171:0/1345611615 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbb3806d920 0x7fbb38098080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.674+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 >> 172.21.15.171:0/1345611615 conn(0x7fbb380a0e50 msgr2=0x7fbb3812af80 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:42.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.674+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 shutdown_connections
2024-03-29T09:08:42.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.674+0000 7fbb3ec00700  1 -- 172.21.15.171:0/1345611615 wait complete.
2024-03-29T09:08:42.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.814+0000 7fb6d7400700  1  Processor -- start
2024-03-29T09:08:42.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.814+0000 7fb6d7400700  1 --  start start
2024-03-29T09:08:42.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6d7400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fb6d006d000 0x7fb6d006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6d7400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d012e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6d7400700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d00670a0 con 0x7fb6d012e8c0
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6d7400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d0071b80 con 0x7fb6d006d000
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6d7400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d006ed80 con 0x7fb6d006d920
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6cfe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d012e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6cfe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d012e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45338/0 (socket says 172.21.15.171:45338)
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6cfe00700  1 -- 172.21.15.171:0/513229417 learned_addr learned my addr 172.21.15.171:0/513229417 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.815+0000 7fb6d4a00700  1 --2- 172.21.15.171:0/513229417 >> v2:172.21.15.171:3300/0 conn(0x7fb6d006d000 0x7fb6d006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cfe00700  1 -- 172.21.15.171:0/513229417 >> v2:172.21.15.171:3300/0 conn(0x7fb6d006d000 msgr2=0x7fb6d006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cfe00700  1 --2- 172.21.15.171:0/513229417 >> v2:172.21.15.171:3300/0 conn(0x7fb6d006d000 0x7fb6d006d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cfe00700  1 -- 172.21.15.171:0/513229417 >> v1:172.21.15.171:6789/0 conn(0x7fb6d012e8c0 legacy=0x7fb6d012ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cfe00700  1 -- 172.21.15.171:0/513229417 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d006df20 con 0x7fb6d006d920
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cfe00700  1 --2- 172.21.15.171:0/513229417 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d012e380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0098f0 tx=0x7fb6bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bdea1315ad8413b server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:42.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cf400700  1 -- 172.21.15.171:0/513229417 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc011830 con 0x7fb6d006d920
2024-03-29T09:08:42.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cf400700  1 -- 172.21.15.171:0/513229417 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc011990 con 0x7fb6d006d920
2024-03-29T09:08:42.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.816+0000 7fb6cf400700  1 -- 172.21.15.171:0/513229417 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc011d20 con 0x7fb6d006d920
2024-03-29T09:08:42.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 -- 172.21.15.171:0/513229417 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 msgr2=0x7fb6d012e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 --2- 172.21.15.171:0/513229417 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d012e380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0098f0 tx=0x7fb6bc009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:42.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 -- 172.21.15.171:0/513229417 shutdown_connections
2024-03-29T09:08:42.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 --2- 172.21.15.171:0/513229417 >> v2:172.21.15.171:3300/0 conn(0x7fb6d006d000 0x7fb6d006d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 --2- 172.21.15.171:0/513229417 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d012e380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 -- 172.21.15.171:0/513229417 >> 172.21.15.171:0/513229417 conn(0x7fb6d00a0bd0 msgr2=0x7fb6d00a0fe0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:42.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 -- 172.21.15.171:0/513229417 shutdown_connections
2024-03-29T09:08:42.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.817+0000 7fb6d7400700  1 -- 172.21.15.171:0/513229417 wait complete.
2024-03-29T09:08:42.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.818+0000 7fb6d7400700  1  Processor -- start
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d7400700  1 --  start start
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d7400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6d006d000 0x7fb6d0128490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d7400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d01289d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d7400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6d012e8c0 0x7fb6d01c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d7400700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d012abb0 con 0x7fb6d012e8c0
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d7400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0129580 con 0x7fb6d006d000
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d7400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d012b7d0 con 0x7fb6d006d920
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d5400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6d012e8c0 0x7fb6d01c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d4a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6d006d000 0x7fb6d0128490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6cfe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d01289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d5400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6d012e8c0 0x7fb6d01c2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39200/0 (socket says 172.21.15.171:39200)
2024-03-29T09:08:42.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.819+0000 7fb6d5400700  1 -- 172.21.15.171:0/2559384254 learned_addr learned my addr 172.21.15.171:0/2559384254 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d5400700  1 -- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 msgr2=0x7fb6d01289d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d5400700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d01289d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d5400700  1 -- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6d006d000 msgr2=0x7fb6d0128490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d5400700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6d006d000 0x7fb6d0128490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d5400700  1 -- 172.21.15.171:0/2559384254 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc009550 con 0x7fb6d012e8c0
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d4a00700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6d006d000 0x7fb6d0128490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d5400700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6d012e8c0 0x7fb6d01c2d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c4d0 tx=0x7fb6c800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6ccc00700  1 -- 172.21.15.171:0/2559384254 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80052d0 con 0x7fb6d012e8c0
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6ccc00700  1 -- 172.21.15.171:0/2559384254 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8005430 con 0x7fb6d012e8c0
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6ccc00700  1 -- 172.21.15.171:0/2559384254 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80038a0 con 0x7fb6d012e8c0
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d012a460 con 0x7fb6d012e8c0
2024-03-29T09:08:42.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.820+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d0128f10 con 0x7fb6d012e8c0
2024-03-29T09:08:42.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.822+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d00623e0 con 0x7fb6d012e8c0
2024-03-29T09:08:42.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.822+0000 7fb6ccc00700  1 -- 172.21.15.171:0/2559384254 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fb6c8003a00 con 0x7fb6d012e8c0
2024-03-29T09:08:42.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.823+0000 7fb6ccc00700  1 -- 172.21.15.171:0/2559384254 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fb6c805bc10 con 0x7fb6d012e8c0
2024-03-29T09:08:42.825 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.826+0000 7fb6ccc00700  1 -- 172.21.15.171:0/2559384254 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fb6c8039820 con 0x7fb6d012e8c0
2024-03-29T09:08:42.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:42.996+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fb6d0129a60 con 0x7fb6d012e8c0
2024-03-29T09:08:43.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.275+0000 7fb6ccc00700  1 -- 172.21.15.171:0/2559384254 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v29) v1 ==== 153+0+0 (secure 0 0 0) 0x7fb6c8017030 con 0x7fb6d012e8c0
2024-03-29T09:08:43.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 >> v1:172.21.15.171:6816/44806 conn(0x7fb6b00475f0 legacy=0x7fb6b0049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:43.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6d012e8c0 msgr2=0x7fb6d01c2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:43.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6d012e8c0 0x7fb6d01c2d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c4d0 tx=0x7fb6c800c7e0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 shutdown_connections
2024-03-29T09:08:43.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6d012e8c0 0x7fb6d01c2d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6d006d000 0x7fb6d0128490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 --2- 172.21.15.171:0/2559384254 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fb6d006d920 0x7fb6d01289d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 >> 172.21.15.171:0/2559384254 conn(0x7fb6d00a0bd0 msgr2=0x7fb6d009c460 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:43.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 shutdown_connections
2024-03-29T09:08:43.278 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.278+0000 7fb6d7400700  1 -- 172.21.15.171:0/2559384254 wait complete.
2024-03-29T09:08:43.279 INFO:teuthology.orchestra.run.smithi171.stderr:set pool 1 pg_autoscale_mode to off
2024-03-29T09:08:43.419 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.420+0000 7fe1f4a00700  1  Processor -- start
2024-03-29T09:08:43.419 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.420+0000 7fe1f4a00700  1 --  start start
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.420+0000 7fe1f4a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f006ce40 0x7fe1f006d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.420+0000 7fe1f4a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f00967c0 0x7fe1f01346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.420+0000 7fe1f4a00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f0098bc0 con 0x7fe1f006d760
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.420+0000 7fe1f4a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00994d0 con 0x7fe1f00967c0
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1f4a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0071790 con 0x7fe1f006ce40
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ed400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fe1f006d760 0x7fe1f00960b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59080/0 (socket says 172.21.15.171:59080)
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ed400700  1 -- 172.21.15.171:0/834747543 learned_addr learned my addr 172.21.15.171:0/834747543 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:43.421 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ee800700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f00967c0 0x7fe1f01346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ede00700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f006ce40 0x7fe1f006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ede00700  1 -- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f00967c0 msgr2=0x7fe1f01346a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ede00700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f00967c0 0x7fe1f01346a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ede00700  1 -- 172.21.15.171:0/834747543 >> v1:172.21.15.171:6789/0 conn(0x7fe1f006d760 legacy=0x7fe1f00960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ede00700  1 -- 172.21.15.171:0/834747543 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0099190 con 0x7fe1f006ce40
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1ee800700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f00967c0 0x7fe1f01346a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.421+0000 7fe1eca00700  1 -- 172.21.15.171:0/834747543 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260524266 0 0) 0x7fe1f0098bc0 con 0x7fe1f006d760
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1ede00700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f006ce40 0x7fe1f006d220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009870 tx=0x7fe1e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9397765c2b5bad87 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1eca00700  1 -- 172.21.15.171:0/834747543 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0011830 con 0x7fe1f006ce40
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1eca00700  1 -- 172.21.15.171:0/834747543 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0011990 con 0x7fe1f006ce40
2024-03-29T09:08:43.422 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1eca00700  1 -- 172.21.15.171:0/834747543 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0011d20 con 0x7fe1f006ce40
2024-03-29T09:08:43.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1f4a00700  1 -- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f006ce40 msgr2=0x7fe1f006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:43.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1f4a00700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f006ce40 0x7fe1f006d220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009870 tx=0x7fe1e0009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:43.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1f4a00700  1 -- 172.21.15.171:0/834747543 shutdown_connections
2024-03-29T09:08:43.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1f4a00700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f006ce40 0x7fe1f006d220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1f4a00700  1 --2- 172.21.15.171:0/834747543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f00967c0 0x7fe1f01346a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1f4a00700  1 -- 172.21.15.171:0/834747543 >> 172.21.15.171:0/834747543 conn(0x7fe1f006abf0 msgr2=0x7fe1f006b000 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:43.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.422+0000 7fe1f4a00700  1 -- 172.21.15.171:0/834747543 shutdown_connections
2024-03-29T09:08:43.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.423+0000 7fe1f4a00700  1 -- 172.21.15.171:0/834747543 wait complete.
2024-03-29T09:08:43.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.424+0000 7fe1f4a00700  1  Processor -- start
2024-03-29T09:08:43.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.424+0000 7fe1f4a00700  1 --  start start
2024-03-29T09:08:43.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1f4a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f006ce40 0x7fe1f008fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1f4a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1f006d760 0x7fe1f00902e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1f4a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f00967c0 0x7fe1f0090820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1f4a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0095fb0 con 0x7fe1f006d760
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1f4a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0093180 con 0x7fe1f006ce40
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1f4a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00918c0 con 0x7fe1f00967c0
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ede00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f006ce40 0x7fe1f008fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ee800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f00967c0 0x7fe1f0090820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ede00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f006ce40 0x7fe1f008fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42492/0 (socket says 172.21.15.171:42492)
2024-03-29T09:08:43.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ede00700  1 -- 172.21.15.171:0/3535607247 learned_addr learned my addr 172.21.15.171:0/3535607247 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ed400700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1f006d760 0x7fe1f00902e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ee800700  1 -- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f006ce40 msgr2=0x7fe1f008fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ee800700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f006ce40 0x7fe1f008fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ee800700  1 -- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1f006d760 msgr2=0x7fe1f00902e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ee800700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1f006d760 0x7fe1f00902e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ee800700  1 -- 172.21.15.171:0/3535607247 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e8009a70 con 0x7fe1f00967c0
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.425+0000 7fe1ede00700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f006ce40 0x7fe1f008fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.426+0000 7fe1ee800700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f00967c0 0x7fe1f0090820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800efc0 tx=0x7fe1e800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.426+0000 7fe1e6000700  1 -- 172.21.15.171:0/3535607247 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800ca90 con 0x7fe1f00967c0
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.426+0000 7fe1e6000700  1 -- 172.21.15.171:0/3535607247 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800f040 con 0x7fe1f00967c0
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.426+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e00094a0 con 0x7fe1f00967c0
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.426+0000 7fe1e6000700  1 -- 172.21.15.171:0/3535607247 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800ce30 con 0x7fe1f00967c0
2024-03-29T09:08:43.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.426+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f01c2f10 con 0x7fe1f00967c0
2024-03-29T09:08:43.428 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.427+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f00623e0 con 0x7fe1f00967c0
2024-03-29T09:08:43.428 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.427+0000 7fe1e6000700  1 -- 172.21.15.171:0/3535607247 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fe1e8014480 con 0x7fe1f00967c0
2024-03-29T09:08:43.428 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.428+0000 7fe1e6000700  1 -- 172.21.15.171:0/3535607247 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fe1e805cd70 con 0x7fe1f00967c0
2024-03-29T09:08:43.430 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.431+0000 7fe1e6000700  1 -- 172.21.15.171:0/3535607247 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fe1e803a9c0 con 0x7fe1f00967c0
2024-03-29T09:08:43.598 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:43.598+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fe1f006f5e0 con 0x7fe1f00967c0
2024-03-29T09:08:44.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.283+0000 7fe1e6000700  1 -- 172.21.15.171:0/3535607247 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v30) v1 ==== 152+0+0 (secure 0 0 0) 0x7fe1e8018030 con 0x7fe1f00967c0
2024-03-29T09:08:44.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.285+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 >> v1:172.21.15.171:6816/44806 conn(0x7fe1d00475f0 legacy=0x7fe1d0049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.285+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f00967c0 msgr2=0x7fe1f0090820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.285+0000 7fe1f4a00700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f00967c0 0x7fe1f0090820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800efc0 tx=0x7fe1e800c3a0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.286+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 shutdown_connections
2024-03-29T09:08:44.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.286+0000 7fe1f4a00700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe1f00967c0 0x7fe1f0090820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.286+0000 7fe1f4a00700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1f006ce40 0x7fe1f008fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.286+0000 7fe1f4a00700  1 --2- 172.21.15.171:0/3535607247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1f006d760 0x7fe1f00902e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.286+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 >> 172.21.15.171:0/3535607247 conn(0x7fe1f006abf0 msgr2=0x7fe1f009b2b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:44.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.286+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 shutdown_connections
2024-03-29T09:08:44.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.286+0000 7fe1f4a00700  1 -- 172.21.15.171:0/3535607247 wait complete.
2024-03-29T09:08:44.286 INFO:teuthology.orchestra.run.smithi171.stderr:set pool 2 pg_autoscale_mode to off
2024-03-29T09:08:44.307 INFO:teuthology.run_tasks:Running task ceph.healthy...
2024-03-29T09:08:44.318 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean...
2024-03-29T09:08:44.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available
2024-03-29T09:08:44.318 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json
2024-03-29T09:08:44.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.514+0000 7f9db3200700  1  Processor -- start
2024-03-29T09:08:44.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9db3200700  1 --  start start
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9db3200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac06f830 0x7f9dac06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9db3200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac070150 0x7f9dac12e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9db3200700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac071b70 con 0x7f9dac12e9a0
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9db3200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0716a0 con 0x7f9dac070150
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9db3200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0673a0 con 0x7f9dac06f830
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9dabe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac06f830 0x7f9dac06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9dab400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac070150 0x7f9dac12e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9dabe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac06f830 0x7f9dac06fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45380/0 (socket says 172.21.15.171:45380)
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.515+0000 7f9dabe00700  1 -- 172.21.15.171:0/1387074778 learned_addr learned my addr 172.21.15.171:0/1387074778 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9dabe00700  1 -- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac070150 msgr2=0x7f9dac12e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9dabe00700  1 --2- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac070150 0x7f9dac12e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9dabe00700  1 -- 172.21.15.171:0/1387074778 >> v1:172.21.15.171:6789/0 conn(0x7f9dac12e9a0 legacy=0x7f9dac12ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9dabe00700  1 -- 172.21.15.171:0/1387074778 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac09e4e0 con 0x7f9dac06f830
2024-03-29T09:08:44.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9dab400700  1 --2- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac070150 0x7f9dac12e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:44.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9daaa00700  1 -- 172.21.15.171:0/1387074778 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684825991 0 0) 0x7f9dac071b70 con 0x7f9dac12e9a0
2024-03-29T09:08:44.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9dabe00700  1 --2- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac06f830 0x7f9dac06fc10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009920 tx=0x7f9d9c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483bcbe37aa0f34 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:44.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9daaa00700  1 -- 172.21.15.171:0/1387074778 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c011830 con 0x7f9dac06f830
2024-03-29T09:08:44.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9daaa00700  1 -- 172.21.15.171:0/1387074778 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c011990 con 0x7f9dac06f830
2024-03-29T09:08:44.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.516+0000 7f9daaa00700  1 -- 172.21.15.171:0/1387074778 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c011d20 con 0x7f9dac06f830
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 -- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac06f830 msgr2=0x7f9dac06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 --2- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac06f830 0x7f9dac06fc10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009920 tx=0x7f9d9c009c30 comp rx=0 tx=0).stop
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 -- 172.21.15.171:0/1387074778 shutdown_connections
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 --2- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac06f830 0x7f9dac06fc10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 --2- 172.21.15.171:0/1387074778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac070150 0x7f9dac12e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 -- 172.21.15.171:0/1387074778 >> 172.21.15.171:0/1387074778 conn(0x7f9dac09d9c0 msgr2=0x7f9dac09ddd0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 -- 172.21.15.171:0/1387074778 shutdown_connections
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.517+0000 7f9db3200700  1 -- 172.21.15.171:0/1387074778 wait complete.
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.518+0000 7f9db3200700  1  Processor -- start
2024-03-29T09:08:44.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db3200700  1 --  start start
2024-03-29T09:08:44.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db3200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac06f830 0x7f9dac1bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db3200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dac070150 0x7f9dac1c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db3200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac12e9a0 0x7f9dac1c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db3200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac12f540 con 0x7f9dac070150
2024-03-29T09:08:44.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db3200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac12fe60 con 0x7f9dac06f830
2024-03-29T09:08:44.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db3200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac136190 con 0x7f9dac12e9a0
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9dabe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac06f830 0x7f9dac1bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9dabe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac06f830 0x7f9dac1bfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42514/0 (socket says 172.21.15.171:42514)
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9dabe00700  1 -- 172.21.15.171:0/4258977542 learned_addr learned my addr 172.21.15.171:0/4258977542 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9db1200700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac12e9a0 0x7f9dac1c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.519+0000 7f9dab400700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dac070150 0x7f9dac1c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9dabe00700  1 -- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac12e9a0 msgr2=0x7f9dac1c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9dabe00700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac12e9a0 0x7f9dac1c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9dabe00700  1 -- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dac070150 msgr2=0x7f9dac1c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9dabe00700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dac070150 0x7f9dac1c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9dabe00700  1 -- 172.21.15.171:0/4258977542 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980094a0 con 0x7f9dac06f830
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9dabe00700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac06f830 0x7f9dac1bfb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009130 tx=0x7f9d9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9da3e00700  1 -- 172.21.15.171:0/4258977542 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c004450 con 0x7f9dac06f830
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9da3e00700  1 -- 172.21.15.171:0/4258977542 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c01f070 con 0x7f9dac06f830
2024-03-29T09:08:44.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c009550 con 0x7f9dac06f830
2024-03-29T09:08:44.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.520+0000 7f9da3e00700  1 -- 172.21.15.171:0/4258977542 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0038c0 con 0x7f9dac06f830
2024-03-29T09:08:44.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.521+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac0712c0 con 0x7f9dac06f830
2024-03-29T09:08:44.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.522+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac0623e0 con 0x7f9dac06f830
2024-03-29T09:08:44.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.522+0000 7f9da3e00700  1 -- 172.21.15.171:0/4258977542 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f9d9c003a20 con 0x7f9dac06f830
2024-03-29T09:08:44.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.522+0000 7f9da3e00700  1 -- 172.21.15.171:0/4258977542 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f9d9c021070 con 0x7f9dac06f830
2024-03-29T09:08:44.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.527+0000 7f9da3e00700  1 -- 172.21.15.171:0/4258977542 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f9d9c0045b0 con 0x7f9dac06f830
2024-03-29T09:08:44.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.736+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9dac128b80 con 0x7f9dac06f830
2024-03-29T09:08:44.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.739+0000 7f9da3e00700  1 -- 172.21.15.171:0/4258977542 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0  v9) v1 ==== 74+0+107677 (secure 0 0 0) 0x7f9d9c0045b0 con 0x7f9dac06f830
2024-03-29T09:08:44.739 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:44.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 >> v1:172.21.15.171:6816/44806 conn(0x7f9d8c0475f0 legacy=0x7f9d8c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac06f830 msgr2=0x7f9dac1bfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac06f830 0x7f9dac1bfb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009130 tx=0x7f9d9c004750 comp rx=0 tx=0).stop
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 shutdown_connections
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9dac12e9a0 0x7f9dac1c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dac06f830 0x7f9dac1bfb30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 --2- 172.21.15.171:0/4258977542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dac070150 0x7f9dac1c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 >> 172.21.15.171:0/4258977542 conn(0x7f9dac09d9c0 msgr2=0x7f9dac12afc0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 shutdown_connections
2024-03-29T09:08:44.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.741+0000 7f9db3200700  1 -- 172.21.15.171:0/4258977542 wait complete.
2024-03-29T09:08:44.758 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":9,"active_gid":14098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6816","nonce":44806}]},"active_addr":"172.21.15.171:6816/44806","active_change":"2024-03-29T09:08:24.052267+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14105,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB.  Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB.  Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":14,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":1505312219}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":3485953949}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":1274221889}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":3924076251}]}]}
2024-03-29T09:08:44.761 INFO:tasks.ceph.ceph_manager.ceph:mgr available!
2024-03-29T09:08:44.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up
2024-03-29T09:08:44.761 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:44.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.953+0000 7f9104c00700  1  Processor -- start
2024-03-29T09:08:44.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.953+0000 7f9104c00700  1 --  start start
2024-03-29T09:08:44.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f9104c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f910012ee90 0x7f9100133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f9104c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f9104c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9100071520 con 0x7f910012e3a0
2024-03-29T09:08:44.954 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f9104c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9100070d80 con 0x7f910012ee90
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f9104c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91000722b0 con 0x7f9100133c60
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f90fd400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f910012ee90 0x7f9100133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f90fe800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f90fd400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f910012ee90 0x7f9100133720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39230/0 (socket says 172.21.15.171:39230)
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f90fd400700  1 -- 172.21.15.171:0/3985799995 learned_addr learned my addr 172.21.15.171:0/3985799995 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.954+0000 7f90fe800700  1 -- 172.21.15.171:0/3985799995 >> v2:172.21.15.171:3300/0 conn(0x7f910012ee90 msgr2=0x7f9100133720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fe800700  1 --2- 172.21.15.171:0/3985799995 >> v2:172.21.15.171:3300/0 conn(0x7f910012ee90 0x7f9100133720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fe800700  1 -- 172.21.15.171:0/3985799995 >> v1:172.21.15.171:6789/0 conn(0x7f910012e3a0 legacy=0x7f910012e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fe800700  1 -- 172.21.15.171:0/3985799995 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100071b40 con 0x7f9100133c60
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fca00700  1 -- 172.21.15.171:0/3985799995 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758740571 0 0) 0x7f9100071520 con 0x7f910012e3a0
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fd400700  1 --2- 172.21.15.171:0/3985799995 >> v2:172.21.15.171:3300/0 conn(0x7f910012ee90 0x7f9100133720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fe800700  1 --2- 172.21.15.171:0/3985799995 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100136050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009d90 tx=0x7f90f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1802b4c453492895 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fca00700  1 -- 172.21.15.171:0/3985799995 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f800e070 con 0x7f9100133c60
2024-03-29T09:08:44.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fca00700  1 -- 172.21.15.171:0/3985799995 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f800bb20 con 0x7f9100133c60
2024-03-29T09:08:44.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.955+0000 7f90fca00700  1 -- 172.21.15.171:0/3985799995 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8012430 con 0x7f9100133c60
2024-03-29T09:08:44.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 -- 172.21.15.171:0/3985799995 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 msgr2=0x7f9100136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 --2- 172.21.15.171:0/3985799995 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100136050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009d90 tx=0x7f90f800b330 comp rx=0 tx=0).stop
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 -- 172.21.15.171:0/3985799995 shutdown_connections
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 --2- 172.21.15.171:0/3985799995 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100136050 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 --2- 172.21.15.171:0/3985799995 >> v2:172.21.15.171:3300/0 conn(0x7f910012ee90 0x7f9100133720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 -- 172.21.15.171:0/3985799995 >> 172.21.15.171:0/3985799995 conn(0x7f91000a0d70 msgr2=0x7f91000a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 -- 172.21.15.171:0/3985799995 shutdown_connections
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.956+0000 7f9104c00700  1 -- 172.21.15.171:0/3985799995 wait complete.
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.957+0000 7f9104c00700  1  Processor -- start
2024-03-29T09:08:44.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.957+0000 7f9104c00700  1 --  start start
2024-03-29T09:08:44.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f9104c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f910012e3a0 0x7f9100123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f9104c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f910012ee90 0x7f9100123860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f9104c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100123da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:44.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f9104c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9100128570 con 0x7f910012ee90
2024-03-29T09:08:44.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f9104c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91001243a0 con 0x7f910012e3a0
2024-03-29T09:08:44.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f9104c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9100121c10 con 0x7f9100133c60
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f910012ee90 0x7f9100123860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fde00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f910012e3a0 0x7f9100123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f910012ee90 0x7f9100123860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39232/0 (socket says 172.21.15.171:39232)
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fde00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f910012e3a0 0x7f9100123320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42522/0 (socket says 172.21.15.171:42522)
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 -- 172.21.15.171:0/2871726110 learned_addr learned my addr 172.21.15.171:0/2871726110 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fe800700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100123da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 -- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 msgr2=0x7f9100123da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100123da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 -- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f910012e3a0 msgr2=0x7f9100123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f910012e3a0 0x7f9100123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fd400700  1 -- 172.21.15.171:0/2871726110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009550 con 0x7f910012ee90
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.958+0000 7f90fde00700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f910012e3a0 0x7f9100123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.959+0000 7f90fd400700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f910012ee90 0x7f9100123860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00ebe0 tx=0x7f90ec00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.959+0000 7f90f6000700  1 -- 172.21.15.171:0/2871726110 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec00c850 con 0x7f910012ee90
2024-03-29T09:08:44.960 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.959+0000 7f90f6000700  1 -- 172.21.15.171:0/2871726110 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec00c9b0 con 0x7f910012ee90
2024-03-29T09:08:44.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.959+0000 7f90f6000700  1 -- 172.21.15.171:0/2871726110 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec00cd40 con 0x7f910012ee90
2024-03-29T09:08:44.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.959+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f8009a70 con 0x7f910012ee90
2024-03-29T09:08:44.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.959+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9100122690 con 0x7f910012ee90
2024-03-29T09:08:44.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.960+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91001171d0 con 0x7f910012ee90
2024-03-29T09:08:44.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.960+0000 7f90f6000700  1 -- 172.21.15.171:0/2871726110 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f90ec013470 con 0x7f910012ee90
2024-03-29T09:08:44.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.961+0000 7f90f6000700  1 -- 172.21.15.171:0/2871726110 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f90ec05ca20 con 0x7f910012ee90
2024-03-29T09:08:44.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:44.965+0000 7f90f6000700  1 -- 172.21.15.171:0/2871726110 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f90ec03a5d0 con 0x7f910012ee90
2024-03-29T09:08:45.134 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.135+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f910012ecb0 con 0x7f910012ee90
2024-03-29T09:08:45.135 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.136+0000 7f90f6000700  1 -- 172.21.15.171:0/2871726110 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v30) v1 ==== 74+0+8811 (secure 0 0 0) 0x7f90ec017030 con 0x7f910012ee90
2024-03-29T09:08:45.135 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:45.135 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":30,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T09:08:44.274815+0000","last_up_change":"2024-03-29T09:08:39.240872+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":46596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":46596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":46596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":46596}]},"public_addr":"172.21.15.171:6800/46596","cluster_addr":"172.21.15.171:6801/46596","heartbeat_back_addr":"172.21.15.171:6803/46596","heartbeat_front_addr":"172.21.15.171:6802/46596","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":24,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":46686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":46686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":46686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":46686}]},"public_addr":"172.21.15.171:6804/46686","cluster_addr":"172.21.15.171:6805/46686","heartbeat_back_addr":"172.21.15.171:6807/46686","heartbeat_front_addr":"172.21.15.171:6806/46686","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":46803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":46803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":46803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":46803}]},"public_addr":"172.21.15.171:6808/46803","cluster_addr":"172.21.15.171:6809/46803","heartbeat_back_addr":"172.21.15.171:6811/46803","heartbeat_front_addr":"172.21.15.171:6810/46803","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":26,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":46965}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":46965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":46965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":46965}]},"public_addr":"172.21.15.171:6812/46965","cluster_addr":"172.21.15.171:6813/46965","heartbeat_back_addr":"172.21.15.171:6815/46965","heartbeat_front_addr":"172.21.15.171:6814/46965","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":19},{"osd":3,"down_stamp":"2024-03-29T09:08:32.109013+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:0/4094087308":"2024-03-30T09:08:24.052102+0000","172.21.15.171:0/4287724647":"2024-03-30T09:08:24.052102+0000","172.21.15.171:6816/38531":"2024-03-30T09:08:24.052102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 >> v1:172.21.15.171:6816/44806 conn(0x7f90e00475f0 legacy=0x7f90e0049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f910012ee90 msgr2=0x7f9100123860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f910012ee90 0x7f9100123860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00ebe0 tx=0x7f90ec00eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 shutdown_connections
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f9100133c60 0x7f9100123da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f910012e3a0 0x7f9100123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 --2- 172.21.15.171:0/2871726110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f910012ee90 0x7f9100123860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 >> 172.21.15.171:0/2871726110 conn(0x7f91000a0d70 msgr2=0x7f910006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 shutdown_connections
2024-03-29T09:08:45.138 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.138+0000 7f9104c00700  1 -- 172.21.15.171:0/2871726110 wait complete.
2024-03-29T09:08:45.156 INFO:tasks.ceph.ceph_manager.ceph:all up!
2024-03-29T09:08:45.156 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:45.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.350+0000 7f4d46600700  1  Processor -- start
2024-03-29T09:08:45.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.350+0000 7f4d46600700  1 --  start start
2024-03-29T09:08:45.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d46600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d4012ee90 0x7f4d40133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d46600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d40133c60 0x7f4d40136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d46600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d40071520 con 0x7f4d4012e3a0
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d46600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40070d80 con 0x7f4d4012ee90
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d46600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400722b0 con 0x7f4d40133c60
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3ea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d4012ee90 0x7f4d40133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3f400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f4d4012e3a0 0x7f4d4012e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59112/0 (socket says 172.21.15.171:59112)
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3f400700  1 -- 172.21.15.171:0/1214751855 learned_addr learned my addr 172.21.15.171:0/1214751855 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3fe00700  1 --2- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d40133c60 0x7f4d40136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3e000700  1 -- 172.21.15.171:0/1214751855 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113306447 0 0) 0x7f4d40071520 con 0x7f4d4012e3a0
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3ea00700  1 -- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d40133c60 msgr2=0x7f4d40136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3ea00700  1 --2- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d40133c60 0x7f4d40136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3ea00700  1 -- 172.21.15.171:0/1214751855 >> v1:172.21.15.171:6789/0 conn(0x7f4d4012e3a0 legacy=0x7f4d4012e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3ea00700  1 -- 172.21.15.171:0/1214751855 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40071b40 con 0x7f4d4012ee90
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.351+0000 7f4d3fe00700  1 --2- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d40133c60 0x7f4d40136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.352+0000 7f4d3ea00700  1 --2- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d4012ee90 0x7f4d40133720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009870 tx=0x7f4d2c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=193c035a0110618d server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.352+0000 7f4d3e000700  1 -- 172.21.15.171:0/1214751855 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011830 con 0x7f4d4012ee90
2024-03-29T09:08:45.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.352+0000 7f4d3e000700  1 -- 172.21.15.171:0/1214751855 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c011990 con 0x7f4d4012ee90
2024-03-29T09:08:45.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.352+0000 7f4d3e000700  1 -- 172.21.15.171:0/1214751855 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011d20 con 0x7f4d4012ee90
2024-03-29T09:08:45.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.352+0000 7f4d46600700  1 -- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d4012ee90 msgr2=0x7f4d40133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.352+0000 7f4d46600700  1 --2- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d4012ee90 0x7f4d40133720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009870 tx=0x7f4d2c009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:45.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.353+0000 7f4d46600700  1 -- 172.21.15.171:0/1214751855 shutdown_connections
2024-03-29T09:08:45.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.353+0000 7f4d46600700  1 --2- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d40133c60 0x7f4d40136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.353+0000 7f4d46600700  1 --2- 172.21.15.171:0/1214751855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d4012ee90 0x7f4d40133720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.353+0000 7f4d46600700  1 -- 172.21.15.171:0/1214751855 >> 172.21.15.171:0/1214751855 conn(0x7f4d400a0d70 msgr2=0x7f4d400a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.353+0000 7f4d46600700  1 -- 172.21.15.171:0/1214751855 shutdown_connections
2024-03-29T09:08:45.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.353+0000 7f4d46600700  1 -- 172.21.15.171:0/1214751855 wait complete.
2024-03-29T09:08:45.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.354+0000 7f4d46600700  1  Processor -- start
2024-03-29T09:08:45.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.355+0000 7f4d46600700  1 --  start start
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.355+0000 7f4d46600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d4012e3a0 0x7f4d4012f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.355+0000 7f4d46600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d4012ee90 0x7f4d4012f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d46600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d40133c60 0x7f4d4012fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d46600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40130700 con 0x7f4d4012ee90
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d46600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40135e90 con 0x7f4d40133c60
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d46600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40131db0 con 0x7f4d4012e3a0
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3f400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d4012e3a0 0x7f4d4012f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3fe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d40133c60 0x7f4d4012fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3ea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d4012ee90 0x7f4d4012f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3ea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d4012ee90 0x7f4d4012f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39240/0 (socket says 172.21.15.171:39240)
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3f400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d4012e3a0 0x7f4d4012f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45416/0 (socket says 172.21.15.171:45416)
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3fe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d40133c60 0x7f4d4012fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42550/0 (socket says 172.21.15.171:42550)
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3ea00700  1 -- 172.21.15.171:0/490133218 learned_addr learned my addr 172.21.15.171:0/490133218 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3f400700  1 -- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d40133c60 msgr2=0x7f4d4012fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3f400700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d40133c60 0x7f4d4012fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3f400700  1 -- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d4012ee90 msgr2=0x7f4d4012f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3f400700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d4012ee90 0x7f4d4012f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3f400700  1 -- 172.21.15.171:0/490133218 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38009a70 con 0x7f4d4012e3a0
2024-03-29T09:08:45.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3fe00700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d40133c60 0x7f4d4012fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:45.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.356+0000 7f4d3ea00700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d4012ee90 0x7f4d4012f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:45.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.357+0000 7f4d3f400700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d4012e3a0 0x7f4d4012f410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c470 tx=0x7f4d3000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.357+0000 7f4d37400700  1 -- 172.21.15.171:0/490133218 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30004c80 con 0x7f4d4012e3a0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.357+0000 7f4d37400700  1 -- 172.21.15.171:0/490133218 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30004de0 con 0x7f4d4012e3a0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.357+0000 7f4d37400700  1 -- 172.21.15.171:0/490133218 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30007310 con 0x7f4d4012e3a0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.357+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c0094a0 con 0x7f4d4012e3a0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.357+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d40130ce0 con 0x7f4d4012e3a0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.358+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d401171d0 con 0x7f4d4012e3a0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.358+0000 7f4d37400700  1 -- 172.21.15.171:0/490133218 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f4d30007470 con 0x7f4d4012e3a0
2024-03-29T09:08:45.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.359+0000 7f4d37400700  1 -- 172.21.15.171:0/490133218 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f4d3005c360 con 0x7f4d4012e3a0
2024-03-29T09:08:45.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.363+0000 7f4d37400700  1 -- 172.21.15.171:0/490133218 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f4d30039da0 con 0x7f4d4012e3a0
2024-03-29T09:08:45.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.536+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d4012a4a0 con 0x7f4d4012e3a0
2024-03-29T09:08:45.536 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.537+0000 7f4d37400700  1 -- 172.21.15.171:0/490133218 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v30) v1 ==== 74+0+8811 (secure 0 0 0) 0x7f4d30007720 con 0x7f4d4012e3a0
2024-03-29T09:08:45.537 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:45.537 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":30,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T09:08:44.274815+0000","last_up_change":"2024-03-29T09:08:39.240872+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":46596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":46596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":46596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":46596}]},"public_addr":"172.21.15.171:6800/46596","cluster_addr":"172.21.15.171:6801/46596","heartbeat_back_addr":"172.21.15.171:6803/46596","heartbeat_front_addr":"172.21.15.171:6802/46596","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":24,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":46686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":46686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":46686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":46686}]},"public_addr":"172.21.15.171:6804/46686","cluster_addr":"172.21.15.171:6805/46686","heartbeat_back_addr":"172.21.15.171:6807/46686","heartbeat_front_addr":"172.21.15.171:6806/46686","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":46803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":46803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":46803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":46803}]},"public_addr":"172.21.15.171:6808/46803","cluster_addr":"172.21.15.171:6809/46803","heartbeat_back_addr":"172.21.15.171:6811/46803","heartbeat_front_addr":"172.21.15.171:6810/46803","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":26,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":46965}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":46965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":46965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":46965}]},"public_addr":"172.21.15.171:6812/46965","cluster_addr":"172.21.15.171:6813/46965","heartbeat_back_addr":"172.21.15.171:6815/46965","heartbeat_front_addr":"172.21.15.171:6814/46965","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":19},{"osd":3,"down_stamp":"2024-03-29T09:08:32.109013+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:0/4094087308":"2024-03-30T09:08:24.052102+0000","172.21.15.171:0/4287724647":"2024-03-30T09:08:24.052102+0000","172.21.15.171:6816/38531":"2024-03-30T09:08:24.052102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 >> v1:172.21.15.171:6816/44806 conn(0x7f4d200475f0 legacy=0x7f4d20049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d4012e3a0 msgr2=0x7f4d4012f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d4012e3a0 0x7f4d4012f410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c470 tx=0x7f4d3000c780 comp rx=0 tx=0).stop
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 shutdown_connections
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d40133c60 0x7f4d4012fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4d4012e3a0 0x7f4d4012f410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 --2- 172.21.15.171:0/490133218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d4012ee90 0x7f4d4012f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 >> 172.21.15.171:0/490133218 conn(0x7f4d400a0d70 msgr2=0x7f4d4012d010 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.539+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 shutdown_connections
2024-03-29T09:08:45.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.540+0000 7f4d46600700  1 -- 172.21.15.171:0/490133218 wait complete.
2024-03-29T09:08:45.559 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats
2024-03-29T09:08:45.559 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats
2024-03-29T09:08:45.560 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats
2024-03-29T09:08:45.560 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats
2024-03-29T09:08:45.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.773+0000 7f1141c00700  1  Processor -- start
2024-03-29T09:08:45.772 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.773+0000 7f421e800700  1  Processor -- start
2024-03-29T09:08:45.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.773+0000 7f1141c00700  1 --  start start
2024-03-29T09:08:45.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.773+0000 7f421e800700  1 --  start start
2024-03-29T09:08:45.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.773+0000 7f421e800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f4218070320 0x7f4218133780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.773+0000 7f421e800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 0x7f42181360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.773+0000 7f1141c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f113c06d310 0x7f113c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f1141c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f1141c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c06ecc0 con 0x7f113c06dc30
2024-03-29T09:08:45.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f1141c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113c06f480 con 0x7f113c06d310
2024-03-29T09:08:45.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f1141c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c098a80 con 0x7f113c12f0d0
2024-03-29T09:08:45.774 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f421e800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4218071b70 con 0x7f421806f830
2024-03-29T09:08:45.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f421e800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42180716a0 con 0x7f4218070320
2024-03-29T09:08:45.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f421e800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180673a0 con 0x7f4218133cc0
2024-03-29T09:08:45.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f113aa00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f113c06d310 0x7f113c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f113aa00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f113c06d310 0x7f113c06d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39250/0 (socket says 172.21.15.171:39250)
2024-03-29T09:08:45.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f113aa00700  1 -- 172.21.15.171:0/602924292 learned_addr learned my addr 172.21.15.171:0/602924292 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.775 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f4217400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f421806f830 0x7f421806fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59128/0 (socket says 172.21.15.171:59128)
2024-03-29T09:08:45.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f113b400700  1 --2- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f4217400700  1 -- 172.21.15.171:0/464615908 learned_addr learned my addr 172.21.15.171:0/464615908 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:45.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f4216a00700  1 --2- 172.21.15.171:0/464615908 >> v2:172.21.15.171:3300/0 conn(0x7f4218070320 0x7f4218133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.774+0000 7f4217e00700  1 --2- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 0x7f42181360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f113aa00700  1 -- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 msgr2=0x7f113c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:45.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f4216000700  1 -- 172.21.15.171:0/464615908 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735721402 0 0) 0x7f4218071b70 con 0x7f421806f830
2024-03-29T09:08:45.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f4216000700  1 -- 172.21.15.171:0/464615908 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41fc0035b0 con 0x7f421806f830
2024-03-29T09:08:45.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f4216a00700  1 -- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 msgr2=0x7f42181360b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:45.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f4216000700  1 -- 172.21.15.171:0/464615908 <== mon.0 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061676104 0 0) 0x7f41fc0035b0 con 0x7f421806f830
2024-03-29T09:08:45.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f113aa00700  1 --2- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f113aa00700  1 -- 172.21.15.171:0/602924292 >> v1:172.21.15.171:6789/0 conn(0x7f113c06dc30 legacy=0x7f113c12e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f113aa00700  1 -- 172.21.15.171:0/602924292 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c06f9d0 con 0x7f113c06d310
2024-03-29T09:08:45.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f1139600700  1 -- 172.21.15.171:0/602924292 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323531099 0 0) 0x7f113c06ecc0 con 0x7f113c06dc30
2024-03-29T09:08:45.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f113b400700  1 --2- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:45.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.775+0000 7f4216a00700  1 --2- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 0x7f42181360b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f4216a00700  1 -- 172.21.15.171:0/464615908 >> v1:172.21.15.171:6789/0 conn(0x7f421806f830 legacy=0x7f421806fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f4216a00700  1 -- 172.21.15.171:0/464615908 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421809e4e0 con 0x7f4218070320
2024-03-29T09:08:45.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f4217e00700  1 --2- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 0x7f42181360b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:45.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f4216a00700  1 --2- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4218070320 0x7f4218133780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4204009840 tx=0x7f4204009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf83fae085923b9 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f113aa00700  1 --2- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06d310 0x7f113c06d6f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852c2af618c2a141 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f4216000700  1 -- 172.21.15.171:0/464615908 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208001670 con 0x7f4218070320
2024-03-29T09:08:45.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f4216000700  1 -- 172.21.15.171:0/464615908 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204004030 con 0x7f4218070320
2024-03-29T09:08:45.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f4216000700  1 -- 172.21.15.171:0/464615908 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42040043c0 con 0x7f4218070320
2024-03-29T09:08:45.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f1139600700  1 -- 172.21.15.171:0/602924292 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c00b8a0 con 0x7f113c06d310
2024-03-29T09:08:45.781 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f1139600700  1 -- 172.21.15.171:0/602924292 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c00ba00 con 0x7f113c06d310
2024-03-29T09:08:45.781 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.776+0000 7f1139600700  1 -- 172.21.15.171:0/602924292 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c00bd90 con 0x7f113c06d310
2024-03-29T09:08:45.781 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f1141c00700  1 -- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06d310 msgr2=0x7f113c06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.781 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f1141c00700  1 --2- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06d310 0x7f113c06d6f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:45.781 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f421e800700  1 -- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4218070320 msgr2=0x7f4218133780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.781 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f421e800700  1 --2- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4218070320 0x7f4218133780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4204009840 tx=0x7f4204009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f1141c00700  1 -- 172.21.15.171:0/602924292 shutdown_connections
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f1141c00700  1 --2- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06d310 0x7f113c06d6f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f1141c00700  1 --2- 172.21.15.171:0/602924292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f1141c00700  1 -- 172.21.15.171:0/602924292 >> 172.21.15.171:0/602924292 conn(0x7f113c0978d0 msgr2=0x7f113c097ce0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f421e800700  1 -- 172.21.15.171:0/464615908 shutdown_connections
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f421e800700  1 --2- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 0x7f42181360b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f421e800700  1 --2- 172.21.15.171:0/464615908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4218070320 0x7f4218133780 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.782 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f421e800700  1 -- 172.21.15.171:0/464615908 >> 172.21.15.171:0/464615908 conn(0x7f421809d9c0 msgr2=0x7f421809ddd0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.777+0000 7f1141c00700  1 -- 172.21.15.171:0/602924292 shutdown_connections
2024-03-29T09:08:45.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.778+0000 7f421e800700  1 -- 172.21.15.171:0/464615908 shutdown_connections
2024-03-29T09:08:45.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.778+0000 7f421e800700  1 -- 172.21.15.171:0/464615908 wait complete.
2024-03-29T09:08:45.783 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.778+0000 7f1141c00700  1 -- 172.21.15.171:0/602924292 wait complete.
2024-03-29T09:08:45.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.780+0000 7f1141c00700  1  Processor -- start
2024-03-29T09:08:45.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.780+0000 7f421e800700  1  Processor -- start
2024-03-29T09:08:45.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.780+0000 7f1141c00700  1 --  start start
2024-03-29T09:08:45.784 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.780+0000 7f421e800700  1 --  start start
2024-03-29T09:08:45.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f1141c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f113c06d310 0x7f113c0943c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f421e800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f421806f830 0x7f4218130ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f421e800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 0x7f4218131010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f421e800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4218131550 0x7f42181319e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f421e800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181335a0 con 0x7f421806f830
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f421e800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42181324a0 con 0x7f4218133cc0
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f421e800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42181293c0 con 0x7f4218131550
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f4217e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4218131550 0x7f42181319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f4217e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4218131550 0x7f42181319e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45426/0 (socket says 172.21.15.171:45426)
2024-03-29T09:08:45.786 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f4217e00700  1 -- 172.21.15.171:0/2374413817 learned_addr learned my addr 172.21.15.171:0/2374413817 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f1141c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06dc30 0x7f113c094900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f1141c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c094e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f1141c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c1227f0 con 0x7f113c06dc30
2024-03-29T09:08:45.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f1141c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c122d70 con 0x7f113c12f0d0
2024-03-29T09:08:45.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.781+0000 7f1141c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113c123030 con 0x7f113c06d310
2024-03-29T09:08:45.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f4217e00700  1 -- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 msgr2=0x7f4218131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f4217e00700  1 --2- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4218133cc0 0x7f4218131010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f4217e00700  1 -- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f421806f830 msgr2=0x7f4218130ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:45.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f4217400700  1 --2- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f421806f830 0x7f4218130ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f113aa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f113c06d310 0x7f113c0943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f113a000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06dc30 0x7f113c094900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f113aa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f113c06d310 0x7f113c0943c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45420/0 (socket says 172.21.15.171:45420)
2024-03-29T09:08:45.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f113aa00700  1 -- 172.21.15.171:0/1477806729 learned_addr learned my addr 172.21.15.171:0/1477806729 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f4217e00700  1 --2- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f421806f830 0x7f4218130ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f4217e00700  1 -- 172.21.15.171:0/2374413817 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4210009a70 con 0x7f4218131550
2024-03-29T09:08:45.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f4217400700  1 --2- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f421806f830 0x7f4218130ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:45.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.782+0000 7f113b400700  1 --2- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c094e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f4217e00700  1 --2- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4218131550 0x7f42181319e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f421000efb0 tx=0x7f421000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f113a000700  1 -- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f113c06d310 msgr2=0x7f113c0943c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f113a000700  1 --2- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f113c06d310 0x7f113c0943c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f113a000700  1 -- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 msgr2=0x7f113c094e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f113a000700  1 --2- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c094e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f113a000700  1 -- 172.21.15.171:0/1477806729 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c009550 con 0x7f113c06dc30
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f113aa00700  1 --2- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f113c06d310 0x7f113c0943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.784+0000 7f113b400700  1 --2- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113c12f0d0 0x7f113c094e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:45.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.784+0000 7f113a000700  1 --2- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06dc30 0x7f113c094900 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f112800c520 tx=0x7f112800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.783+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210009ca0 con 0x7f4218131550
2024-03-29T09:08:45.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.784+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42040094a0 con 0x7f4218131550
2024-03-29T09:08:45.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.784+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421000f040 con 0x7f4218131550
2024-03-29T09:08:45.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.784+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210009ca0 con 0x7f4218131550
2024-03-29T09:08:45.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.784+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4218132eb0 con 0x7f4218131550
2024-03-29T09:08:45.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.785+0000 7fc999200700  1  Processor -- start
2024-03-29T09:08:45.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.785+0000 7fc999200700  1 --  start start
2024-03-29T09:08:45.793 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.785+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4218071280 con 0x7f4218131550
2024-03-29T09:08:45.793 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.785+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280054e0 con 0x7f113c06dc30
2024-03-29T09:08:45.793 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.785+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1128003680 con 0x7f113c06dc30
2024-03-29T09:08:45.793 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.785+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128003a10 con 0x7f113c06dc30
2024-03-29T09:08:45.793 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.785+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c06e200 con 0x7f113c06dc30
2024-03-29T09:08:45.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c1c2e60 con 0x7f113c06dc30
2024-03-29T09:08:45.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc999200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc999200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412f130 0x7fc99412b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc999200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fc99412b6a0 0x7fc99412bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc999200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9941258a0 con 0x7fc99412b6a0
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc999200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9941171a0 con 0x7fc99412e6e0
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc999200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc994071bc0 con 0x7fc99412f130
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc991e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc991e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42598/0 (socket says 172.21.15.171:42598)
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7fc991e00700  1 -- 172.21.15.171:0/3076715549 learned_addr learned my addr 172.21.15.171:0/3076715549 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc991e00700  1 -- 172.21.15.171:0/3076715549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412f130 msgr2=0x7fc99412b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc991e00700  1 --2- 172.21.15.171:0/3076715549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412f130 0x7fc99412b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc991e00700  1 -- 172.21.15.171:0/3076715549 >> v2:172.21.15.171:3300/0 conn(0x7fc99412b6a0 msgr2=0x7fc99412bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc991e00700  1 --2- 172.21.15.171:0/3076715549 >> v2:172.21.15.171:3300/0 conn(0x7fc99412b6a0 0x7fc99412bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc991e00700  1 -- 172.21.15.171:0/3076715549 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99412f530 con 0x7fc99412e6e0
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc991e00700  1 --2- 172.21.15.171:0/3076715549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412ebf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9840098f0 tx=0x7fc984009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51164cf2d9d3f104 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc990a00700  1 -- 172.21.15.171:0/3076715549 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98400b8a0 con 0x7fc99412e6e0
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc990a00700  1 -- 172.21.15.171:0/3076715549 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98400ba00 con 0x7fc99412e6e0
2024-03-29T09:08:45.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7fc990a00700  1 -- 172.21.15.171:0/3076715549 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98400bd90 con 0x7fc99412e6e0
2024-03-29T09:08:45.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.786+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f421000cd40 con 0x7f4218131550
2024-03-29T09:08:45.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f421005ce50 con 0x7f4218131550
2024-03-29T09:08:45.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 --> v1:172.21.15.171:6804/46686 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41f8051aa0 con 0x7f41f804ddd0
2024-03-29T09:08:45.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f421003a830 con 0x7f4218131550
2024-03-29T09:08:45.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.787+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f113c06e080 con 0x7f113c06dc30
2024-03-29T09:08:45.797 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7fc999200700  1 -- 172.21.15.171:0/3076715549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 msgr2=0x7fc99412ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.797 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7fc999200700  1 --2- 172.21.15.171:0/3076715549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412ebf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9840098f0 tx=0x7fc984009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:45.797 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7fc999200700  1 -- 172.21.15.171:0/3076715549 shutdown_connections
2024-03-29T09:08:45.797 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7fc999200700  1 --2- 172.21.15.171:0/3076715549 >> v2:172.21.15.171:3300/0 conn(0x7fc99412b6a0 0x7fc99412bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.797 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7fc999200700  1 --2- 172.21.15.171:0/3076715549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412ebf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7fc999200700  1 --2- 172.21.15.171:0/3076715549 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412f130 0x7fc99412b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.788+0000 7fc999200700  1 -- 172.21.15.171:0/3076715549 >> 172.21.15.171:0/3076715549 conn(0x7fc9940a0ba0 msgr2=0x7fc9940a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.789+0000 7fc999200700  1 -- 172.21.15.171:0/3076715549 shutdown_connections
2024-03-29T09:08:45.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.789+0000 7fc999200700  1 -- 172.21.15.171:0/3076715549 wait complete.
2024-03-29T09:08:45.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.789+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f1128003b70 con 0x7f113c06dc30
2024-03-29T09:08:45.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.790+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f112805c2e0 con 0x7f113c06dc30
2024-03-29T09:08:45.799 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.790+0000 7fc999200700  1  Processor -- start
2024-03-29T09:08:45.799 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.790+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== osd.1 v1:172.21.15.171:6804/46686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7f41f8051aa0 con 0x7f41f804ddd0
2024-03-29T09:08:45.799 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.790+0000 7fc999200700  1 --  start start
2024-03-29T09:08:45.799 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.790+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 --> v1:172.21.15.171:6800/46596 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f111c051b10 con 0x7f111c04de40
2024-03-29T09:08:45.800 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.790+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f112805c780 con 0x7f113c06dc30
2024-03-29T09:08:45.800 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.791+0000 7fc999200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412b6a0 0x7fc99412f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.800 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.791+0000 7fc999200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.800 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.791+0000 7fc999200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99412f130 0x7fc9941302b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.791+0000 7fc999200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99406f150 con 0x7fc99412f130
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.791+0000 7fc999200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99406fd60 con 0x7fc99412e6e0
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.791+0000 7fc999200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc99408e760 con 0x7fc99412b6a0
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7fc992800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99412f130 0x7fc9941302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7fc992800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99412f130 0x7fc9941302b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39286/0 (socket says 172.21.15.171:39286)
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7fc992800700  1 -- 172.21.15.171:0/367180208 learned_addr learned my addr 172.21.15.171:0/367180208 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7fc991e00700  1 --2- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412b6a0 0x7fc99412f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7fc991400700  1 --2- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.801 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7f0db4c00700  1  Processor -- start
2024-03-29T09:08:45.802 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== osd.0 v1:172.21.15.171:6800/46596 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7f111c051b10 con 0x7f111c04de40
2024-03-29T09:08:45.802 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.792+0000 7f0db4c00700  1 --  start start
2024-03-29T09:08:45.802 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7fc992800700  1 -- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412b6a0 msgr2=0x7fc99412f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.802 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7fc992800700  1 --2- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fc99412b6a0 0x7fc99412f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.802 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7fc992800700  1 -- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 msgr2=0x7fc99412fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7fc992800700  1 --2- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7fc992800700  1 -- 172.21.15.171:0/367180208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984009550 con 0x7fc99412f130
2024-03-29T09:08:45.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7f0db4c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f0db012e6e0 0x7f0db012ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7f0db4c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db012f130 0x7f0db012b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.803 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7fc991400700  1 --2- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99412e6e0 0x7fc99412fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:45.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7f0dad400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db012f130 0x7f0db012b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.804 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.793+0000 7f0db4c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db01171a0 con 0x7f0db012b6a0
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0db4c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db01258a0 con 0x7f0db012e6e0
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0db4c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0071bc0 con 0x7f0db012f130
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dad400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db012f130 0x7f0db012b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45452/0 (socket says 172.21.15.171:45452)
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dad400700  1 -- 172.21.15.171:0/303983094 learned_addr learned my addr 172.21.15.171:0/303983094 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dad400700  1 -- 172.21.15.171:0/303983094 >> v2:172.21.15.171:3300/0 conn(0x7f0db012e6e0 msgr2=0x7f0db012ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dade00700  1 --2- 172.21.15.171:0/303983094 >> v2:172.21.15.171:3300/0 conn(0x7f0db012e6e0 0x7f0db012ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dad400700  1 --2- 172.21.15.171:0/303983094 >> v2:172.21.15.171:3300/0 conn(0x7f0db012e6e0 0x7f0db012ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dad400700  1 -- 172.21.15.171:0/303983094 >> v1:172.21.15.171:6789/0 conn(0x7f0db012b6a0 legacy=0x7f0db0135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dad400700  1 -- 172.21.15.171:0/303983094 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db012f530 con 0x7f0db012f130
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dade00700  1 --2- 172.21.15.171:0/303983094 >> v2:172.21.15.171:3300/0 conn(0x7f0db012e6e0 0x7f0db012ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:45.805 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7fc992800700  1 --2- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99412f130 0x7fc9941302b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00b9e0 tx=0x7fc98c00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.794+0000 7f0dad400700  1 --2- 172.21.15.171:0/303983094 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db012f130 0x7f0db012b160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0098f0 tx=0x7f0d9c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6946aca99955db server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.795+0000 7f0daca00700  1 -- 172.21.15.171:0/303983094 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c004230 con 0x7f0db012f130
2024-03-29T09:08:45.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.795+0000 7f0daca00700  1 -- 172.21.15.171:0/303983094 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c004390 con 0x7f0db012f130
2024-03-29T09:08:45.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.795+0000 7f0daca00700  1 -- 172.21.15.171:0/303983094 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0036a0 con 0x7f0db012f130
2024-03-29T09:08:45.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.795+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00d8e0 con 0x7fc99412f130
2024-03-29T09:08:45.806 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.795+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c00da60 con 0x7fc99412f130
2024-03-29T09:08:45.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.795+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00de10 con 0x7fc99412f130
2024-03-29T09:08:45.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7f0db4c00700  1 -- 172.21.15.171:0/303983094 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db012f130 msgr2=0x7f0db012b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7f0db4c00700  1 --2- 172.21.15.171:0/303983094 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db012f130 0x7f0db012b160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0098f0 tx=0x7f0d9c009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:45.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7f0db4c00700  1 -- 172.21.15.171:0/303983094 shutdown_connections
2024-03-29T09:08:45.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7f0db4c00700  1 --2- 172.21.15.171:0/303983094 >> v2:172.21.15.171:3300/0 conn(0x7f0db012e6e0 0x7f0db012ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7f0db4c00700  1 --2- 172.21.15.171:0/303983094 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db012f130 0x7f0db012b160 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0098f0 tx=0x7f0d9c009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:45.807 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7f0db4c00700  1 -- 172.21.15.171:0/303983094 >> 172.21.15.171:0/303983094 conn(0x7f0db00a0ba0 msgr2=0x7f0db00a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99406f850 con 0x7fc99412f130
2024-03-29T09:08:45.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.796+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc994124770 con 0x7fc99412f130
2024-03-29T09:08:45.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.797+0000 7f0db4c00700  1 -- 172.21.15.171:0/303983094 shutdown_connections
2024-03-29T09:08:45.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.797+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9940a0f80 con 0x7fc99412f130
2024-03-29T09:08:45.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.797+0000 7f0db4c00700  1 -- 172.21.15.171:0/303983094 wait complete.
2024-03-29T09:08:45.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.798+0000 7f0db4c00700  1  Processor -- start
2024-03-29T09:08:45.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.798+0000 7f0db4c00700  1 --  start start
2024-03-29T09:08:45.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.799+0000 7f0db4c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0db012b6a0 0x7f0db01d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.799+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fc98c015420 con 0x7fc99412f130
2024-03-29T09:08:45.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0db4c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0db012e6e0 0x7f0db01d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0db4c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db0118bd0 0x7f0db008db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:45.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0dade00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0db012b6a0 0x7f0db01d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0dad400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0db012e6e0 0x7f0db01d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fc98c011070 con 0x7fc99412f130
2024-03-29T09:08:45.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0dae800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db0118bd0 0x7f0db008db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:45.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0dade00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0db012b6a0 0x7f0db01d0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42628/0 (socket says 172.21.15.171:42628)
2024-03-29T09:08:45.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 --> v1:172.21.15.171:6812/46965 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc974051a40 con 0x7fc97404dd70
2024-03-29T09:08:45.811 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc98c05ec80 con 0x7fc99412f130
2024-03-29T09:08:45.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0dad400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0db012e6e0 0x7f0db01d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39304/0 (socket says 172.21.15.171:39304)
2024-03-29T09:08:45.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0dae800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db0118bd0 0x7f0db008db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45460/0 (socket says 172.21.15.171:45460)
2024-03-29T09:08:45.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0db4c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0118320 con 0x7f0db012e6e0
2024-03-29T09:08:45.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0db4c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01186f0 con 0x7f0db012b6a0
2024-03-29T09:08:45.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0db4c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01d12f0 con 0x7f0db0118bd0
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.800+0000 7f0dade00700  1 -- 172.21.15.171:0/2458545113 learned_addr learned my addr 172.21.15.171:0/2458545113 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.801+0000 7f0dad400700  1 -- 172.21.15.171:0/2458545113 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db0118bd0 msgr2=0x7f0db008db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.801+0000 7f0dad400700  1 --2- 172.21.15.171:0/2458545113 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f0db0118bd0 0x7f0db008db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.801+0000 7f0dad400700  1 -- 172.21.15.171:0/2458545113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0db012b6a0 msgr2=0x7f0db01d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.801+0000 7f0dad400700  1 --2- 172.21.15.171:0/2458545113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0db012b6a0 0x7f0db01d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.801+0000 7f0dad400700  1 -- 172.21.15.171:0/2458545113 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009550 con 0x7f0db012e6e0
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.801+0000 7f0dad400700  1 --2- 172.21.15.171:0/2458545113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0db012e6e0 0x7f0db01d0db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c015000 tx=0x7f0d9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.801+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c003ea0 con 0x7f0db012e6e0
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.802+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0045e0 con 0x7f0db012e6e0
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.802+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00b8a0 con 0x7f0db012e6e0
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.802+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db008e060 con 0x7f0db012e6e0
2024-03-29T09:08:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.802+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db008e490 con 0x7f0db012e6e0
2024-03-29T09:08:45.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.803+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== osd.3 v1:172.21.15.171:6812/46965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7fc974051a40 con 0x7fc97404dd70
2024-03-29T09:08:45.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.803+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d88000fb0 con 0x7f0db012e6e0
2024-03-29T09:08:45.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.804+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f0d9c022070 con 0x7f0db012e6e0
2024-03-29T09:08:45.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.805+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f0d9c05db90 con 0x7f0db012e6e0
2024-03-29T09:08:45.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.805+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 --> v1:172.21.15.171:6808/46803 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d90051a70 con 0x7f0d9004dda0
2024-03-29T09:08:45.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.805+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d9c0278e0 con 0x7f0db012e6e0
2024-03-29T09:08:45.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.807+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== osd.2 v1:172.21.15.171:6808/46803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7f0d90051a70 con 0x7f0d9004dda0
2024-03-29T09:08:45.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.812+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 --> v1:172.21.15.171:6804/46686 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4218132eb0 con 0x7f41f804ddd0
2024-03-29T09:08:45.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.812+0000 7f420f400700  1 -- 172.21.15.171:0/2374413817 <== osd.1 v1:172.21.15.171:6804/46686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 949611525) 0x7f4218132eb0 con 0x7f41f804ddd0
2024-03-29T09:08:45.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.813+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 >> v1:172.21.15.171:6804/46686 conn(0x7f41f804ddd0 legacy=0x7f41f8050230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.813+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 >> v1:172.21.15.171:6816/44806 conn(0x7f41f8047650 legacy=0x7f41f8049b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.813+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4218131550 msgr2=0x7f42181319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.813+0000 7f421e800700  1 --2- 172.21.15.171:0/2374413817 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f4218131550 0x7f42181319e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f421000efb0 tx=0x7f421000c3a0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.813+0000 7f4217e00700  1 -- 172.21.15.171:0/2374413817 reap_dead start
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.813+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 shutdown_connections
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.813+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 >> 172.21.15.171:0/2374413817 conn(0x7f421809d9c0 msgr2=0x7f4218125d70 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.814+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 shutdown_connections
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.814+0000 7f421e800700  1 -- 172.21.15.171:0/2374413817 wait complete.
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.816+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 --> v1:172.21.15.171:6800/46596 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f113c06fce0 con 0x7f111c04de40
2024-03-29T09:08:45.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.817+0000 7f1132a00700  1 -- 172.21.15.171:0/1477806729 <== osd.0 v1:172.21.15.171:6800/46596 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2042554106) 0x7f11340077d0 con 0x7f111c04de40
2024-03-29T09:08:45.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.817+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 >> v1:172.21.15.171:6800/46596 conn(0x7f111c04de40 legacy=0x7f111c0502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 >> v1:172.21.15.171:6816/44806 conn(0x7f111c047640 legacy=0x7f111c049b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06dc30 msgr2=0x7f113c094900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f1141c00700  1 --2- 172.21.15.171:0/1477806729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113c06dc30 0x7f113c094900 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f112800c520 tx=0x7f112800c830 comp rx=0 tx=0).stop
2024-03-29T09:08:45.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f113b400700  1 -- 172.21.15.171:0/1477806729 reap_dead start
2024-03-29T09:08:45.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 shutdown_connections
2024-03-29T09:08:45.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 >> 172.21.15.171:0/1477806729 conn(0x7f113c0978d0 msgr2=0x7f113c09b730 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 shutdown_connections
2024-03-29T09:08:45.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.818+0000 7f1141c00700  1 -- 172.21.15.171:0/1477806729 wait complete.
2024-03-29T09:08:45.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.822+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 --> v1:172.21.15.171:6812/46965 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc99408f200 con 0x7fc97404dd70
2024-03-29T09:08:45.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.823+0000 7fc98a000700  1 -- 172.21.15.171:0/367180208 <== osd.3 v1:172.21.15.171:6812/46965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 795413372) 0x7fc99408f200 con 0x7fc97404dd70
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.823+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 >> v1:172.21.15.171:6812/46965 conn(0x7fc97404dd70 legacy=0x7fc9740501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.823+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 >> v1:172.21.15.171:6816/44806 conn(0x7fc9740475f0 legacy=0x7fc974049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.823+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99412f130 msgr2=0x7fc9941302b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.823+0000 7fc999200700  1 --2- 172.21.15.171:0/367180208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99412f130 0x7fc9941302b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00b9e0 tx=0x7fc98c00bcf0 comp rx=0 tx=0).stop
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.823+0000 7fc992800700  1 -- 172.21.15.171:0/367180208 reap_dead start
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.824+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 shutdown_connections
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.824+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 >> 172.21.15.171:0/367180208 conn(0x7fc9940a0ba0 msgr2=0x7fc99408de00 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.824+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 shutdown_connections
2024-03-29T09:08:45.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.824+0000 7fc999200700  1 -- 172.21.15.171:0/367180208 wait complete.
2024-03-29T09:08:45.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.827+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 --> v1:172.21.15.171:6808/46803 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d88002d00 con 0x7f0d9004dda0
2024-03-29T09:08:45.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.827+0000 7f0da6000700  1 -- 172.21.15.171:0/2458545113 <== osd.2 v1:172.21.15.171:6808/46803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4081650579) 0x7f0d88002d00 con 0x7f0d9004dda0
2024-03-29T09:08:45.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 >> v1:172.21.15.171:6808/46803 conn(0x7f0d9004dda0 legacy=0x7f0d90050200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 >> v1:172.21.15.171:6816/44806 conn(0x7f0d90047620 legacy=0x7f0d90049ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0db012e6e0 msgr2=0x7f0db01d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:45.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 --2- 172.21.15.171:0/2458545113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0db012e6e0 0x7f0db01d0db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c015000 tx=0x7f0d9c004750 comp rx=0 tx=0).stop
2024-03-29T09:08:45.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0dae800700  1 -- 172.21.15.171:0/2458545113 reap_dead start
2024-03-29T09:08:45.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 shutdown_connections
2024-03-29T09:08:45.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 >> 172.21.15.171:0/2458545113 conn(0x7f0db00a0ba0 msgr2=0x7f0db006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:45.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 shutdown_connections
2024-03-29T09:08:45.828 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:45.828+0000 7f0db4c00700  1 -- 172.21.15.171:0/2458545113 wait complete.
2024-03-29T09:08:45.835 INFO:teuthology.orchestra.run.smithi171.stdout:103079215108
2024-03-29T09:08:45.835 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1
2024-03-29T09:08:45.840 INFO:teuthology.orchestra.run.smithi171.stdout:98784247812
2024-03-29T09:08:45.840 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T09:08:45.849 INFO:teuthology.orchestra.run.smithi171.stdout:111669149699
2024-03-29T09:08:45.850 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3
2024-03-29T09:08:45.852 INFO:teuthology.orchestra.run.smithi171.stdout:107374182403
2024-03-29T09:08:45.852 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T09:08:46.054 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.054+0000 7faffee00700  1  Processor -- start
2024-03-29T09:08:46.054 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.055+0000 7faffee00700  1 --  start start
2024-03-29T09:08:46.055 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faffee00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7faff806ef50 0x7faff81338e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.056 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faffee00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff8133e20 0x7faff8136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.056 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faffee00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff806d120 con 0x7faff806e460
2024-03-29T09:08:46.056 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faffee00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff806ce40 con 0x7faff806ef50
2024-03-29T09:08:46.056 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faffee00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff806c5b0 con 0x7faff8133e20
2024-03-29T09:08:46.056 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faff7e00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7faff806e460 0x7faff806e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59152/0 (socket says 172.21.15.171:59152)
2024-03-29T09:08:46.056 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faff7e00700  1 -- 172.21.15.171:0/1948932449 learned_addr learned my addr 172.21.15.171:0/1948932449 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:46.056 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.056+0000 7faff7400700  1 --2- 172.21.15.171:0/1948932449 >> v2:172.21.15.171:3300/0 conn(0x7faff806ef50 0x7faff81338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faff7400700  1 -- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff8133e20 msgr2=0x7faff8136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faffce00700  1 --2- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff8133e20 0x7faff8136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faff6a00700  1 -- 172.21.15.171:0/1948932449 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45083964 0 0) 0x7faff806d120 con 0x7faff806e460
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faff7400700  1 --2- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff8133e20 0x7faff8136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faff7400700  1 -- 172.21.15.171:0/1948932449 >> v1:172.21.15.171:6789/0 conn(0x7faff806e460 legacy=0x7faff806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faff7400700  1 -- 172.21.15.171:0/1948932449 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff806f690 con 0x7faff806ef50
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faffce00700  1 --2- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff8133e20 0x7faff8136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:46.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.057+0000 7faff7400700  1 --2- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806ef50 0x7faff81338e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009840 tx=0x7fafe4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101ad4e4e2b30b5e server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.058+0000 7faff6a00700  1 -- 172.21.15.171:0/1948932449 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4011830 con 0x7faff806ef50
2024-03-29T09:08:46.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.058+0000 7faff6a00700  1 -- 172.21.15.171:0/1948932449 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe4011990 con 0x7faff806ef50
2024-03-29T09:08:46.058 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.058+0000 7faff6a00700  1 -- 172.21.15.171:0/1948932449 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4011d00 con 0x7faff806ef50
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 -- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806ef50 msgr2=0x7faff81338e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 --2- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806ef50 0x7faff81338e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009840 tx=0x7fafe4009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 -- 172.21.15.171:0/1948932449 shutdown_connections
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 --2- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff8133e20 0x7faff8136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 --2- 172.21.15.171:0/1948932449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806ef50 0x7faff81338e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 -- 172.21.15.171:0/1948932449 >> 172.21.15.171:0/1948932449 conn(0x7faff809a230 msgr2=0x7faff809a640 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 -- 172.21.15.171:0/1948932449 shutdown_connections
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.059+0000 7faffee00700  1 -- 172.21.15.171:0/1948932449 wait complete.
2024-03-29T09:08:46.059 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.060+0000 7faffee00700  1  Processor -- start
2024-03-29T09:08:46.060 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.060+0000 7faffee00700  1 --  start start
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faffee00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806e460 0x7faff81c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faffee00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff806ef50 0x7faff81c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faffee00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faff8133e20 0x7faff81c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faffee00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff8091ca0 con 0x7faff806e460
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faffee00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff8091990 con 0x7faff8133e20
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faffee00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff81331b0 con 0x7faff806ef50
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faff7400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff806ef50 0x7faff81c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faff7400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff806ef50 0x7faff81c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45478/0 (socket says 172.21.15.171:45478)
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.061+0000 7faff7400700  1 -- 172.21.15.171:0/3187994573 learned_addr learned my addr 172.21.15.171:0/3187994573 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faff7e00700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806e460 0x7faff81c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faffce00700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faff8133e20 0x7faff81c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faff7400700  1 -- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faff8133e20 msgr2=0x7faff81c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faff7400700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faff8133e20 0x7faff81c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faff7400700  1 -- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806e460 msgr2=0x7faff81c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faff7400700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806e460 0x7faff81c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faff7400700  1 -- 172.21.15.171:0/3187994573 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40094a0 con 0x7faff806ef50
2024-03-29T09:08:46.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.062+0000 7faff7e00700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806e460 0x7faff81c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:46.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.063+0000 7faff7400700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff806ef50 0x7faff81c3500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faff806cf80 tx=0x7fafe4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.063+0000 7fafefe00700  1 -- 172.21.15.171:0/3187994573 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4004590 con 0x7faff806ef50
2024-03-29T09:08:46.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.063+0000 7fafefe00700  1 -- 172.21.15.171:0/3187994573 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe401f070 con 0x7faff806ef50
2024-03-29T09:08:46.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.063+0000 7fafefe00700  1 -- 172.21.15.171:0/3187994573 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40038e0 con 0x7faff806ef50
2024-03-29T09:08:46.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.063+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff8090800 con 0x7faff806ef50
2024-03-29T09:08:46.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.063+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff80912a0 con 0x7faff806ef50
2024-03-29T09:08:46.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.064+0000 7fafefe00700  1 -- 172.21.15.171:0/3187994573 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fafe4003a40 con 0x7faff806ef50
2024-03-29T09:08:46.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.065+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff8067f30 con 0x7faff806ef50
2024-03-29T09:08:46.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.065+0000 7fafefe00700  1 -- 172.21.15.171:0/3187994573 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fafe4021070 con 0x7faff806ef50
2024-03-29T09:08:46.069 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.070+0000 7f3f20000700  1  Processor -- start
2024-03-29T09:08:46.070 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.070+0000 7f3f20000700  1 --  start start
2024-03-29T09:08:46.070 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.071+0000 7f3f20000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f3f1812e3a0 0x7f3f1812e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.070 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.071+0000 7f3f20000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812ecc0 0x7f3f1812ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.071 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.071+0000 7f3f20000700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f180715b0 con 0x7f3f1812b360
2024-03-29T09:08:46.071 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f8591600700  1  Processor -- start
2024-03-29T09:08:46.071 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.071+0000 7f3f20000700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f18070d80 con 0x7f3f1812e3a0
2024-03-29T09:08:46.071 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.071+0000 7f3f20000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180722b0 con 0x7f3f1812ecc0
2024-03-29T09:08:46.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f3f1cc00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812ecc0 0x7f3f1812ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f3f1e000700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f3f1812b360 0x7f3f18135730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59160/0 (socket says 172.21.15.171:59160)
2024-03-29T09:08:46.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f3f1e000700  1 -- 172.21.15.171:0/2675272978 learned_addr learned my addr 172.21.15.171:0/2675272978 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:46.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f3f1d600700  1 --2- 172.21.15.171:0/2675272978 >> v2:172.21.15.171:3300/0 conn(0x7f3f1812e3a0 0x7f3f1812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f8591600700  1 --  start start
2024-03-29T09:08:46.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f3f1d600700  1 -- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812ecc0 msgr2=0x7f3f1812ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:46.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f3f1d600700  1 --2- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812ecc0 0x7f3f1812ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.072+0000 7f3f1d600700  1 -- 172.21.15.171:0/2675272978 >> v1:172.21.15.171:6789/0 conn(0x7f3f1812b360 legacy=0x7f3f18135730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f3f1d600700  1 -- 172.21.15.171:0/2675272978 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18071b40 con 0x7f3f1812e3a0
2024-03-29T09:08:46.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f3f1cc00700  1 --2- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812ecc0 0x7f3f1812ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:46.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f3f17e00700  1 -- 172.21.15.171:0/2675272978 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64246982 0 0) 0x7f3f180715b0 con 0x7f3f1812b360
2024-03-29T09:08:46.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f8591600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c12e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.074 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f3f1d600700  1 --2- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812e3a0 0x7f3f1812e780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009840 tx=0x7f3f0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e0b000eb052786 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.074 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f8591600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12b530 0x7f858c136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.074 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f8591600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c070d80 con 0x7f858c12ecc0
2024-03-29T09:08:46.074 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f8591600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0715e0 con 0x7f858c12e3a0
2024-03-29T09:08:46.074 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f8591600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0722b0 con 0x7f858c12b530
2024-03-29T09:08:46.075 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f3f17e00700  1 -- 172.21.15.171:0/2675272978 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c011830 con 0x7f3f1812e3a0
2024-03-29T09:08:46.075 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f3f17e00700  1 -- 172.21.15.171:0/2675272978 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c011990 con 0x7f3f1812e3a0
2024-03-29T09:08:46.075 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f3f17e00700  1 -- 172.21.15.171:0/2675272978 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c011d20 con 0x7f3f1812e3a0
2024-03-29T09:08:46.075 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7fafefe00700  1 -- 172.21.15.171:0/3187994573 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fafe4061030 con 0x7faff806ef50
2024-03-29T09:08:46.075 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.073+0000 7f858a000700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f858c12ecc0 0x7f858c12ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59166/0 (socket says 172.21.15.171:59166)
2024-03-29T09:08:46.076 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f858a000700  1 -- 172.21.15.171:0/1181217404 learned_addr learned my addr 172.21.15.171:0/1181217404 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:46.076 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f858aa00700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c12e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.076 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f858b400700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12b530 0x7f858c136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.076 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f588fa00700  1  Processor -- start
2024-03-29T09:08:46.076 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f588fa00700  1 --  start start
2024-03-29T09:08:46.077 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f3f20000700  1 -- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812e3a0 msgr2=0x7f3f1812e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.077 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f3f20000700  1 --2- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812e3a0 0x7f3f1812e780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009840 tx=0x7f3f0c009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:46.077 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f8589600700  1 -- 172.21.15.171:0/1181217404 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467313302 0 0) 0x7f858c070d80 con 0x7f858c12ecc0
2024-03-29T09:08:46.077 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.074+0000 7f858aa00700  1 -- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12b530 msgr2=0x7f858c136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f3f20000700  1 -- 172.21.15.171:0/2675272978 shutdown_connections
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f3f20000700  1 --2- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812e3a0 0x7f3f1812e780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f3f20000700  1 --2- 172.21.15.171:0/2675272978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812ecc0 0x7f3f1812ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f3f20000700  1 -- 172.21.15.171:0/2675272978 >> 172.21.15.171:0/2675272978 conn(0x7f3f180a0d70 msgr2=0x7f3f180a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f3f20000700  1 -- 172.21.15.171:0/2675272978 shutdown_connections
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f3f20000700  1 -- 172.21.15.171:0/2675272978 wait complete.
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f588fa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812e6e0 0x7f588812ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f588fa00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f588812b870 0x7f5888136a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f588fa00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58881171a0 con 0x7f588812f130
2024-03-29T09:08:46.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f588fa00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58881258a0 con 0x7f588812b870
2024-03-29T09:08:46.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f588fa00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5888071bc0 con 0x7f588812e6e0
2024-03-29T09:08:46.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f858aa00700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12b530 0x7f858c136740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.075+0000 7f858aa00700  1 -- 172.21.15.171:0/1181217404 >> v1:172.21.15.171:6789/0 conn(0x7f858c12ecc0 legacy=0x7f858c12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f858aa00700  1 -- 172.21.15.171:0/1181217404 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c071b40 con 0x7f858c12e3a0
2024-03-29T09:08:46.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f588d000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812e6e0 0x7f588812ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f5887e00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f588812f130 0x7f588812b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59178/0 (socket says 172.21.15.171:59178)
2024-03-29T09:08:46.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f5887e00700  1 -- 172.21.15.171:0/3723072735 learned_addr learned my addr 172.21.15.171:0/3723072735 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:46.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f588da00700  1 --2- 172.21.15.171:0/3723072735 >> v2:172.21.15.171:3300/0 conn(0x7f588812b870 0x7f5888136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f588d000700  1 -- 172.21.15.171:0/3723072735 >> v2:172.21.15.171:3300/0 conn(0x7f588812b870 msgr2=0x7f5888136a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:46.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f588d000700  1 --2- 172.21.15.171:0/3723072735 >> v2:172.21.15.171:3300/0 conn(0x7f588812b870 0x7f5888136a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f588d000700  1 -- 172.21.15.171:0/3723072735 >> v1:172.21.15.171:6789/0 conn(0x7f588812f130 legacy=0x7f588812b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f588d000700  1 -- 172.21.15.171:0/3723072735 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588812f530 con 0x7f588812e6e0
2024-03-29T09:08:46.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.077+0000 7f588d000700  1 --2- 172.21.15.171:0/3723072735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812e6e0 0x7f588812ebf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f587c009840 tx=0x7f587c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8162af30e62ec5c7 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.076+0000 7f858aa00700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c12e780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f857c009870 tx=0x7f857c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c59c122dfc77e52 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.077+0000 7f8589600700  1 -- 172.21.15.171:0/1181217404 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c011830 con 0x7f858c12e3a0
2024-03-29T09:08:46.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.077+0000 7f8589600700  1 -- 172.21.15.171:0/1181217404 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c011990 con 0x7f858c12e3a0
2024-03-29T09:08:46.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.077+0000 7f8589600700  1 -- 172.21.15.171:0/1181217404 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c011d20 con 0x7f858c12e3a0
2024-03-29T09:08:46.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.077+0000 7f3f20000700  1  Processor -- start
2024-03-29T09:08:46.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.077+0000 7f5887400700  1 -- 172.21.15.171:0/3723072735 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011830 con 0x7f588812e6e0
2024-03-29T09:08:46.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f5887400700  1 -- 172.21.15.171:0/3723072735 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c011990 con 0x7f588812e6e0
2024-03-29T09:08:46.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f5887400700  1 -- 172.21.15.171:0/3723072735 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011d20 con 0x7f588812e6e0
2024-03-29T09:08:46.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f858b400700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12b530 0x7f858c136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:46.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 -- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 msgr2=0x7f858c12e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c12e780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f857c009870 tx=0x7f857c009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:46.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f3f20000700  1 --  start start
2024-03-29T09:08:46.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 -- 172.21.15.171:0/1181217404 shutdown_connections
2024-03-29T09:08:46.084 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12b530 0x7f858c136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.084 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 --2- 172.21.15.171:0/1181217404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c12e780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.084 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 -- 172.21.15.171:0/1181217404 >> 172.21.15.171:0/1181217404 conn(0x7f858c0a0d70 msgr2=0x7f858c0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.084 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f588fa00700  1 -- 172.21.15.171:0/3723072735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812e6e0 msgr2=0x7f588812ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.084 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f588fa00700  1 --2- 172.21.15.171:0/3723072735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812e6e0 0x7f588812ebf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f587c009840 tx=0x7f587c009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:46.084 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 -- 172.21.15.171:0/1181217404 shutdown_connections
2024-03-29T09:08:46.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f588fa00700  1 -- 172.21.15.171:0/3723072735 shutdown_connections
2024-03-29T09:08:46.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f588fa00700  1 --2- 172.21.15.171:0/3723072735 >> v2:172.21.15.171:3300/0 conn(0x7f588812b870 0x7f5888136a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f588fa00700  1 --2- 172.21.15.171:0/3723072735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812e6e0 0x7f588812ebf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f588fa00700  1 -- 172.21.15.171:0/3723072735 >> 172.21.15.171:0/3723072735 conn(0x7f58880a0ba0 msgr2=0x7f58880a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f588fa00700  1 -- 172.21.15.171:0/3723072735 shutdown_connections
2024-03-29T09:08:46.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f588fa00700  1 -- 172.21.15.171:0/3723072735 wait complete.
2024-03-29T09:08:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f3f20000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812b360 0x7f3f181c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f3f20000700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3f1812e3a0 0x7f3f181c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f3f20000700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812ecc0 0x7f3f18119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f3f20000700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1811d220 con 0x7f3f1812ecc0
2024-03-29T09:08:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f3f20000700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1811d530 con 0x7f3f1812b360
2024-03-29T09:08:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.079+0000 7f3f20000700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1811c510 con 0x7f3f1812e3a0
2024-03-29T09:08:46.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.080+0000 7f3f1cc00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3f1812e3a0 0x7f3f181c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.080+0000 7f3f1cc00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3f1812e3a0 0x7f3f181c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45506/0 (socket says 172.21.15.171:45506)
2024-03-29T09:08:46.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.080+0000 7f3f1cc00700  1 -- 172.21.15.171:0/2078171698 learned_addr learned my addr 172.21.15.171:0/2078171698 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:46.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.080+0000 7f3f1d600700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812b360 0x7f3f181c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.078+0000 7f8591600700  1 -- 172.21.15.171:0/1181217404 wait complete.
2024-03-29T09:08:46.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.080+0000 7f3f1cc00700  1 -- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812b360 msgr2=0x7f3f181c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.080+0000 7f8591600700  1  Processor -- start
2024-03-29T09:08:46.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f3f1cc00700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812b360 0x7f3f181c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f3f1cc00700  1 -- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812ecc0 msgr2=0x7f3f18119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f3f1cc00700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812ecc0 0x7f3f18119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f3f1cc00700  1 -- 172.21.15.171:0/2078171698 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f040094a0 con 0x7f3f1812e3a0
2024-03-29T09:08:46.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f588fa00700  1  Processor -- start
2024-03-29T09:08:46.089 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f3f1d600700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812b360 0x7f3f181c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:46.089 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f588fa00700  1 --  start start
2024-03-29T09:08:46.089 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f3f1cc00700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3f1812e3a0 0x7f3f181c3970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400ed00 tx=0x7f3f0400c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.089 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f3f15600700  1 -- 172.21.15.171:0/2078171698 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400ee50 con 0x7f3f1812e3a0
2024-03-29T09:08:46.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f3f15600700  1 -- 172.21.15.171:0/2078171698 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0400ca40 con 0x7f3f1812e3a0
2024-03-29T09:08:46.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f3f15600700  1 -- 172.21.15.171:0/2078171698 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400cdd0 con 0x7f3f1812e3a0
2024-03-29T09:08:46.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f588fa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812b870 0x7f5888131ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f588fa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f588812e6e0 0x7f5888132400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.081+0000 7f8591600700  1 --  start start
2024-03-29T09:08:46.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f8591600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c12b530 0x7f858c1271f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f8591600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c127730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f8591600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12ecc0 0x7f858c127c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f8591600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c08b4c0 con 0x7f858c12b530
2024-03-29T09:08:46.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f8591600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c08d120 con 0x7f858c12e3a0
2024-03-29T09:08:46.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f8591600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f858c08c100 con 0x7f858c12ecc0
2024-03-29T09:08:46.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f588fa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f588812f130 0x7f5888132940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:46.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c0094a0 con 0x7f3f1812e3a0
2024-03-29T09:08:46.092 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f5887e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f588812e6e0 0x7f5888132400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.092 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588d000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812b870 0x7f5888131ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.092 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.082+0000 7f858a000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c127730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.092 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588da00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f588812f130 0x7f5888132940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:46.093 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588d000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812b870 0x7f5888131ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42694/0 (socket says 172.21.15.171:42694)
2024-03-29T09:08:46.093 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588da00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f588812f130 0x7f5888132940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:45516/0 (socket says 172.21.15.171:45516)
2024-03-29T09:08:46.093 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f5887e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f588812e6e0 0x7f5888132400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39370/0 (socket says 172.21.15.171:39370)
2024-03-29T09:08:46.093 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588fa00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58881359f0 con 0x7f588812e6e0
2024-03-29T09:08:46.093 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f858a000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c127730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:42700/0 (socket says 172.21.15.171:42700)
2024-03-29T09:08:46.094 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588fa00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5888135690 con 0x7f588812b870
2024-03-29T09:08:46.094 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588d000700  1 -- 172.21.15.171:0/2568350298 learned_addr learned my addr 172.21.15.171:0/2568350298 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:46.094 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5888133990 con 0x7f588812f130
2024-03-29T09:08:46.094 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f181c3eb0 con 0x7f3f1812e3a0
2024-03-29T09:08:46.094 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.083+0000 7f858a000700  1 -- 172.21.15.171:0/3860576244 learned_addr learned my addr 172.21.15.171:0/3860576244 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f588da00700  1 -- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812b870 msgr2=0x7f5888131ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f588da00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812b870 0x7f5888131ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f588da00700  1 -- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f588812e6e0 msgr2=0x7f5888132400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f858a000700  1 -- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12ecc0 msgr2=0x7f858c127c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f858a000700  1 --2- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12ecc0 0x7f858c127c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f858a000700  1 -- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c12b530 msgr2=0x7f858c1271f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f858a000700  1 --2- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c12b530 0x7f858c1271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.095 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f858a000700  1 -- 172.21.15.171:0/3860576244 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8584009a70 con 0x7f858c12e3a0
2024-03-29T09:08:46.096 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f588da00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f588812e6e0 0x7f5888132400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.096 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f588da00700  1 -- 172.21.15.171:0/2568350298 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0094a0 con 0x7f588812f130
2024-03-29T09:08:46.096 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f858a000700  1 --2- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c127730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f857800c540 tx=0x7f857800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.096 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.084+0000 7f5887e00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f588812e6e0 0x7f5888132400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:46.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.085+0000 7f588da00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f588812f130 0x7f5888132940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f588000eb80 tx=0x7f588000ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:46.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.085+0000 7f8582a00700  1 -- 172.21.15.171:0/3860576244 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578004c80 con 0x7f858c12e3a0
2024-03-29T09:08:46.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.085+0000 7f8582a00700  1 -- 172.21.15.171:0/3860576244 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8578004de0 con 0x7f858c12e3a0
2024-03-29T09:08:46.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.085+0000 7f8582a00700  1 -- 172.21.15.171:0/3860576244 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578007310 con 0x7f858c12e3a0
2024-03-29T09:08:46.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.085+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c0094a0 con 0x7f858c12e3a0
2024-03-29T09:08:46.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.085+0000 7f5884c00700  1 -- 172.21.15.171:0/2568350298 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588000ca00 con 0x7f588812f130
2024-03-29T09:08:46.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.086+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c08c770 con 0x7f858c12e3a0
2024-03-29T09:08:46.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.086+0000 7f5884c00700  1 -- 172.21.15.171:0/2568350298 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588000f040 con 0x7f588812f130
2024-03-29T09:08:46.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.086+0000 7f5884c00700  1 -- 172.21.15.171:0/2568350298 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588000cdc0 con 0x7f588812f130
2024-03-29T09:08:46.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.086+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588812bfe0 con 0x7f588812f130
2024-03-29T09:08:46.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.086+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f181171d0 con 0x7f3f1812e3a0
2024-03-29T09:08:46.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.086+0000 7f3f15600700  1 -- 172.21.15.171:0/2078171698 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f3f04013470 con 0x7f3f1812e3a0
2024-03-29T09:08:46.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.086+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58881342e0 con 0x7f588812f130
2024-03-29T09:08:46.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.087+0000 7f8582a00700  1 -- 172.21.15.171:0/3860576244 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f8578007470 con 0x7f858c12e3a0
2024-03-29T09:08:46.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.088+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c1171d0 con 0x7f858c12e3a0
2024-03-29T09:08:46.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.088+0000 7f3f15600700  1 -- 172.21.15.171:0/2078171698 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f3f04064300 con 0x7f3f1812e3a0
2024-03-29T09:08:46.100 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.088+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588806e960 con 0x7f588812f130
2024-03-29T09:08:46.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.089+0000 7f8582a00700  1 -- 172.21.15.171:0/3860576244 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f857803bf50 con 0x7f858c12e3a0
2024-03-29T09:08:46.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.091+0000 7f3f15600700  1 -- 172.21.15.171:0/2078171698 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f3f04062060 con 0x7f3f1812e3a0
2024-03-29T09:08:46.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.092+0000 7f5884c00700  1 -- 172.21.15.171:0/2568350298 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f5880014480 con 0x7f588812f130
2024-03-29T09:08:46.101 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.093+0000 7f5884c00700  1 -- 172.21.15.171:0/2568350298 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f588005d760 con 0x7f588812f130
2024-03-29T09:08:46.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.094+0000 7f8582a00700  1 -- 172.21.15.171:0/3860576244 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f857803a8e0 con 0x7f858c12e3a0
2024-03-29T09:08:46.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.095+0000 7f5884c00700  1 -- 172.21.15.171:0/2568350298 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f588003b200 con 0x7f588812f130
2024-03-29T09:08:46.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.273+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f180623e0 con 0x7f3f1812e3a0
2024-03-29T09:08:46.273 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.273+0000 7f3f15600700  1 -- 172.21.15.171:0/2078171698 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f04062020 con 0x7f3f1812e3a0
2024-03-29T09:08:46.273 INFO:teuthology.orchestra.run.smithi171.stdout:107374182402
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.275+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 >> v1:172.21.15.171:6816/44806 conn(0x7f3ef80475f0 legacy=0x7f3ef8049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.275+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3f1812e3a0 msgr2=0x7f3f181c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.275+0000 7f3f20000700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3f1812e3a0 0x7f3f181c3970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400ed00 tx=0x7f3f0400c430 comp rx=0 tx=0).stop
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.276+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 shutdown_connections
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.276+0000 7f3f20000700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f1812ecc0 0x7f3f18119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.276+0000 7f3f20000700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f1812b360 0x7f3f181c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.276+0000 7f3f20000700  1 --2- 172.21.15.171:0/2078171698 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3f1812e3a0 0x7f3f181c3970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.276+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 >> 172.21.15.171:0/2078171698 conn(0x7f3f180a0d70 msgr2=0x7f3f1806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.275 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.276+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 shutdown_connections
2024-03-29T09:08:46.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.276+0000 7f3f20000700  1 -- 172.21.15.171:0/2078171698 wait complete.
2024-03-29T09:08:46.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.278+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5888134a40 con 0x7f588812f130
2024-03-29T09:08:46.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.278+0000 7f5884c00700  1 -- 172.21.15.171:0/2568350298 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5880018030 con 0x7f588812f130
2024-03-29T09:08:46.277 INFO:teuthology.orchestra.run.smithi171.stdout:98784247810
2024-03-29T09:08:46.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.281+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 >> v1:172.21.15.171:6816/44806 conn(0x7f5868047640 legacy=0x7f5868049b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.281+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f588812f130 msgr2=0x7f5888132940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.281+0000 7f588fa00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f588812f130 0x7f5888132940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f588000eb80 tx=0x7f588000ee90 comp rx=0 tx=0).stop
2024-03-29T09:08:46.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.282+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 shutdown_connections
2024-03-29T09:08:46.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.282+0000 7f588fa00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f588812f130 0x7f5888132940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.282+0000 7f588fa00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f588812b870 0x7f5888131ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.282+0000 7f588fa00700  1 --2- 172.21.15.171:0/2568350298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f588812e6e0 0x7f5888132400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.282+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 >> 172.21.15.171:0/2568350298 conn(0x7f58880a0ba0 msgr2=0x7f5888128340 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.282+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 shutdown_connections
2024-03-29T09:08:46.282 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.282+0000 7f588fa00700  1 -- 172.21.15.171:0/2568350298 wait complete.
2024-03-29T09:08:46.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 107374182402 for osd.2
2024-03-29T09:08:46.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247810 for osd.0
2024-03-29T09:08:46.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.339+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faff80623e0 con 0x7faff806ef50
2024-03-29T09:08:46.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.340+0000 7fafefe00700  1 -- 172.21.15.171:0/3187994573 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0  v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafe402b020 con 0x7faff806ef50
2024-03-29T09:08:46.339 INFO:teuthology.orchestra.run.smithi171.stdout:103079215108
2024-03-29T09:08:46.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 >> v1:172.21.15.171:6816/44806 conn(0x7fafd8047620 legacy=0x7fafd8049ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff806ef50 msgr2=0x7faff81c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff806ef50 0x7faff81c3500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faff806cf80 tx=0x7fafe4004750 comp rx=0 tx=0).stop
2024-03-29T09:08:46.341 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 shutdown_connections
2024-03-29T09:08:46.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faff8133e20 0x7faff81c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faff806e460 0x7faff81c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 --2- 172.21.15.171:0/3187994573 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faff806ef50 0x7faff81c3500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 >> 172.21.15.171:0/3187994573 conn(0x7faff809a230 msgr2=0x7faff8099030 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 shutdown_connections
2024-03-29T09:08:46.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.342+0000 7faffee00700  1 -- 172.21.15.171:0/3187994573 wait complete.
2024-03-29T09:08:46.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.354+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f858c0623e0 con 0x7f858c12e3a0
2024-03-29T09:08:46.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.355+0000 7f8582a00700  1 -- 172.21.15.171:0/3860576244 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0  v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f857803aa80 con 0x7f858c12e3a0
2024-03-29T09:08:46.354 INFO:teuthology.orchestra.run.smithi171.stdout:111669149699
2024-03-29T09:08:46.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 >> v1:172.21.15.171:6816/44806 conn(0x7f856c047640 legacy=0x7f856c049b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 msgr2=0x7f858c127730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 --2- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c127730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f857800c540 tx=0x7f857800c900 comp rx=0 tx=0).stop
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 shutdown_connections
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 --2- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f858c12ecc0 0x7f858c127c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 --2- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c12b530 0x7f858c1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 --2- 172.21.15.171:0/3860576244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c12e3a0 0x7f858c127730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 >> 172.21.15.171:0/3860576244 conn(0x7f858c0a0d70 msgr2=0x7f858c124b90 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 shutdown_connections
2024-03-29T09:08:46.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:46.357+0000 7f8591600700  1 -- 172.21.15.171:0/3860576244 wait complete.
2024-03-29T09:08:46.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215108 got 103079215108 for osd.1
2024-03-29T09:08:46.359 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:46.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 111669149699 for osd.3
2024-03-29T09:08:46.374 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:47.302 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2
2024-03-29T09:08:47.305 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0
2024-03-29T09:08:47.511 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.511+0000 7f43f8800700  1  Processor -- start
2024-03-29T09:08:47.511 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.511+0000 7f6f7ea00700  1  Processor -- start
2024-03-29T09:08:47.511 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.511+0000 7f6f7ea00700  1 --  start start
2024-03-29T09:08:47.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.511+0000 7f43f8800700  1 --  start start
2024-03-29T09:08:47.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f6f7ea00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f7806e460 0x7f6f7806e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f6f7ea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806ed80 0x7f6f781328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.512 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f8800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f43f0070ed0 0x7f43f00712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f6f7ea00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7806d120 con 0x7f6f78132e10
2024-03-29T09:08:47.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f6f7ea00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806ce40 con 0x7f6f7806ed80
2024-03-29T09:08:47.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f6f7ea00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806c5b0 con 0x7f6f7806e460
2024-03-29T09:08:47.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f8800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006d310 0x7f43f006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.513 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f8800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f00705e0 con 0x7f43f006dcb0
2024-03-29T09:08:47.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f8800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f006e640 con 0x7f43f0070ed0
2024-03-29T09:08:47.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f8800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43f0071d90 con 0x7f43f006d310
2024-03-29T09:08:47.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f6f77400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806ed80 0x7f6f781328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f5400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006d310 0x7f43f006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.514 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f5400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006d310 0x7f43f006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35302/0 (socket says 172.21.15.171:35302)
2024-03-29T09:08:47.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.512+0000 7f43f5400700  1 -- 172.21.15.171:0/620310532 learned_addr learned my addr 172.21.15.171:0/620310532 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:47.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f43f5e00700  1 --2- 172.21.15.171:0/620310532 >> v2:172.21.15.171:3300/0 conn(0x7f43f0070ed0 0x7f43f00712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f7ca00700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f6f78132e10 0x7f6f78135200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:40918/0 (socket says 172.21.15.171:40918)
2024-03-29T09:08:47.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f77400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806ed80 0x7f6f781328d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60220/0 (socket says 172.21.15.171:60220)
2024-03-29T09:08:47.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f7ca00700  1 -- 172.21.15.171:0/3312608823 learned_addr learned my addr 172.21.15.171:0/3312608823 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:47.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f77e00700  1 --2- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f7806e460 0x7f6f7806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f77400700  1 -- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f7806e460 msgr2=0x7f6f7806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:47.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f77400700  1 --2- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f7806e460 0x7f6f7806e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f77400700  1 -- 172.21.15.171:0/3312608823 >> v1:172.21.15.171:6789/0 conn(0x7f6f78132e10 legacy=0x7f6f78135200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f6f77400700  1 -- 172.21.15.171:0/3312608823 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7806f690 con 0x7f6f7806ed80
2024-03-29T09:08:47.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f43f5e00700  1 -- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006d310 msgr2=0x7f43f006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:47.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f43f5e00700  1 --2- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006d310 0x7f43f006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f43f5e00700  1 -- 172.21.15.171:0/620310532 >> v1:172.21.15.171:6789/0 conn(0x7f43f006dcb0 legacy=0x7f43f0131c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f6f77400700  1 --2- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806ed80 0x7f6f781328d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009870 tx=0x7f6f64009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b28d56b5f0569bd server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:47.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f43f5e00700  1 -- 172.21.15.171:0/620310532 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f006fd10 con 0x7f43f0070ed0
2024-03-29T09:08:47.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f43f5400700  1 --2- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006d310 0x7f43f006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:47.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.513+0000 7f43f4a00700  1 -- 172.21.15.171:0/620310532 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877552792 0 0) 0x7f43f00705e0 con 0x7f43f006dcb0
2024-03-29T09:08:47.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f6f76a00700  1 -- 172.21.15.171:0/3312608823 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011830 con 0x7f6f7806ed80
2024-03-29T09:08:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f43f5e00700  1 --2- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f00712b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009870 tx=0x7f43e4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc53932e749feb5 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f6f76a00700  1 -- 172.21.15.171:0/3312608823 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64011990 con 0x7f6f7806ed80
2024-03-29T09:08:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f6f76a00700  1 -- 172.21.15.171:0/3312608823 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011d20 con 0x7f6f7806ed80
2024-03-29T09:08:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f43f4a00700  1 -- 172.21.15.171:0/620310532 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4011830 con 0x7f43f0070ed0
2024-03-29T09:08:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f43f4a00700  1 -- 172.21.15.171:0/620310532 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4011990 con 0x7f43f0070ed0
2024-03-29T09:08:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.514+0000 7f43f4a00700  1 -- 172.21.15.171:0/620310532 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4011d20 con 0x7f43f0070ed0
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 -- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806ed80 msgr2=0x7f6f781328d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 --2- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806ed80 0x7f6f781328d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009870 tx=0x7f6f64009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 -- 172.21.15.171:0/3312608823 shutdown_connections
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 --2- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f7806e460 0x7f6f7806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 --2- 172.21.15.171:0/3312608823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806ed80 0x7f6f781328d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 -- 172.21.15.171:0/3312608823 >> 172.21.15.171:0/3312608823 conn(0x7f6f7809a230 msgr2=0x7f6f7809a640 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 -- 172.21.15.171:0/3312608823 shutdown_connections
2024-03-29T09:08:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 -- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 msgr2=0x7f43f00712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 --2- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f00712b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009870 tx=0x7f43e4009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f6f7ea00700  1 -- 172.21.15.171:0/3312608823 wait complete.
2024-03-29T09:08:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 -- 172.21.15.171:0/620310532 shutdown_connections
2024-03-29T09:08:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 --2- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f00712b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 --2- 172.21.15.171:0/620310532 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006d310 0x7f43f006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 -- 172.21.15.171:0/620310532 >> 172.21.15.171:0/620310532 conn(0x7f43f00978d0 msgr2=0x7f43f0097ce0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 -- 172.21.15.171:0/620310532 shutdown_connections
2024-03-29T09:08:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.515+0000 7f43f8800700  1 -- 172.21.15.171:0/620310532 wait complete.
2024-03-29T09:08:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.516+0000 7f6f7ea00700  1  Processor -- start
2024-03-29T09:08:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.516+0000 7f43f8800700  1  Processor -- start
2024-03-29T09:08:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.516+0000 7f6f7ea00700  1 --  start start
2024-03-29T09:08:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f43f8800700  1 --  start start
2024-03-29T09:08:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806e460 0x7f6f781bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f7806ed80 0x7f6f781c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ea00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f78132e10 0x7f6f781c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ea00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781233f0 con 0x7f6f7806ed80
2024-03-29T09:08:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ea00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78095e90 con 0x7f6f7806e460
2024-03-29T09:08:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ea00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78096d50 con 0x7f6f78132e10
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f43f8800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f006d310 0x7f43f0093cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f43f8800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006dcb0 0x7f43f00941f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f43f8800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f0094730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f43f8800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f0126b90 con 0x7f43f0070ed0
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f43f8800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f0096d50 con 0x7f43f006d310
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f43f8800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43f0127360 con 0x7f43f006dcb0
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ca00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f78132e10 0x7f6f781c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f77e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806e460 0x7f6f781bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f77e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806e460 0x7f6f781bfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60224/0 (socket says 172.21.15.171:60224)
2024-03-29T09:08:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f7ca00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f78132e10 0x7f6f781c05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35306/0 (socket says 172.21.15.171:35306)
2024-03-29T09:08:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f77e00700  1 -- 172.21.15.171:0/4121750498 learned_addr learned my addr 172.21.15.171:0/4121750498 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.517+0000 7f6f77400700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f7806ed80 0x7f6f781c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006dcb0 0x7f43f00941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f006d310 0x7f43f0093cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006dcb0 0x7f43f00941f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35320/0 (socket says 172.21.15.171:35320)
2024-03-29T09:08:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 -- 172.21.15.171:0/3371470478 learned_addr learned my addr 172.21.15.171:0/3371470478 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f77e00700  1 -- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f78132e10 msgr2=0x7f6f781c05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f77e00700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f78132e10 0x7f6f781c05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f77e00700  1 -- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f7806ed80 msgr2=0x7f6f781c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f77e00700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f7806ed80 0x7f6f781c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f77e00700  1 -- 172.21.15.171:0/4121750498 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640094a0 con 0x7f6f7806e460
2024-03-29T09:08:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f77e00700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806e460 0x7f6f781bfb60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800e9b0 tx=0x7f6f6800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 -- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f006d310 msgr2=0x7f43f0093cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f006d310 0x7f43f0093cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 -- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 msgr2=0x7f43f0094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f6800700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f0094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f6fe00700  1 -- 172.21.15.171:0/4121750498 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68009710 con 0x7f6f7806e460
2024-03-29T09:08:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f6fe00700  1 -- 172.21.15.171:0/4121750498 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6800c850 con 0x7f6f7806e460
2024-03-29T09:08:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f6fe00700  1 -- 172.21.15.171:0/4121750498 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6800cbc0 con 0x7f6f7806e460
2024-03-29T09:08:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78071460 con 0x7f6f7806e460
2024-03-29T09:08:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f0094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.518+0000 7f43f5400700  1 -- 172.21.15.171:0/3371470478 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0009550 con 0x7f43f006dcb0
2024-03-29T09:08:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.519+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f781c3060 con 0x7f6f7806e460
2024-03-29T09:08:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.519+0000 7f43f6800700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f0094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed!
2024-03-29T09:08:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.519+0000 7f43f5400700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006dcb0 0x7f43f00941f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43e000ec10 tx=0x7f43e000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.519+0000 7f43ea000700  1 -- 172.21.15.171:0/3371470478 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000c7f0 con 0x7f43f006dcb0
2024-03-29T09:08:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.519+0000 7f43ea000700  1 -- 172.21.15.171:0/3371470478 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e000c950 con 0x7f43f006dcb0
2024-03-29T09:08:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.519+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e40094a0 con 0x7f43f006dcb0
2024-03-29T09:08:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.519+0000 7f43ea000700  1 -- 172.21.15.171:0/3371470478 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000ccc0 con 0x7f43f006dcb0
2024-03-29T09:08:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.520+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f00955a0 con 0x7f43f006dcb0
2024-03-29T09:08:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.520+0000 7f6f6fe00700  1 -- 172.21.15.171:0/4121750498 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f6f6800cd20 con 0x7f6f7806e460
2024-03-29T09:08:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.520+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f780623e0 con 0x7f6f7806e460
2024-03-29T09:08:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.521+0000 7f6f6fe00700  1 -- 172.21.15.171:0/4121750498 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f6f6805ccc0 con 0x7f6f7806e460
2024-03-29T09:08:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.521+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f00623e0 con 0x7f43f006dcb0
2024-03-29T09:08:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.521+0000 7f43ea000700  1 -- 172.21.15.171:0/3371470478 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f43e0013470 con 0x7f43f006dcb0
2024-03-29T09:08:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.522+0000 7f43ea000700  1 -- 172.21.15.171:0/3371470478 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f43e005c840 con 0x7f43f006dcb0
2024-03-29T09:08:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.525+0000 7f6f6fe00700  1 -- 172.21.15.171:0/4121750498 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f6f6803a8b0 con 0x7f6f7806e460
2024-03-29T09:08:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.526+0000 7f43ea000700  1 -- 172.21.15.171:0/3371470478 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f43e003a570 con 0x7f43f006dcb0
2024-03-29T09:08:47.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.703+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f780748b0 con 0x7f6f7806e460
2024-03-29T09:08:47.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.704+0000 7f6f6fe00700  1 -- 172.21.15.171:0/4121750498 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0  v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f68017030 con 0x7f6f7806e460
2024-03-29T09:08:47.703 INFO:teuthology.orchestra.run.smithi171.stdout:107374182403
2024-03-29T09:08:47.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.706+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 >> v1:172.21.15.171:6816/44806 conn(0x7f6f580475f0 legacy=0x7f6f58049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806e460 msgr2=0x7f6f781bfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806e460 0x7f6f781bfb60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800e9b0 tx=0x7f6f6800ecc0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.706 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 shutdown_connections
2024-03-29T09:08:47.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6f78132e10 0x7f6f781c05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f7806e460 0x7f6f781bfb60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 --2- 172.21.15.171:0/4121750498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f7806ed80 0x7f6f781c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 >> 172.21.15.171:0/4121750498 conn(0x7f6f7809a230 msgr2=0x7f6f78071670 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:47.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 shutdown_connections
2024-03-29T09:08:47.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f6f7ea00700  1 -- 172.21.15.171:0/4121750498 wait complete.
2024-03-29T09:08:47.707 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.707+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43f0126810 con 0x7f43f006dcb0
2024-03-29T09:08:47.708 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.708+0000 7f43ea000700  1 -- 172.21.15.171:0/3371470478 <== mon.2 v2:172.21.15.171:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0  v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43f0126810 con 0x7f43f006dcb0
2024-03-29T09:08:47.708 INFO:teuthology.orchestra.run.smithi171.stdout:98784247812
2024-03-29T09:08:47.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.710+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 >> v1:172.21.15.171:6816/44806 conn(0x7f43d4047670 legacy=0x7f43d4049b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.710+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006dcb0 msgr2=0x7f43f00941f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.710+0000 7f43f8800700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006dcb0 0x7f43f00941f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43e000ec10 tx=0x7f43e000ef20 comp rx=0 tx=0).stop
2024-03-29T09:08:47.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.711+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 shutdown_connections
2024-03-29T09:08:47.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.711+0000 7f43f8800700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43f0070ed0 0x7f43f0094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.711+0000 7f43f8800700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43f006d310 0x7f43f0093cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.711+0000 7f43f8800700  1 --2- 172.21.15.171:0/3371470478 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f43f006dcb0 0x7f43f00941f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.711+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 >> 172.21.15.171:0/3371470478 conn(0x7f43f00978d0 msgr2=0x7f43f009a730 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:47.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.711+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 shutdown_connections
2024-03-29T09:08:47.711 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.711+0000 7f43f8800700  1 -- 172.21.15.171:0/3371470478 wait complete.
2024-03-29T09:08:47.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 107374182403 for osd.2
2024-03-29T09:08:47.733 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:47.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247812 for osd.0
2024-03-29T09:08:47.735 DEBUG:teuthology.parallel:result is None
2024-03-29T09:08:47.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean
2024-03-29T09:08:47.735 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.969+0000 7fe205600700  1  Processor -- start
2024-03-29T09:08:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.969+0000 7fe205600700  1 --  start start
2024-03-29T09:08:47.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.970+0000 7fe205600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe20012e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.970+0000 7fe205600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe20012ecc0 0x7fe20012ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.970+0000 7fe205600700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe200070d80 con 0x7fe20012b360
2024-03-29T09:08:47.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.970+0000 7fe205600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000715e0 con 0x7fe20012ecc0
2024-03-29T09:08:47.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.970+0000 7fe205600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000722b0 con 0x7fe20012e3a0
2024-03-29T09:08:47.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.970+0000 7fe1fea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe20012e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.970+0000 7fe1fe000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe20012ecc0 0x7fe20012ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fe000700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe20012ecc0 0x7fe20012ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59176/0 (socket says 172.21.15.171:59176)
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fe000700  1 -- 172.21.15.171:0/787892969 learned_addr learned my addr 172.21.15.171:0/787892969 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1ff400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7fe20012b360 0x7fe200135730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:40938/0 (socket says 172.21.15.171:40938)
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fea00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe20012e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60244/0 (socket says 172.21.15.171:60244)
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fea00700  1 -- 172.21.15.171:0/787892969 >> v2:172.21.15.171:3300/0 conn(0x7fe20012ecc0 msgr2=0x7fe20012ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fea00700  1 --2- 172.21.15.171:0/787892969 >> v2:172.21.15.171:3300/0 conn(0x7fe20012ecc0 0x7fe20012ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fea00700  1 -- 172.21.15.171:0/787892969 >> v1:172.21.15.171:6789/0 conn(0x7fe20012b360 legacy=0x7fe200135730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fea00700  1 -- 172.21.15.171:0/787892969 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200071b40 con 0x7fe20012e3a0
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fd600700  1 -- 172.21.15.171:0/787892969 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894108806 0 0) 0x7fe200070d80 con 0x7fe20012b360
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fe000700  1 --2- 172.21.15.171:0/787892969 >> v2:172.21.15.171:3300/0 conn(0x7fe20012ecc0 0x7fe20012ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:47.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fea00700  1 --2- 172.21.15.171:0/787892969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe20012e780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009870 tx=0x7fe1f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4f0e48a32cee93 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:47.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fd600700  1 -- 172.21.15.171:0/787892969 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011830 con 0x7fe20012e3a0
2024-03-29T09:08:47.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fd600700  1 -- 172.21.15.171:0/787892969 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0011990 con 0x7fe20012e3a0
2024-03-29T09:08:47.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.971+0000 7fe1fd600700  1 -- 172.21.15.171:0/787892969 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011d20 con 0x7fe20012e3a0
2024-03-29T09:08:47.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 -- 172.21.15.171:0/787892969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 msgr2=0x7fe20012e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 --2- 172.21.15.171:0/787892969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe20012e780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009870 tx=0x7fe1f0009b80 comp rx=0 tx=0).stop
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 -- 172.21.15.171:0/787892969 shutdown_connections
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 --2- 172.21.15.171:0/787892969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe20012e780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 --2- 172.21.15.171:0/787892969 >> v2:172.21.15.171:3300/0 conn(0x7fe20012ecc0 0x7fe20012ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 -- 172.21.15.171:0/787892969 >> 172.21.15.171:0/787892969 conn(0x7fe2000a0d70 msgr2=0x7fe2000a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 -- 172.21.15.171:0/787892969 shutdown_connections
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.972+0000 7fe205600700  1 -- 172.21.15.171:0/787892969 wait complete.
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1  Processor -- start
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1 --  start start
2024-03-29T09:08:47.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe20012b360 0x7fe2001c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe2001c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe20012ecc0 0x7fe200119da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20011bfc0 con 0x7fe20012b360
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20011c130 con 0x7fe20012e3a0
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.974+0000 7fe205600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001c3eb0 con 0x7fe20012ecc0
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe2001c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe2001c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60250/0 (socket says 172.21.15.171:60250)
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 -- 172.21.15.171:0/4023476269 learned_addr learned my addr 172.21.15.171:0/4023476269 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1ff400700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe20012ecc0 0x7fe200119da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fea00700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe20012b360 0x7fe2001c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:47.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 -- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe20012ecc0 msgr2=0x7fe200119da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe20012ecc0 0x7fe200119da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 -- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe20012b360 msgr2=0x7fe2001c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:47.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe20012b360 0x7fe2001c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:47.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 -- 172.21.15.171:0/4023476269 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009550 con 0x7fe20012e3a0
2024-03-29T09:08:47.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1fe000700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe2001c3970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00ebe0 tx=0x7fe1ec00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:47.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.975+0000 7fe1f6a00700  1 -- 172.21.15.171:0/4023476269 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00c850 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.976+0000 7fe1f6a00700  1 -- 172.21.15.171:0/4023476269 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec00c9b0 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.976+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f00094a0 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.976+0000 7fe1f6a00700  1 -- 172.21.15.171:0/4023476269 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00cd60 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.976+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20011cc30 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.977+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2001171d0 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.977+0000 7fe1f6a00700  1 -- 172.21.15.171:0/4023476269 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fe1ec013470 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.978+0000 7fe1f6a00700  1 -- 172.21.15.171:0/4023476269 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fe1ec05c900 con 0x7fe20012e3a0
2024-03-29T09:08:47.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:47.981+0000 7fe1f6a00700  1 -- 172.21.15.171:0/4023476269 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fe1ec03a4b0 con 0x7fe20012e3a0
2024-03-29T09:08:48.149 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.150+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2000623e0 con 0x7fe1e00475f0
2024-03-29T09:08:48.151 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.152+0000 7fe1f6a00700  1 -- 172.21.15.171:0/4023476269 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34618 (unknown 2965378022 0 1517338528) 0x7fe2000623e0 con 0x7fe1e00475f0
2024-03-29T09:08:48.151 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:48.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.153+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 >> v1:172.21.15.171:6816/44806 conn(0x7fe1e00475f0 legacy=0x7fe1e0049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 msgr2=0x7fe2001c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe2001c3970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00ebe0 tx=0x7fe1ec00eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 shutdown_connections
2024-03-29T09:08:48.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe20012ecc0 0x7fe200119da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe20012b360 0x7fe2001c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 --2- 172.21.15.171:0/4023476269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe20012e3a0 0x7fe2001c3970 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 >> 172.21.15.171:0/4023476269 conn(0x7fe2000a0d70 msgr2=0x7fe20006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:48.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 shutdown_connections
2024-03-29T09:08:48.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.154+0000 7fe205600700  1 -- 172.21.15.171:0/4023476269 wait complete.
2024-03-29T09:08:48.154 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:48.170 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-29T09:08:48.080826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115108,"kb_used_data":2152,"kb_used_omap":4,"kb_used_meta":112891,"kb_avail":377372252,"statfs":{"total":386547056640,"available":386429186048,"internally_reserved":0,"allocated":2203648,"data_stored":1540340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4636,"internal_metadata":115600868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282241+0000","last_change":"2024-03-29T09:08:40.602229+0000","last_active":"2024-03-29T09:08:43.282241+0000","last_peered":"2024-03-29T09:08:43.282241+0000","last_clean":"2024-03-29T09:08:43.282241+0000","last_became_active":"2024-03-29T09:08:40.601985+0000","last_became_peered":"2024-03-29T09:08:40.601985+0000","last_unstale":"2024-03-29T09:08:43.282241+0000","last_undegraded":"2024-03-29T09:08:43.282241+0000","last_fullsized":"2024-03-29T09:08:43.282241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:02:05.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609604+0000","last_change":"2024-03-29T09:08:38.252447+0000","last_active":"2024-03-29T09:08:43.609604+0000","last_peered":"2024-03-29T09:08:43.609604+0000","last_clean":"2024-03-29T09:08:43.609604+0000","last_became_active":"2024-03-29T09:08:38.252122+0000","last_became_peered":"2024-03-29T09:08:38.252122+0000","last_unstale":"2024-03-29T09:08:43.609604+0000","last_undegraded":"2024-03-29T09:08:43.609604+0000","last_fullsized":"2024-03-29T09:08:43.609604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:20.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282186+0000","last_change":"2024-03-29T09:08:40.601753+0000","last_active":"2024-03-29T09:08:43.282186+0000","last_peered":"2024-03-29T09:08:43.282186+0000","last_clean":"2024-03-29T09:08:43.282186+0000","last_became_active":"2024-03-29T09:08:40.601418+0000","last_became_peered":"2024-03-29T09:08:40.601418+0000","last_unstale":"2024-03-29T09:08:43.282186+0000","last_undegraded":"2024-03-29T09:08:43.282186+0000","last_fullsized":"2024-03-29T09:08:43.282186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:11:37.158605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282070+0000","last_change":"2024-03-29T09:08:40.554498+0000","last_active":"2024-03-29T09:08:43.282070+0000","last_peered":"2024-03-29T09:08:43.282070+0000","last_clean":"2024-03-29T09:08:43.282070+0000","last_became_active":"2024-03-29T09:08:40.554228+0000","last_became_peered":"2024-03-29T09:08:40.554228+0000","last_unstale":"2024-03-29T09:08:43.282070+0000","last_undegraded":"2024-03-29T09:08:43.282070+0000","last_fullsized":"2024-03-29T09:08:43.282070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:33:35.566190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'98","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609571+0000","last_change":"2024-03-29T09:08:38.258057+0000","last_active":"2024-03-29T09:08:43.609571+0000","last_peered":"2024-03-29T09:08:43.609571+0000","last_clean":"2024-03-29T09:08:43.609571+0000","last_became_active":"2024-03-29T09:08:38.252224+0000","last_became_peered":"2024-03-29T09:08:38.252224+0000","last_unstale":"2024-03-29T09:08:43.609571+0000","last_undegraded":"2024-03-29T09:08:43.609571+0000","last_fullsized":"2024-03-29T09:08:43.609571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T19:46:09.422195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282148+0000","last_change":"2024-03-29T09:08:40.253037+0000","last_active":"2024-03-29T09:08:43.282148+0000","last_peered":"2024-03-29T09:08:43.282148+0000","last_clean":"2024-03-29T09:08:43.282148+0000","last_became_active":"2024-03-29T09:08:40.252699+0000","last_became_peered":"2024-03-29T09:08:40.252699+0000","last_unstale":"2024-03-29T09:08:43.282148+0000","last_undegraded":"2024-03-29T09:08:43.282148+0000","last_fullsized":"2024-03-29T09:08:43.282148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:59:53.558716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.279082+0000","last_change":"2024-03-29T09:08:40.253174+0000","last_active":"2024-03-29T09:08:43.279082+0000","last_peered":"2024-03-29T09:08:43.279082+0000","last_clean":"2024-03-29T09:08:43.279082+0000","last_became_active":"2024-03-29T09:08:40.252878+0000","last_became_peered":"2024-03-29T09:08:40.252878+0000","last_unstale":"2024-03-29T09:08:43.279082+0000","last_undegraded":"2024-03-29T09:08:43.279082+0000","last_fullsized":"2024-03-29T09:08:43.279082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:52:36.947448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282101+0000","last_change":"2024-03-29T09:08:40.550924+0000","last_active":"2024-03-29T09:08:43.282101+0000","last_peered":"2024-03-29T09:08:43.282101+0000","last_clean":"2024-03-29T09:08:43.282101+0000","last_became_active":"2024-03-29T09:08:40.550604+0000","last_became_peered":"2024-03-29T09:08:40.550604+0000","last_unstale":"2024-03-29T09:08:43.282101+0000","last_undegraded":"2024-03-29T09:08:43.282101+0000","last_fullsized":"2024-03-29T09:08:43.282101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:36:25.128918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609633+0000","last_change":"2024-03-29T09:08:38.251213+0000","last_active":"2024-03-29T09:08:43.609633+0000","last_peered":"2024-03-29T09:08:43.609633+0000","last_clean":"2024-03-29T09:08:43.609633+0000","last_became_active":"2024-03-29T09:08:38.250953+0000","last_became_peered":"2024-03-29T09:08:38.250953+0000","last_unstale":"2024-03-29T09:08:43.609633+0000","last_undegraded":"2024-03-29T09:08:43.609633+0000","last_fullsized":"2024-03-29T09:08:43.609633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:06:03.995157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31294,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":32045945},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:48.172 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:48.365 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.365+0000 7f345e200700  1  Processor -- start
2024-03-29T09:08:48.365 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.365+0000 7f345e200700  1 --  start start
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f345e200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812e3a0 0x7f345812e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f345e200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f345812ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f345e200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f345812b360 0x7f345812b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f345e200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3458071520 con 0x7f345812b360
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f345e200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3458070d80 con 0x7f345812e3a0
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f345e200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34580722b0 con 0x7f345812ecc0
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f3457400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812e3a0 0x7f345812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f3457400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812e3a0 0x7f345812e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60256/0 (socket says 172.21.15.171:60256)
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f3456a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f345812ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f3457400700  1 -- 172.21.15.171:0/802487581 learned_addr learned my addr 172.21.15.171:0/802487581 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.366+0000 7f3457e00700  1 --2- 172.21.15.171:0/802487581 >> v2:172.21.15.171:3300/0 conn(0x7f345812b360 0x7f345812b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3457400700  1 -- 172.21.15.171:0/802487581 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 msgr2=0x7f345812ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3457400700  1 --2- 172.21.15.171:0/802487581 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f345812ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3457400700  1 -- 172.21.15.171:0/802487581 >> v2:172.21.15.171:3300/0 conn(0x7f345812b360 msgr2=0x7f345812b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3457400700  1 --2- 172.21.15.171:0/802487581 >> v2:172.21.15.171:3300/0 conn(0x7f345812b360 0x7f345812b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3457400700  1 -- 172.21.15.171:0/802487581 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458071b40 con 0x7f345812e3a0
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3457e00700  1 --2- 172.21.15.171:0/802487581 >> v2:172.21.15.171:3300/0 conn(0x7f345812b360 0x7f345812b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3457400700  1 --2- 172.21.15.171:0/802487581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812e3a0 0x7f345812e780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34480098f0 tx=0x7f3448009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa5621c0705c383 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3456000700  1 -- 172.21.15.171:0/802487581 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448011830 con 0x7f345812e3a0
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3456000700  1 -- 172.21.15.171:0/802487581 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448011990 con 0x7f345812e3a0
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.367+0000 7f3456000700  1 -- 172.21.15.171:0/802487581 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448011d20 con 0x7f345812e3a0
2024-03-29T09:08:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 -- 172.21.15.171:0/802487581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812e3a0 msgr2=0x7f345812e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 --2- 172.21.15.171:0/802487581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812e3a0 0x7f345812e780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34480098f0 tx=0x7f3448009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 -- 172.21.15.171:0/802487581 shutdown_connections
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 --2- 172.21.15.171:0/802487581 >> v2:172.21.15.171:3300/0 conn(0x7f345812b360 0x7f345812b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 --2- 172.21.15.171:0/802487581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812e3a0 0x7f345812e780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 --2- 172.21.15.171:0/802487581 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f345812ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 -- 172.21.15.171:0/802487581 >> 172.21.15.171:0/802487581 conn(0x7f34580a0d70 msgr2=0x7f34580a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 -- 172.21.15.171:0/802487581 shutdown_connections
2024-03-29T09:08:48.370 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.368+0000 7f345e200700  1 -- 172.21.15.171:0/802487581 wait complete.
2024-03-29T09:08:48.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.369+0000 7f345e200700  1  Processor -- start
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.369+0000 7f345e200700  1 --  start start
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f345e200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812b360 0x7f34581258a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f345e200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f345812e3a0 0x7f3458125de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f345e200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f3458126320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f345e200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3458126c60 con 0x7f345812e3a0
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f345e200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345812a7b0 con 0x7f345812b360
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f345e200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f345806ed40 con 0x7f345812ecc0
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f3457400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812b360 0x7f34581258a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f3456a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f345812e3a0 0x7f3458125de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f3457e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f3458126320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f3457400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812b360 0x7f34581258a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60266/0 (socket says 172.21.15.171:60266)
2024-03-29T09:08:48.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.370+0000 7f3457400700  1 -- 172.21.15.171:0/3566906546 learned_addr learned my addr 172.21.15.171:0/3566906546 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f3456a00700  1 -- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 msgr2=0x7f3458126320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f3456a00700  1 --2- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f3458126320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f3456a00700  1 -- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812b360 msgr2=0x7f34581258a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f3456a00700  1 --2- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812b360 0x7f34581258a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f3456a00700  1 -- 172.21.15.171:0/3566906546 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450009a70 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f3456a00700  1 --2- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f345812e3a0 0x7f3458125de0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f344400e8d0 tx=0x7f344400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f344f400700  1 -- 172.21.15.171:0/3566906546 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444013680 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f344f400700  1 -- 172.21.15.171:0/3566906546 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34440137e0 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3448009550 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f344f400700  1 -- 172.21.15.171:0/3566906546 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444013b50 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.371+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3458127430 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.372+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3458127fd0 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.373+0000 7f344f400700  1 -- 172.21.15.171:0/3566906546 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f3444013cb0 con 0x7f345812e3a0
2024-03-29T09:08:48.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.373+0000 7f344f400700  1 -- 172.21.15.171:0/3566906546 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f344405c7f0 con 0x7f345812e3a0
2024-03-29T09:08:48.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.377+0000 7f344f400700  1 -- 172.21.15.171:0/3566906546 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f344403a400 con 0x7f345812e3a0
2024-03-29T09:08:48.545 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.545+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34581171d0 con 0x7f34380475f0
2024-03-29T09:08:48.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.547+0000 7f344f400700  1 -- 172.21.15.171:0/3566906546 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34618 (unknown 2965378022 0 1517338528) 0x7f34581171d0 con 0x7f34380475f0
2024-03-29T09:08:48.547 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:48.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 >> v1:172.21.15.171:6816/44806 conn(0x7f34380475f0 legacy=0x7f3438049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f345812e3a0 msgr2=0x7f3458125de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 --2- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f345812e3a0 0x7f3458125de0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f344400e8d0 tx=0x7f344400ebe0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 shutdown_connections
2024-03-29T09:08:48.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 --2- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f345812ecc0 0x7f3458126320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 --2- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f345812b360 0x7f34581258a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 --2- 172.21.15.171:0/3566906546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f345812e3a0 0x7f3458125de0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 >> 172.21.15.171:0/3566906546 conn(0x7f34580a0d70 msgr2=0x7f345812c5a0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:48.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 shutdown_connections
2024-03-29T09:08:48.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.549+0000 7f345e200700  1 -- 172.21.15.171:0/3566906546 wait complete.
2024-03-29T09:08:48.549 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:48.565 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-29T09:08:48.080826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115108,"kb_used_data":2152,"kb_used_omap":4,"kb_used_meta":112891,"kb_avail":377372252,"statfs":{"total":386547056640,"available":386429186048,"internally_reserved":0,"allocated":2203648,"data_stored":1540340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4636,"internal_metadata":115600868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282241+0000","last_change":"2024-03-29T09:08:40.602229+0000","last_active":"2024-03-29T09:08:43.282241+0000","last_peered":"2024-03-29T09:08:43.282241+0000","last_clean":"2024-03-29T09:08:43.282241+0000","last_became_active":"2024-03-29T09:08:40.601985+0000","last_became_peered":"2024-03-29T09:08:40.601985+0000","last_unstale":"2024-03-29T09:08:43.282241+0000","last_undegraded":"2024-03-29T09:08:43.282241+0000","last_fullsized":"2024-03-29T09:08:43.282241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:02:05.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609604+0000","last_change":"2024-03-29T09:08:38.252447+0000","last_active":"2024-03-29T09:08:43.609604+0000","last_peered":"2024-03-29T09:08:43.609604+0000","last_clean":"2024-03-29T09:08:43.609604+0000","last_became_active":"2024-03-29T09:08:38.252122+0000","last_became_peered":"2024-03-29T09:08:38.252122+0000","last_unstale":"2024-03-29T09:08:43.609604+0000","last_undegraded":"2024-03-29T09:08:43.609604+0000","last_fullsized":"2024-03-29T09:08:43.609604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:20.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282186+0000","last_change":"2024-03-29T09:08:40.601753+0000","last_active":"2024-03-29T09:08:43.282186+0000","last_peered":"2024-03-29T09:08:43.282186+0000","last_clean":"2024-03-29T09:08:43.282186+0000","last_became_active":"2024-03-29T09:08:40.601418+0000","last_became_peered":"2024-03-29T09:08:40.601418+0000","last_unstale":"2024-03-29T09:08:43.282186+0000","last_undegraded":"2024-03-29T09:08:43.282186+0000","last_fullsized":"2024-03-29T09:08:43.282186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:11:37.158605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282070+0000","last_change":"2024-03-29T09:08:40.554498+0000","last_active":"2024-03-29T09:08:43.282070+0000","last_peered":"2024-03-29T09:08:43.282070+0000","last_clean":"2024-03-29T09:08:43.282070+0000","last_became_active":"2024-03-29T09:08:40.554228+0000","last_became_peered":"2024-03-29T09:08:40.554228+0000","last_unstale":"2024-03-29T09:08:43.282070+0000","last_undegraded":"2024-03-29T09:08:43.282070+0000","last_fullsized":"2024-03-29T09:08:43.282070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:33:35.566190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'98","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609571+0000","last_change":"2024-03-29T09:08:38.258057+0000","last_active":"2024-03-29T09:08:43.609571+0000","last_peered":"2024-03-29T09:08:43.609571+0000","last_clean":"2024-03-29T09:08:43.609571+0000","last_became_active":"2024-03-29T09:08:38.252224+0000","last_became_peered":"2024-03-29T09:08:38.252224+0000","last_unstale":"2024-03-29T09:08:43.609571+0000","last_undegraded":"2024-03-29T09:08:43.609571+0000","last_fullsized":"2024-03-29T09:08:43.609571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T19:46:09.422195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282148+0000","last_change":"2024-03-29T09:08:40.253037+0000","last_active":"2024-03-29T09:08:43.282148+0000","last_peered":"2024-03-29T09:08:43.282148+0000","last_clean":"2024-03-29T09:08:43.282148+0000","last_became_active":"2024-03-29T09:08:40.252699+0000","last_became_peered":"2024-03-29T09:08:40.252699+0000","last_unstale":"2024-03-29T09:08:43.282148+0000","last_undegraded":"2024-03-29T09:08:43.282148+0000","last_fullsized":"2024-03-29T09:08:43.282148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:59:53.558716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.279082+0000","last_change":"2024-03-29T09:08:40.253174+0000","last_active":"2024-03-29T09:08:43.279082+0000","last_peered":"2024-03-29T09:08:43.279082+0000","last_clean":"2024-03-29T09:08:43.279082+0000","last_became_active":"2024-03-29T09:08:40.252878+0000","last_became_peered":"2024-03-29T09:08:40.252878+0000","last_unstale":"2024-03-29T09:08:43.279082+0000","last_undegraded":"2024-03-29T09:08:43.279082+0000","last_fullsized":"2024-03-29T09:08:43.279082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:52:36.947448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282101+0000","last_change":"2024-03-29T09:08:40.550924+0000","last_active":"2024-03-29T09:08:43.282101+0000","last_peered":"2024-03-29T09:08:43.282101+0000","last_clean":"2024-03-29T09:08:43.282101+0000","last_became_active":"2024-03-29T09:08:40.550604+0000","last_became_peered":"2024-03-29T09:08:40.550604+0000","last_unstale":"2024-03-29T09:08:43.282101+0000","last_undegraded":"2024-03-29T09:08:43.282101+0000","last_fullsized":"2024-03-29T09:08:43.282101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:36:25.128918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609633+0000","last_change":"2024-03-29T09:08:38.251213+0000","last_active":"2024-03-29T09:08:43.609633+0000","last_peered":"2024-03-29T09:08:43.609633+0000","last_clean":"2024-03-29T09:08:43.609633+0000","last_became_active":"2024-03-29T09:08:38.250953+0000","last_became_peered":"2024-03-29T09:08:38.250953+0000","last_unstale":"2024-03-29T09:08:43.609633+0000","last_undegraded":"2024-03-29T09:08:43.609633+0000","last_fullsized":"2024-03-29T09:08:43.609633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:06:03.995157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31294,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":32045945},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:48.566 INFO:tasks.ceph.ceph_manager.ceph:clean!
2024-03-29T09:08:48.566 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy...
2024-03-29T09:08:48.567 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy
2024-03-29T09:08:48.567 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json
2024-03-29T09:08:48.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.760+0000 7ff24e200700  1  Processor -- start
2024-03-29T09:08:48.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.760+0000 7ff24e200700  1 --  start start
2024-03-29T09:08:48.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.760+0000 7ff24e200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff24812e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.760+0000 7ff24e200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff24812b530 0x7ff248136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.760+0000 7ff24e200700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff248070d80 con 0x7ff24812ecc0
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.760+0000 7ff24e200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2480715e0 con 0x7ff24812b530
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.760+0000 7ff24e200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480722b0 con 0x7ff24812e3a0
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff24812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff24812b530 0x7ff248136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff24812e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60274/0 (socket says 172.21.15.171:60274)
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247400700  1 -- 172.21.15.171:0/2558232680 learned_addr learned my addr 172.21.15.171:0/2558232680 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7ff24812b530 0x7ff248136740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59222/0 (socket says 172.21.15.171:59222)
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247e00700  1 -- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 msgr2=0x7ff24812e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247e00700  1 --2- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff24812e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247e00700  1 -- 172.21.15.171:0/2558232680 >> v1:172.21.15.171:6789/0 conn(0x7ff24812ecc0 legacy=0x7ff24812ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247e00700  1 -- 172.21.15.171:0/2558232680 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248071b40 con 0x7ff24812b530
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247400700  1 --2- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff24812e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.761+0000 7ff247e00700  1 --2- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248136740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff240009d90 tx=0x7ff24000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3e060abd07db60 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff246000700  1 -- 172.21.15.171:0/2558232680 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24000e070 con 0x7ff24812b530
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff246000700  1 -- 172.21.15.171:0/2558232680 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24000bb20 con 0x7ff24812b530
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff246000700  1 -- 172.21.15.171:0/2558232680 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240012430 con 0x7ff24812b530
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 -- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 msgr2=0x7ff248136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 --2- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248136740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff240009d90 tx=0x7ff24000b330 comp rx=0 tx=0).stop
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 -- 172.21.15.171:0/2558232680 shutdown_connections
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 --2- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248136740 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 --2- 172.21.15.171:0/2558232680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff24812e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 -- 172.21.15.171:0/2558232680 >> 172.21.15.171:0/2558232680 conn(0x7ff2480a0d70 msgr2=0x7ff2480a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 -- 172.21.15.171:0/2558232680 shutdown_connections
2024-03-29T09:08:48.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.762+0000 7ff24e200700  1 -- 172.21.15.171:0/2558232680 wait complete.
2024-03-29T09:08:48.765 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1  Processor -- start
2024-03-29T09:08:48.765 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1 --  start start
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff248123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff24812ecc0 0x7ff2481238c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24812f9c0 con 0x7ff24812b530
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2481366e0 con 0x7ff24812e3a0
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.764+0000 7ff24e200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff248130190 con 0x7ff24812ecc0
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff246a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff248123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59226/0 (socket says 172.21.15.171:59226)
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 -- 172.21.15.171:0/235374510 learned_addr learned my addr 172.21.15.171:0/235374510 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247e00700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff24812ecc0 0x7ff2481238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:48.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 -- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff24812ecc0 msgr2=0x7ff2481238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff24812ecc0 0x7ff2481238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 -- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 msgr2=0x7ff248123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff248123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 -- 172.21.15.171:0/235374510 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff238009550 con 0x7ff24812b530
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff246a00700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff248123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff247400700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248122e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff23800ebe0 tx=0x7ff23800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.765+0000 7ff23f400700  1 -- 172.21.15.171:0/235374510 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23800c850 con 0x7ff24812b530
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.766+0000 7ff23f400700  1 -- 172.21.15.171:0/235374510 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23800c9b0 con 0x7ff24812b530
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.766+0000 7ff23f400700  1 -- 172.21.15.171:0/235374510 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23800cd40 con 0x7ff24812b530
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.766+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff240009a70 con 0x7ff24812b530
2024-03-29T09:08:48.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.766+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24812ff50 con 0x7ff24812b530
2024-03-29T09:08:48.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.767+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2481363a0 con 0x7ff24812b530
2024-03-29T09:08:48.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.767+0000 7ff23f400700  1 -- 172.21.15.171:0/235374510 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7ff238013470 con 0x7ff24812b530
2024-03-29T09:08:48.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.768+0000 7ff23f400700  1 -- 172.21.15.171:0/235374510 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7ff23805c8d0 con 0x7ff24812b530
2024-03-29T09:08:48.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.771+0000 7ff23f400700  1 -- 172.21.15.171:0/235374510 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7ff23803a480 con 0x7ff24812b530
2024-03-29T09:08:48.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.975+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff24812ff50 con 0x7ff24812b530
2024-03-29T09:08:48.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.976+0000 7ff23f400700  1 -- 172.21.15.171:0/235374510 <== mon.0 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0  v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff24812ff50 con 0x7ff24812b530
2024-03-29T09:08:48.975 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:48.975 INFO:teuthology.orchestra.run.smithi171.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]}
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 >> v1:172.21.15.171:6816/44806 conn(0x7ff2280475f0 legacy=0x7ff228049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 msgr2=0x7ff248122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248122e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff23800ebe0 tx=0x7ff23800eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 shutdown_connections
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff24812ecc0 0x7ff2481238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff24812b530 0x7ff248122e40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 --2- 172.21.15.171:0/235374510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24812e3a0 0x7ff248123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 >> 172.21.15.171:0/235374510 conn(0x7ff2480a0d70 msgr2=0x7ff24806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 shutdown_connections
2024-03-29T09:08:48.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:48.978+0000 7ff24e200700  1 -- 172.21.15.171:0/235374510 wait complete.
2024-03-29T09:08:48.995 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done
2024-03-29T09:08:48.996 INFO:teuthology.run_tasks:Running task print...
2024-03-29T09:08:49.012 INFO:teuthology.task.print:**** done ceph.restart
2024-03-29T09:08:49.012 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart
2024-03-29T09:08:49.024 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart
2024-03-29T09:08:49.035 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade
2024-03-29T09:08:49.045 DEBUG:teuthology.run_tasks:Unwinding manager ceph
2024-03-29T09:08:49.056 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean
2024-03-29T09:08:49.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:49.248 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.249+0000 7ff953a00700  1  Processor -- start
2024-03-29T09:08:49.248 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.249+0000 7ff953a00700  1 --  start start
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff953a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c133720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff953a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff953a00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c071520 con 0x7ff94c12e3a0
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff953a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c070d80 con 0x7ff94c12ee90
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff953a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0722b0 con 0x7ff94c133c60
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff951a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff94be00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff951000700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7ff94c12e3a0 0x7ff94c12e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:40960/0 (socket says 172.21.15.171:40960)
2024-03-29T09:08:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.250+0000 7ff951000700  1 -- 172.21.15.171:0/1847641086 learned_addr learned my addr 172.21.15.171:0/1847641086 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff951a00700  1 -- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 msgr2=0x7ff94c133720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff951a00700  1 --2- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c133720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff951a00700  1 -- 172.21.15.171:0/1847641086 >> v1:172.21.15.171:6789/0 conn(0x7ff94c12e3a0 legacy=0x7ff94c12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff951a00700  1 -- 172.21.15.171:0/1847641086 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c071b40 con 0x7ff94c133c60
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff94b400700  1 -- 172.21.15.171:0/1847641086 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953185255 0 0) 0x7ff94c071520 con 0x7ff94c12e3a0
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff94be00700  1 --2- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c133720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff951a00700  1 --2- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c136050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ae92e5a5a39555 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:49.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff94b400700  1 -- 172.21.15.171:0/1847641086 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400e070 con 0x7ff94c133c60
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff94b400700  1 -- 172.21.15.171:0/1847641086 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400bb20 con 0x7ff94c133c60
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.251+0000 7ff94b400700  1 -- 172.21.15.171:0/1847641086 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944012430 con 0x7ff94c133c60
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 -- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 msgr2=0x7ff94c136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 --2- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c136050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).stop
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 -- 172.21.15.171:0/1847641086 shutdown_connections
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 --2- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c136050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 --2- 172.21.15.171:0/1847641086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c133720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 -- 172.21.15.171:0/1847641086 >> 172.21.15.171:0/1847641086 conn(0x7ff94c0a0d70 msgr2=0x7ff94c0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 -- 172.21.15.171:0/1847641086 shutdown_connections
2024-03-29T09:08:49.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.252+0000 7ff953a00700  1 -- 172.21.15.171:0/1847641086 wait complete.
2024-03-29T09:08:49.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.253+0000 7ff953a00700  1  Processor -- start
2024-03-29T09:08:49.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff953a00700  1 --  start start
2024-03-29T09:08:49.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff953a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff94c12e3a0 0x7ff94c121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff953a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c122060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff953a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c1c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff953a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c127dd0 con 0x7ff94c12e3a0
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff953a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c1284b0 con 0x7ff94c12ee90
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff953a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c1216d0 con 0x7ff94c133c60
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff94be00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c122060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff951a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c1c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff94be00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c122060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60314/0 (socket says 172.21.15.171:60314)
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.254+0000 7ff94be00700  1 -- 172.21.15.171:0/3289424996 learned_addr learned my addr 172.21.15.171:0/3289424996 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff951000700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff94c12e3a0 0x7ff94c121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff94be00700  1 -- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 msgr2=0x7ff94c1c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff94be00700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c1c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff94be00700  1 -- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff94c12e3a0 msgr2=0x7ff94c121b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff94be00700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff94c12e3a0 0x7ff94c121b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff94be00700  1 -- 172.21.15.171:0/3289424996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380094a0 con 0x7ff94c12ee90
2024-03-29T09:08:49.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff94be00700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c122060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff93800ebe0 tx=0x7ff93800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:49.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff948c00700  1 -- 172.21.15.171:0/3289424996 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800c850 con 0x7ff94c12ee90
2024-03-29T09:08:49.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff948c00700  1 -- 172.21.15.171:0/3289424996 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800c9b0 con 0x7ff94c12ee90
2024-03-29T09:08:49.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff948c00700  1 -- 172.21.15.171:0/3289424996 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800cd40 con 0x7ff94c12ee90
2024-03-29T09:08:49.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.255+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff944009a70 con 0x7ff94c12ee90
2024-03-29T09:08:49.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.256+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c123a20 con 0x7ff94c12ee90
2024-03-29T09:08:49.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.257+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c1171d0 con 0x7ff94c12ee90
2024-03-29T09:08:49.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.257+0000 7ff948c00700  1 -- 172.21.15.171:0/3289424996 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7ff938013470 con 0x7ff94c12ee90
2024-03-29T09:08:49.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.258+0000 7ff948c00700  1 -- 172.21.15.171:0/3289424996 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7ff93805c8d0 con 0x7ff94c12ee90
2024-03-29T09:08:49.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.262+0000 7ff948c00700  1 -- 172.21.15.171:0/3289424996 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7ff93803a640 con 0x7ff94c12ee90
2024-03-29T09:08:49.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.424+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff94c0623e0 con 0x7ff92c0475f0
2024-03-29T09:08:49.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.425+0000 7ff948c00700  1 -- 172.21.15.171:0/3289424996 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34618 (unknown 2965378022 0 1517338528) 0x7ff94c0623e0 con 0x7ff92c0475f0
2024-03-29T09:08:49.425 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:49.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 >> v1:172.21.15.171:6816/44806 conn(0x7ff92c0475f0 legacy=0x7ff92c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 msgr2=0x7ff94c122060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c122060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff93800ebe0 tx=0x7ff93800eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 shutdown_connections
2024-03-29T09:08:49.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7ff94c133c60 0x7ff94c1c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff94c12e3a0 0x7ff94c121b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.427 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 --2- 172.21.15.171:0/3289424996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff94c12ee90 0x7ff94c122060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.428 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.427+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 >> 172.21.15.171:0/3289424996 conn(0x7ff94c0a0d70 msgr2=0x7ff94c06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:49.428 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.428+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 shutdown_connections
2024-03-29T09:08:49.428 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.428+0000 7ff953a00700  1 -- 172.21.15.171:0/3289424996 wait complete.
2024-03-29T09:08:49.428 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:49.445 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-29T09:08:48.080826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115108,"kb_used_data":2152,"kb_used_omap":4,"kb_used_meta":112891,"kb_avail":377372252,"statfs":{"total":386547056640,"available":386429186048,"internally_reserved":0,"allocated":2203648,"data_stored":1540340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4636,"internal_metadata":115600868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282241+0000","last_change":"2024-03-29T09:08:40.602229+0000","last_active":"2024-03-29T09:08:43.282241+0000","last_peered":"2024-03-29T09:08:43.282241+0000","last_clean":"2024-03-29T09:08:43.282241+0000","last_became_active":"2024-03-29T09:08:40.601985+0000","last_became_peered":"2024-03-29T09:08:40.601985+0000","last_unstale":"2024-03-29T09:08:43.282241+0000","last_undegraded":"2024-03-29T09:08:43.282241+0000","last_fullsized":"2024-03-29T09:08:43.282241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:02:05.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609604+0000","last_change":"2024-03-29T09:08:38.252447+0000","last_active":"2024-03-29T09:08:43.609604+0000","last_peered":"2024-03-29T09:08:43.609604+0000","last_clean":"2024-03-29T09:08:43.609604+0000","last_became_active":"2024-03-29T09:08:38.252122+0000","last_became_peered":"2024-03-29T09:08:38.252122+0000","last_unstale":"2024-03-29T09:08:43.609604+0000","last_undegraded":"2024-03-29T09:08:43.609604+0000","last_fullsized":"2024-03-29T09:08:43.609604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:20.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282186+0000","last_change":"2024-03-29T09:08:40.601753+0000","last_active":"2024-03-29T09:08:43.282186+0000","last_peered":"2024-03-29T09:08:43.282186+0000","last_clean":"2024-03-29T09:08:43.282186+0000","last_became_active":"2024-03-29T09:08:40.601418+0000","last_became_peered":"2024-03-29T09:08:40.601418+0000","last_unstale":"2024-03-29T09:08:43.282186+0000","last_undegraded":"2024-03-29T09:08:43.282186+0000","last_fullsized":"2024-03-29T09:08:43.282186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:11:37.158605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282070+0000","last_change":"2024-03-29T09:08:40.554498+0000","last_active":"2024-03-29T09:08:43.282070+0000","last_peered":"2024-03-29T09:08:43.282070+0000","last_clean":"2024-03-29T09:08:43.282070+0000","last_became_active":"2024-03-29T09:08:40.554228+0000","last_became_peered":"2024-03-29T09:08:40.554228+0000","last_unstale":"2024-03-29T09:08:43.282070+0000","last_undegraded":"2024-03-29T09:08:43.282070+0000","last_fullsized":"2024-03-29T09:08:43.282070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:33:35.566190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'98","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609571+0000","last_change":"2024-03-29T09:08:38.258057+0000","last_active":"2024-03-29T09:08:43.609571+0000","last_peered":"2024-03-29T09:08:43.609571+0000","last_clean":"2024-03-29T09:08:43.609571+0000","last_became_active":"2024-03-29T09:08:38.252224+0000","last_became_peered":"2024-03-29T09:08:38.252224+0000","last_unstale":"2024-03-29T09:08:43.609571+0000","last_undegraded":"2024-03-29T09:08:43.609571+0000","last_fullsized":"2024-03-29T09:08:43.609571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T19:46:09.422195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282148+0000","last_change":"2024-03-29T09:08:40.253037+0000","last_active":"2024-03-29T09:08:43.282148+0000","last_peered":"2024-03-29T09:08:43.282148+0000","last_clean":"2024-03-29T09:08:43.282148+0000","last_became_active":"2024-03-29T09:08:40.252699+0000","last_became_peered":"2024-03-29T09:08:40.252699+0000","last_unstale":"2024-03-29T09:08:43.282148+0000","last_undegraded":"2024-03-29T09:08:43.282148+0000","last_fullsized":"2024-03-29T09:08:43.282148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:59:53.558716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.279082+0000","last_change":"2024-03-29T09:08:40.253174+0000","last_active":"2024-03-29T09:08:43.279082+0000","last_peered":"2024-03-29T09:08:43.279082+0000","last_clean":"2024-03-29T09:08:43.279082+0000","last_became_active":"2024-03-29T09:08:40.252878+0000","last_became_peered":"2024-03-29T09:08:40.252878+0000","last_unstale":"2024-03-29T09:08:43.279082+0000","last_undegraded":"2024-03-29T09:08:43.279082+0000","last_fullsized":"2024-03-29T09:08:43.279082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:52:36.947448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282101+0000","last_change":"2024-03-29T09:08:40.550924+0000","last_active":"2024-03-29T09:08:43.282101+0000","last_peered":"2024-03-29T09:08:43.282101+0000","last_clean":"2024-03-29T09:08:43.282101+0000","last_became_active":"2024-03-29T09:08:40.550604+0000","last_became_peered":"2024-03-29T09:08:40.550604+0000","last_unstale":"2024-03-29T09:08:43.282101+0000","last_undegraded":"2024-03-29T09:08:43.282101+0000","last_fullsized":"2024-03-29T09:08:43.282101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:36:25.128918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609633+0000","last_change":"2024-03-29T09:08:38.251213+0000","last_active":"2024-03-29T09:08:43.609633+0000","last_peered":"2024-03-29T09:08:43.609633+0000","last_clean":"2024-03-29T09:08:43.609633+0000","last_became_active":"2024-03-29T09:08:38.250953+0000","last_became_peered":"2024-03-29T09:08:38.250953+0000","last_unstale":"2024-03-29T09:08:43.609633+0000","last_undegraded":"2024-03-29T09:08:43.609633+0000","last_fullsized":"2024-03-29T09:08:43.609633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:06:03.995157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31294,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":32045945},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:49.446 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:49.638 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.639+0000 7fcc02200700  1  Processor -- start
2024-03-29T09:08:49.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.639+0000 7fcc02200700  1 --  start start
2024-03-29T09:08:49.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcc02200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12e3f0 0x7fcbfc12e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcc02200700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fcbfc12ed10 0x7fcbfc12ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcc02200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12b3b0 0x7fcbfc12b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcc02200700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc071530 con 0x7fcbfc12ed10
2024-03-29T09:08:49.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcc02200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc071010 con 0x7fcbfc12b3b0
2024-03-29T09:08:49.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcc02200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0722c0 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfbe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12b3b0 0x7fcbfc12b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfaa00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fcbfc12ed10 0x7fcbfc12ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfb400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12e3f0 0x7fcbfc12e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfb400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12e3f0 0x7fcbfc12e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35388/0 (socket says 172.21.15.171:35388)
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfbe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12b3b0 0x7fcbfc12b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60316/0 (socket says 172.21.15.171:60316)
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfb400700  1 -- 172.21.15.171:0/2799383656 learned_addr learned my addr 172.21.15.171:0/2799383656 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfaa00700  1 -- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12e3f0 msgr2=0x7fcbfc12e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfaa00700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12e3f0 0x7fcbfc12e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfaa00700  1 -- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12b3b0 msgr2=0x7fcbfc12b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.640+0000 7fcbfaa00700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12b3b0 0x7fcbfc12b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.641+0000 7fcbfaa00700  1 -- 172.21.15.171:0/2799383656 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc12f130 con 0x7fcbfc12ed10
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.641+0000 7fcbfb400700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12e3f0 0x7fcbfc12e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:49.642 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.641+0000 7fcbfbe00700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12b3b0 0x7fcbfc12b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.641+0000 7fcbfaa00700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12ed10 0x7fcbfc12ae70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009840 tx=0x7fcbe8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae5de57073c8d3b server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.641+0000 7fcbfa000700  1 -- 172.21.15.171:0/2799383656 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbfc12ed10
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.641+0000 7fcbfa000700  1 -- 172.21.15.171:0/2799383656 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbfc12ed10
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.641+0000 7fcbfa000700  1 -- 172.21.15.171:0/2799383656 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d20 con 0x7fcbfc12ed10
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 -- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12ed10 msgr2=0x7fcbfc12ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12ed10 0x7fcbfc12ae70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009840 tx=0x7fcbe8009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 -- 172.21.15.171:0/2799383656 shutdown_connections
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12b3b0 0x7fcbfc12b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12e3f0 0x7fcbfc12e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 --2- 172.21.15.171:0/2799383656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12ed10 0x7fcbfc12ae70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 -- 172.21.15.171:0/2799383656 >> 172.21.15.171:0/2799383656 conn(0x7fcbfc0a0d70 msgr2=0x7fcbfc0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 -- 172.21.15.171:0/2799383656 shutdown_connections
2024-03-29T09:08:49.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.642+0000 7fcc02200700  1 -- 172.21.15.171:0/2799383656 wait complete.
2024-03-29T09:08:49.645 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.643+0000 7fcc02200700  1  Processor -- start
2024-03-29T09:08:49.645 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.643+0000 7fcc02200700  1 --  start start
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcc02200700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12b3b0 0x7fcbfc1c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcc02200700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12e3f0 0x7fcbfc1c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcc02200700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12ed10 0x7fcbfc1c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcc02200700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1248c0 con 0x7fcbfc12b3b0
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcc02200700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc125110 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcc02200700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1304f0 con 0x7fcbfc12ed10
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcbfaa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12e3f0 0x7fcbfc1c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcbfaa00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12e3f0 0x7fcbfc1c35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60318/0 (socket says 172.21.15.171:60318)
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcbfaa00700  1 -- 172.21.15.171:0/536237207 learned_addr learned my addr 172.21.15.171:0/536237207 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcbfbe00700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12ed10 0x7fcbfc1c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcbfb400700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12b3b0 0x7fcbfc1c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:49.646 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcbfaa00700  1 -- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12ed10 msgr2=0x7fcbfc1c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.644+0000 7fcbfaa00700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12ed10 0x7fcbfc1c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbfaa00700  1 -- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12b3b0 msgr2=0x7fcbfc1c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbfaa00700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12b3b0 0x7fcbfc1c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbfaa00700  1 -- 172.21.15.171:0/536237207 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf4009a70 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbfb400700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12b3b0 0x7fcbfc1c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbfaa00700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12e3f0 0x7fcbfc1c35b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8000c00 tx=0x7fcbe8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbf3400700  1 -- 172.21.15.171:0/536237207 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8004240 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbf3400700  1 -- 172.21.15.171:0/536237207 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe801f070 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcbf3400700  1 -- 172.21.15.171:0/536237207 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe80045e0 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec009550 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.645+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe80094a0 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.646+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc0623e0 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.647 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.646+0000 7fcbf3400700  1 -- 172.21.15.171:0/536237207 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fcbe8021030 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.648 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.647+0000 7fcbf3400700  1 -- 172.21.15.171:0/536237207 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fcbe805d690 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.650 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.651+0000 7fcbf3400700  1 -- 172.21.15.171:0/536237207 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fcbe8007e90 con 0x7fcbfc12e3f0
2024-03-29T09:08:49.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.823+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbfc067ce0 con 0x7fcbdc0475f0
2024-03-29T09:08:49.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.824+0000 7fcbf3400700  1 -- 172.21.15.171:0/536237207 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34618 (unknown 2965378022 0 1517338528) 0x7fcbfc067ce0 con 0x7fcbdc0475f0
2024-03-29T09:08:49.824 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:49.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.826+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 >> v1:172.21.15.171:6816/44806 conn(0x7fcbdc0475f0 legacy=0x7fcbdc049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.826+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12e3f0 msgr2=0x7fcbfc1c35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:49.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.826+0000 7fcc02200700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12e3f0 0x7fcbfc1c35b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8000c00 tx=0x7fcbe8004750 comp rx=0 tx=0).stop
2024-03-29T09:08:49.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.827+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 shutdown_connections
2024-03-29T09:08:49.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.827+0000 7fcc02200700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcbfc12ed10 0x7fcbfc1c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.827+0000 7fcc02200700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbfc12b3b0 0x7fcbfc1c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.827+0000 7fcc02200700  1 --2- 172.21.15.171:0/536237207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbfc12e3f0 0x7fcbfc1c35b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:49.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.827+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 >> 172.21.15.171:0/536237207 conn(0x7fcbfc0a0d70 msgr2=0x7fcbfc12bfc0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:49.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.827+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 shutdown_connections
2024-03-29T09:08:49.827 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:49.827+0000 7fcc02200700  1 -- 172.21.15.171:0/536237207 wait complete.
2024-03-29T09:08:49.827 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:49.845 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-29T09:08:48.080826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115108,"kb_used_data":2152,"kb_used_omap":4,"kb_used_meta":112891,"kb_avail":377372252,"statfs":{"total":386547056640,"available":386429186048,"internally_reserved":0,"allocated":2203648,"data_stored":1540340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4636,"internal_metadata":115600868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282241+0000","last_change":"2024-03-29T09:08:40.602229+0000","last_active":"2024-03-29T09:08:43.282241+0000","last_peered":"2024-03-29T09:08:43.282241+0000","last_clean":"2024-03-29T09:08:43.282241+0000","last_became_active":"2024-03-29T09:08:40.601985+0000","last_became_peered":"2024-03-29T09:08:40.601985+0000","last_unstale":"2024-03-29T09:08:43.282241+0000","last_undegraded":"2024-03-29T09:08:43.282241+0000","last_fullsized":"2024-03-29T09:08:43.282241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:02:05.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609604+0000","last_change":"2024-03-29T09:08:38.252447+0000","last_active":"2024-03-29T09:08:43.609604+0000","last_peered":"2024-03-29T09:08:43.609604+0000","last_clean":"2024-03-29T09:08:43.609604+0000","last_became_active":"2024-03-29T09:08:38.252122+0000","last_became_peered":"2024-03-29T09:08:38.252122+0000","last_unstale":"2024-03-29T09:08:43.609604+0000","last_undegraded":"2024-03-29T09:08:43.609604+0000","last_fullsized":"2024-03-29T09:08:43.609604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:20.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282186+0000","last_change":"2024-03-29T09:08:40.601753+0000","last_active":"2024-03-29T09:08:43.282186+0000","last_peered":"2024-03-29T09:08:43.282186+0000","last_clean":"2024-03-29T09:08:43.282186+0000","last_became_active":"2024-03-29T09:08:40.601418+0000","last_became_peered":"2024-03-29T09:08:40.601418+0000","last_unstale":"2024-03-29T09:08:43.282186+0000","last_undegraded":"2024-03-29T09:08:43.282186+0000","last_fullsized":"2024-03-29T09:08:43.282186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:11:37.158605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282070+0000","last_change":"2024-03-29T09:08:40.554498+0000","last_active":"2024-03-29T09:08:43.282070+0000","last_peered":"2024-03-29T09:08:43.282070+0000","last_clean":"2024-03-29T09:08:43.282070+0000","last_became_active":"2024-03-29T09:08:40.554228+0000","last_became_peered":"2024-03-29T09:08:40.554228+0000","last_unstale":"2024-03-29T09:08:43.282070+0000","last_undegraded":"2024-03-29T09:08:43.282070+0000","last_fullsized":"2024-03-29T09:08:43.282070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:33:35.566190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'98","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609571+0000","last_change":"2024-03-29T09:08:38.258057+0000","last_active":"2024-03-29T09:08:43.609571+0000","last_peered":"2024-03-29T09:08:43.609571+0000","last_clean":"2024-03-29T09:08:43.609571+0000","last_became_active":"2024-03-29T09:08:38.252224+0000","last_became_peered":"2024-03-29T09:08:38.252224+0000","last_unstale":"2024-03-29T09:08:43.609571+0000","last_undegraded":"2024-03-29T09:08:43.609571+0000","last_fullsized":"2024-03-29T09:08:43.609571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T19:46:09.422195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282148+0000","last_change":"2024-03-29T09:08:40.253037+0000","last_active":"2024-03-29T09:08:43.282148+0000","last_peered":"2024-03-29T09:08:43.282148+0000","last_clean":"2024-03-29T09:08:43.282148+0000","last_became_active":"2024-03-29T09:08:40.252699+0000","last_became_peered":"2024-03-29T09:08:40.252699+0000","last_unstale":"2024-03-29T09:08:43.282148+0000","last_undegraded":"2024-03-29T09:08:43.282148+0000","last_fullsized":"2024-03-29T09:08:43.282148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:59:53.558716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.279082+0000","last_change":"2024-03-29T09:08:40.253174+0000","last_active":"2024-03-29T09:08:43.279082+0000","last_peered":"2024-03-29T09:08:43.279082+0000","last_clean":"2024-03-29T09:08:43.279082+0000","last_became_active":"2024-03-29T09:08:40.252878+0000","last_became_peered":"2024-03-29T09:08:40.252878+0000","last_unstale":"2024-03-29T09:08:43.279082+0000","last_undegraded":"2024-03-29T09:08:43.279082+0000","last_fullsized":"2024-03-29T09:08:43.279082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:52:36.947448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282101+0000","last_change":"2024-03-29T09:08:40.550924+0000","last_active":"2024-03-29T09:08:43.282101+0000","last_peered":"2024-03-29T09:08:43.282101+0000","last_clean":"2024-03-29T09:08:43.282101+0000","last_became_active":"2024-03-29T09:08:40.550604+0000","last_became_peered":"2024-03-29T09:08:40.550604+0000","last_unstale":"2024-03-29T09:08:43.282101+0000","last_undegraded":"2024-03-29T09:08:43.282101+0000","last_fullsized":"2024-03-29T09:08:43.282101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:36:25.128918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609633+0000","last_change":"2024-03-29T09:08:38.251213+0000","last_active":"2024-03-29T09:08:43.609633+0000","last_peered":"2024-03-29T09:08:43.609633+0000","last_clean":"2024-03-29T09:08:43.609633+0000","last_became_active":"2024-03-29T09:08:38.250953+0000","last_became_peered":"2024-03-29T09:08:38.250953+0000","last_unstale":"2024-03-29T09:08:43.609633+0000","last_undegraded":"2024-03-29T09:08:43.609633+0000","last_fullsized":"2024-03-29T09:08:43.609633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:06:03.995157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":0,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31294,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":32045945},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:49.846 INFO:tasks.ceph.ceph_manager.ceph:clean!
2024-03-29T09:08:49.846 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:50.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1  Processor -- start
2024-03-29T09:08:50.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1 --  start start
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f3bec12e3a0 0x7f3bec12e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12ecc0 0x7f3bec12ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12b360 0x7f3bec12b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec071520 con 0x7f3bec12e3a0
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec070d80 con 0x7f3bec12b360
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.040+0000 7f3bf2600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0722b0 con 0x7f3bec12ecc0
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12ecc0 0x7f3bec12ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3bebe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12b360 0x7f3bec12b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beb400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f3bec12e3a0 0x7f3bec12e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12ecc0 0x7f3bec12ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35396/0 (socket says 172.21.15.171:35396)
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3bebe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12b360 0x7f3bec12b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60328/0 (socket says 172.21.15.171:60328)
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beaa00700  1 -- 172.21.15.171:0/2708078676 learned_addr learned my addr 172.21.15.171:0/2708078676 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beb400700  1 -- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12ecc0 msgr2=0x7f3bec12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beb400700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12ecc0 0x7f3bec12ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beb400700  1 -- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12b360 msgr2=0x7f3bec12b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beb400700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12b360 0x7f3bec12b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beb400700  1 -- 172.21.15.171:0/2708078676 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec071b40 con 0x7f3bec12e3a0
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beaa00700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12ecc0 0x7f3bec12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.041+0000 7f3beb400700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12e3a0 0x7f3bec12e780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009840 tx=0x7f3bdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8874bc50ae1df848 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bea000700  1 -- 172.21.15.171:0/2708078676 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011830 con 0x7f3bec12e3a0
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bea000700  1 -- 172.21.15.171:0/2708078676 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc011990 con 0x7f3bec12e3a0
2024-03-29T09:08:50.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bea000700  1 -- 172.21.15.171:0/2708078676 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011d20 con 0x7f3bec12e3a0
2024-03-29T09:08:50.044 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 -- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12e3a0 msgr2=0x7f3bec12e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.044 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12e3a0 0x7f3bec12e780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009840 tx=0x7f3bdc009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:50.044 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 -- 172.21.15.171:0/2708078676 shutdown_connections
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12b360 0x7f3bec12b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12e3a0 0x7f3bec12e780 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 --2- 172.21.15.171:0/2708078676 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12ecc0 0x7f3bec12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 -- 172.21.15.171:0/2708078676 >> 172.21.15.171:0/2708078676 conn(0x7f3bec0a0d70 msgr2=0x7f3bec0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 -- 172.21.15.171:0/2708078676 shutdown_connections
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.042+0000 7f3bf2600700  1 -- 172.21.15.171:0/2708078676 wait complete.
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1  Processor -- start
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1 --  start start
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12b360 0x7f3bec125690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12e3a0 0x7f3bec125bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12ecc0 0x7f3bec126110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec12a640 con 0x7f3bec12b360
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec127d40 con 0x7f3bec12ecc0
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.044+0000 7f3bf2600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1352e0 con 0x7f3bec12e3a0
2024-03-29T09:08:50.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12ecc0 0x7f3bec126110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3beaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12e3a0 0x7f3bec125bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12ecc0 0x7f3bec126110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60338/0 (socket says 172.21.15.171:60338)
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 -- 172.21.15.171:0/4289101126 learned_addr learned my addr 172.21.15.171:0/4289101126 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3beb400700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12b360 0x7f3bec125690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 -- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12e3a0 msgr2=0x7f3bec125bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12e3a0 0x7f3bec125bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 -- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12b360 msgr2=0x7f3bec125690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12b360 0x7f3bec125690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 -- 172.21.15.171:0/4289101126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8009550 con 0x7f3bec12ecc0
2024-03-29T09:08:50.046 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.045+0000 7f3bebe00700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12ecc0 0x7f3bec126110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eed0 tx=0x7f3be400b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.046+0000 7f3be3400700  1 -- 172.21.15.171:0/4289101126 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4010040 con 0x7f3bec12ecc0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.046+0000 7f3be3400700  1 -- 172.21.15.171:0/4289101126 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400bc80 con 0x7f3bec12ecc0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.046+0000 7f3be3400700  1 -- 172.21.15.171:0/4289101126 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4009e40 con 0x7f3bec12ecc0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.046+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc0094a0 con 0x7f3bec12ecc0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.046+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec127140 con 0x7f3bec12ecc0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.047+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec1171d0 con 0x7f3bec12ecc0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.047+0000 7f3be3400700  1 -- 172.21.15.171:0/4289101126 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f3be4014400 con 0x7f3bec12ecc0
2024-03-29T09:08:50.047 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.048+0000 7f3be3400700  1 -- 172.21.15.171:0/4289101126 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f3be405cbc0 con 0x7f3bec12ecc0
2024-03-29T09:08:50.050 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.051+0000 7f3be3400700  1 -- 172.21.15.171:0/4289101126 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f3be403a5a0 con 0x7f3bec12ecc0
2024-03-29T09:08:50.220 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.221+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bec128750 con 0x7f3bcc0475f0
2024-03-29T09:08:50.222 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.222+0000 7f3be3400700  1 -- 172.21.15.171:0/4289101126 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34608 (unknown 2965378022 0 354696520) 0x7f3bdc006c60 con 0x7f3bcc0475f0
2024-03-29T09:08:50.222 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.224+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 >> v1:172.21.15.171:6816/44806 conn(0x7f3bcc0475f0 legacy=0x7f3bcc049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.224+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12ecc0 msgr2=0x7f3bec126110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.224+0000 7f3bf2600700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12ecc0 0x7f3bec126110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3be400eed0 tx=0x7f3be400b390 comp rx=0 tx=0).stop
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.225+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 shutdown_connections
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.225+0000 7f3bf2600700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bec12ecc0 0x7f3bec126110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.225+0000 7f3bf2600700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bec12b360 0x7f3bec125690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.225+0000 7f3bf2600700  1 --2- 172.21.15.171:0/4289101126 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f3bec12e3a0 0x7f3bec125bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.225+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 >> 172.21.15.171:0/4289101126 conn(0x7f3bec0a0d70 msgr2=0x7f3bec1216c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:50.225 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.225+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 shutdown_connections
2024-03-29T09:08:50.225 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.225+0000 7f3bf2600700  1 -- 172.21.15.171:0/4289101126 wait complete.
2024-03-29T09:08:50.225 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:50.242 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-03-29T09:08:50.081122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115108,"kb_used_data":2152,"kb_used_omap":4,"kb_used_meta":112891,"kb_avail":377372252,"statfs":{"total":386547056640,"available":386429186048,"internally_reserved":0,"allocated":2203648,"data_stored":1540340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4636,"internal_metadata":115600868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.806589"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282241+0000","last_change":"2024-03-29T09:08:40.602229+0000","last_active":"2024-03-29T09:08:43.282241+0000","last_peered":"2024-03-29T09:08:43.282241+0000","last_clean":"2024-03-29T09:08:43.282241+0000","last_became_active":"2024-03-29T09:08:40.601985+0000","last_became_peered":"2024-03-29T09:08:40.601985+0000","last_unstale":"2024-03-29T09:08:43.282241+0000","last_undegraded":"2024-03-29T09:08:43.282241+0000","last_fullsized":"2024-03-29T09:08:43.282241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:02:05.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609604+0000","last_change":"2024-03-29T09:08:38.252447+0000","last_active":"2024-03-29T09:08:43.609604+0000","last_peered":"2024-03-29T09:08:43.609604+0000","last_clean":"2024-03-29T09:08:43.609604+0000","last_became_active":"2024-03-29T09:08:38.252122+0000","last_became_peered":"2024-03-29T09:08:38.252122+0000","last_unstale":"2024-03-29T09:08:43.609604+0000","last_undegraded":"2024-03-29T09:08:43.609604+0000","last_fullsized":"2024-03-29T09:08:43.609604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:20.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282186+0000","last_change":"2024-03-29T09:08:40.601753+0000","last_active":"2024-03-29T09:08:43.282186+0000","last_peered":"2024-03-29T09:08:43.282186+0000","last_clean":"2024-03-29T09:08:43.282186+0000","last_became_active":"2024-03-29T09:08:40.601418+0000","last_became_peered":"2024-03-29T09:08:40.601418+0000","last_unstale":"2024-03-29T09:08:43.282186+0000","last_undegraded":"2024-03-29T09:08:43.282186+0000","last_fullsized":"2024-03-29T09:08:43.282186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:11:37.158605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282070+0000","last_change":"2024-03-29T09:08:40.554498+0000","last_active":"2024-03-29T09:08:43.282070+0000","last_peered":"2024-03-29T09:08:43.282070+0000","last_clean":"2024-03-29T09:08:43.282070+0000","last_became_active":"2024-03-29T09:08:40.554228+0000","last_became_peered":"2024-03-29T09:08:40.554228+0000","last_unstale":"2024-03-29T09:08:43.282070+0000","last_undegraded":"2024-03-29T09:08:43.282070+0000","last_fullsized":"2024-03-29T09:08:43.282070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:33:35.566190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'98","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609571+0000","last_change":"2024-03-29T09:08:38.258057+0000","last_active":"2024-03-29T09:08:43.609571+0000","last_peered":"2024-03-29T09:08:43.609571+0000","last_clean":"2024-03-29T09:08:43.609571+0000","last_became_active":"2024-03-29T09:08:38.252224+0000","last_became_peered":"2024-03-29T09:08:38.252224+0000","last_unstale":"2024-03-29T09:08:43.609571+0000","last_undegraded":"2024-03-29T09:08:43.609571+0000","last_fullsized":"2024-03-29T09:08:43.609571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T19:46:09.422195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282148+0000","last_change":"2024-03-29T09:08:40.253037+0000","last_active":"2024-03-29T09:08:43.282148+0000","last_peered":"2024-03-29T09:08:43.282148+0000","last_clean":"2024-03-29T09:08:43.282148+0000","last_became_active":"2024-03-29T09:08:40.252699+0000","last_became_peered":"2024-03-29T09:08:40.252699+0000","last_unstale":"2024-03-29T09:08:43.282148+0000","last_undegraded":"2024-03-29T09:08:43.282148+0000","last_fullsized":"2024-03-29T09:08:43.282148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:59:53.558716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.279082+0000","last_change":"2024-03-29T09:08:40.253174+0000","last_active":"2024-03-29T09:08:43.279082+0000","last_peered":"2024-03-29T09:08:43.279082+0000","last_clean":"2024-03-29T09:08:43.279082+0000","last_became_active":"2024-03-29T09:08:40.252878+0000","last_became_peered":"2024-03-29T09:08:40.252878+0000","last_unstale":"2024-03-29T09:08:43.279082+0000","last_undegraded":"2024-03-29T09:08:43.279082+0000","last_fullsized":"2024-03-29T09:08:43.279082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:52:36.947448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282101+0000","last_change":"2024-03-29T09:08:40.550924+0000","last_active":"2024-03-29T09:08:43.282101+0000","last_peered":"2024-03-29T09:08:43.282101+0000","last_clean":"2024-03-29T09:08:43.282101+0000","last_became_active":"2024-03-29T09:08:40.550604+0000","last_became_peered":"2024-03-29T09:08:40.550604+0000","last_unstale":"2024-03-29T09:08:43.282101+0000","last_undegraded":"2024-03-29T09:08:43.282101+0000","last_fullsized":"2024-03-29T09:08:43.282101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:36:25.128918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609633+0000","last_change":"2024-03-29T09:08:38.251213+0000","last_active":"2024-03-29T09:08:43.609633+0000","last_peered":"2024-03-29T09:08:43.609633+0000","last_clean":"2024-03-29T09:08:43.609633+0000","last_became_active":"2024-03-29T09:08:38.250953+0000","last_became_peered":"2024-03-29T09:08:38.250953+0000","last_unstale":"2024-03-29T09:08:43.609633+0000","last_undegraded":"2024-03-29T09:08:43.609633+0000","last_fullsized":"2024-03-29T09:08:43.609633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:06:03.995157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":2,"up_from":25,"seq":107374182404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":0,"up_from":23,"seq":98784247813,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215108,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31294,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":32045945},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:50.242 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json
2024-03-29T09:08:50.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.433+0000 7f6a37a00700  1  Processor -- start
2024-03-29T09:08:50.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.433+0000 7f6a37a00700  1 --  start start
2024-03-29T09:08:50.435 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a37a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f6a30070150 0x7f6a30131780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.435 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a37a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30131cc0 0x7f6a301340b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.435 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a37a00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a30071e90 con 0x7f6a3006f660
2024-03-29T09:08:50.435 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a37a00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3009e1e0 con 0x7f6a30070150
2024-03-29T09:08:50.435 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a37a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300723e0 con 0x7f6a30131cc0
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a2fe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f6a30070150 0x7f6a30131780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a35a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30131cc0 0x7f6a301340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a2fe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f6a30070150 0x7f6a30131780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59278/0 (socket says 172.21.15.171:59278)
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a2fe00700  1 -- 172.21.15.171:0/3828986623 learned_addr learned my addr 172.21.15.171:0/3828986623 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a35000700  1 --1- 172.21.15.171:0/3828986623 >> v1:172.21.15.171:6789/0 conn(0x7f6a3006f660 0x7f6a3006fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:40972/0 (socket says 172.21.15.171:40972)
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a35a00700  1 -- 172.21.15.171:0/3828986623 >> v2:172.21.15.171:3300/0 conn(0x7f6a30070150 msgr2=0x7f6a30131780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a35a00700  1 --2- 172.21.15.171:0/3828986623 >> v2:172.21.15.171:3300/0 conn(0x7f6a30070150 0x7f6a30131780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a35a00700  1 -- 172.21.15.171:0/3828986623 >> v1:172.21.15.171:6789/0 conn(0x7f6a3006f660 legacy=0x7f6a3006fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a35a00700  1 -- 172.21.15.171:0/3828986623 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30071790 con 0x7f6a30131cc0
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.434+0000 7f6a2fe00700  1 --2- 172.21.15.171:0/3828986623 >> v2:172.21.15.171:3300/0 conn(0x7f6a30070150 0x7f6a30131780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.435+0000 7f6a35a00700  1 --2- 172.21.15.171:0/3828986623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30131cc0 0x7f6a301340b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfac8faab568da3b server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.435+0000 7f6a2f400700  1 -- 172.21.15.171:0/3828986623 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800e070 con 0x7f6a30131cc0
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.435+0000 7f6a2f400700  1 -- 172.21.15.171:0/3828986623 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800bb20 con 0x7f6a30131cc0
2024-03-29T09:08:50.436 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.435+0000 7f6a2f400700  1 -- 172.21.15.171:0/3828986623 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28012430 con 0x7f6a30131cc0
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.435+0000 7f6a37a00700  1 -- 172.21.15.171:0/3828986623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30131cc0 msgr2=0x7f6a301340b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.435+0000 7f6a37a00700  1 --2- 172.21.15.171:0/3828986623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30131cc0 0x7f6a301340b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2800b330 comp rx=0 tx=0).stop
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.436+0000 7f6a37a00700  1 -- 172.21.15.171:0/3828986623 shutdown_connections
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.436+0000 7f6a37a00700  1 --2- 172.21.15.171:0/3828986623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30131cc0 0x7f6a301340b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.436+0000 7f6a37a00700  1 --2- 172.21.15.171:0/3828986623 >> v2:172.21.15.171:3300/0 conn(0x7f6a30070150 0x7f6a30131780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.436+0000 7f6a37a00700  1 -- 172.21.15.171:0/3828986623 >> 172.21.15.171:0/3828986623 conn(0x7f6a3009ba80 msgr2=0x7f6a3009c850 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.436+0000 7f6a37a00700  1 -- 172.21.15.171:0/3828986623 shutdown_connections
2024-03-29T09:08:50.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.436+0000 7f6a37a00700  1 -- 172.21.15.171:0/3828986623 wait complete.
2024-03-29T09:08:50.444 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.437+0000 7f6a37a00700  1  Processor -- start
2024-03-29T09:08:50.444 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.437+0000 7f6a37a00700  1 --  start start
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a37a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a3006f660 0x7f6a3006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a37a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30070150 0x7f6a3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a37a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6a30131cc0 0x7f6a3006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a37a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30098ee0 con 0x7f6a3006f660
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a37a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30095790 con 0x7f6a30070150
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a37a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3006f150 con 0x7f6a30131cc0
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30070150 0x7f6a3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30070150 0x7f6a3006d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60356/0 (socket says 172.21.15.171:60356)
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 -- 172.21.15.171:0/3571587375 learned_addr learned my addr 172.21.15.171:0/3571587375 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a35000700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a3006f660 0x7f6a3006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a35a00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6a30131cc0 0x7f6a3006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 -- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6a30131cc0 msgr2=0x7f6a3006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6a30131cc0 0x7f6a3006ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 -- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a3006f660 msgr2=0x7f6a3006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a3006f660 0x7f6a3006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.438+0000 7f6a2fe00700  1 -- 172.21.15.171:0/3571587375 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c009550 con 0x7f6a30070150
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.439+0000 7f6a2fe00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30070150 0x7f6a3006d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00ec10 tx=0x7f6a1c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.439+0000 7f6a2cc00700  1 -- 172.21.15.171:0/3571587375 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00c850 con 0x7f6a30070150
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.439+0000 7f6a2cc00700  1 -- 172.21.15.171:0/3571587375 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00c9b0 con 0x7f6a30070150
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.439+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a28009a70 con 0x7f6a30070150
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.439+0000 7f6a2cc00700  1 -- 172.21.15.171:0/3571587375 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00cd40 con 0x7f6a30070150
2024-03-29T09:08:50.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.439+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a300959c0 con 0x7f6a30070150
2024-03-29T09:08:50.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.440+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a300623e0 con 0x7f6a30070150
2024-03-29T09:08:50.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.440+0000 7f6a2cc00700  1 -- 172.21.15.171:0/3571587375 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f6a1c013470 con 0x7f6a30070150
2024-03-29T09:08:50.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.441+0000 7f6a2cc00700  1 -- 172.21.15.171:0/3571587375 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f6a1c05ca50 con 0x7f6a30070150
2024-03-29T09:08:50.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.444+0000 7f6a2cc00700  1 -- 172.21.15.171:0/3571587375 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f6a1c03a600 con 0x7f6a30070150
2024-03-29T09:08:50.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.614+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a300748d0 con 0x7f6a30070150
2024-03-29T09:08:50.614 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.615+0000 7f6a2cc00700  1 -- 172.21.15.171:0/3571587375 <== mon.1 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0  v30) v1 ==== 74+0+8811 (secure 0 0 0) 0x7f6a1c017030 con 0x7f6a30070150
2024-03-29T09:08:50.614 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:50.614 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":30,"fsid":"5d11de56-0552-4a0a-9c9b-c107a7eaf7f9","created":"2024-03-29T08:54:18.344251+0000","modified":"2024-03-29T09:08:44.274815+0000","last_up_change":"2024-03-29T09:08:39.240872+0000","last_in_change":"2024-03-29T08:54:20.297263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T08:54:27.580138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-29T08:54:28.529901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cd8f3f88-2404-4aef-9bc1-bbb395180f89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":46596}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":46596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":46596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":46596}]},"public_addr":"172.21.15.171:6800/46596","cluster_addr":"172.21.15.171:6801/46596","heartbeat_back_addr":"172.21.15.171:6803/46596","heartbeat_front_addr":"172.21.15.171:6802/46596","state":["exists","up"]},{"osd":1,"uuid":"f2edc853-e433-4c25-a9a7-0c412db5d352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":24,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":46686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":46686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":46686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":46686}]},"public_addr":"172.21.15.171:6804/46686","cluster_addr":"172.21.15.171:6805/46686","heartbeat_back_addr":"172.21.15.171:6807/46686","heartbeat_front_addr":"172.21.15.171:6806/46686","state":["exists","up"]},{"osd":2,"uuid":"c1f904d8-4070-4c18-b06a-fd252f0b0378","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":26,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":46803}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":46803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":46803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":46803}]},"public_addr":"172.21.15.171:6808/46803","cluster_addr":"172.21.15.171:6809/46803","heartbeat_back_addr":"172.21.15.171:6811/46803","heartbeat_front_addr":"172.21.15.171:6810/46803","state":["exists","up"]},{"osd":3,"uuid":"809786b2-3806-4467-bd9d-01455bdcd876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":26,"up_thru":26,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":46965}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6813","nonce":46965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6815","nonce":46965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6814","nonce":46965}]},"public_addr":"172.21.15.171:6812/46965","cluster_addr":"172.21.15.171:6813/46965","heartbeat_back_addr":"172.21.15.171:6815/46965","heartbeat_front_addr":"172.21.15.171:6814/46965","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.830481+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.931512+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.924038+0000","dead_epoch":19},{"osd":3,"down_stamp":"2024-03-29T09:08:32.109013+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T08:54:25.887945+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:0/4094087308":"2024-03-30T09:08:24.052102+0000","172.21.15.171:0/4287724647":"2024-03-30T09:08:24.052102+0000","172.21.15.171:6816/38531":"2024-03-30T09:08:24.052102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
2024-03-29T09:08:50.616 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 >> v1:172.21.15.171:6816/44806 conn(0x7f6a100475f0 legacy=0x7f6a10049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.616 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30070150 msgr2=0x7f6a3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30070150 0x7f6a3006d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00ec10 tx=0x7f6a1c00ef20 comp rx=0 tx=0).stop
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 shutdown_connections
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f6a30131cc0 0x7f6a3006ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a3006f660 0x7f6a3006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 --2- 172.21.15.171:0/3571587375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a30070150 0x7f6a3006d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 >> 172.21.15.171:0/3571587375 conn(0x7f6a3009ba80 msgr2=0x7f6a30125a20 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 shutdown_connections
2024-03-29T09:08:50.617 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:50.617+0000 7f6a37a00700  1 -- 172.21.15.171:0/3571587375 wait complete.
2024-03-29T09:08:51.634 INFO:tasks.ceph:Scrubbing osd.0
2024-03-29T09:08:51.635 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0
2024-03-29T09:08:51.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.843+0000 7fbc42800700  1  Processor -- start
2024-03-29T09:08:51.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.844+0000 7fbc42800700  1 --  start start
2024-03-29T09:08:51.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.844+0000 7fbc42800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fbc3c12e9d0 0x7fbc3c12edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:51.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.844+0000 7fbc42800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c071540 0x7fbc3c12ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:51.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.844+0000 7fbc42800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0a1970 con 0x7fbc3c12b370
2024-03-29T09:08:51.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.844+0000 7fbc42800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0719f0 con 0x7fbc3c12e9d0
2024-03-29T09:08:51.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.844+0000 7fbc42800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c12e5a0 con 0x7fbc3c071540
2024-03-29T09:08:51.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3aa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c071540 0x7fbc3c12ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:51.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3b400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fbc3c12e9d0 0x7fbc3c12edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3b400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fbc3c12e9d0 0x7fbc3c12edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59290/0 (socket says 172.21.15.171:59290)
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3b400700  1 -- 172.21.15.171:0/3467108588 learned_addr learned my addr 172.21.15.171:0/3467108588 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3aa00700  1 -- 172.21.15.171:0/3467108588 >> v2:172.21.15.171:3300/0 conn(0x7fbc3c12e9d0 msgr2=0x7fbc3c12edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3aa00700  1 --2- 172.21.15.171:0/3467108588 >> v2:172.21.15.171:3300/0 conn(0x7fbc3c12e9d0 0x7fbc3c12edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3aa00700  1 -- 172.21.15.171:0/3467108588 >> v1:172.21.15.171:6789/0 conn(0x7fbc3c12b370 legacy=0x7fbc3c135660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3aa00700  1 -- 172.21.15.171:0/3467108588 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c071d50 con 0x7fbc3c071540
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3b400700  1 --2- 172.21.15.171:0/3467108588 >> v2:172.21.15.171:3300/0 conn(0x7fbc3c12e9d0 0x7fbc3c12edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3a000700  1 -- 172.21.15.171:0/3467108588 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603414508 0 0) 0x7fbc3c0a1970 con 0x7fbc3c12b370
2024-03-29T09:08:51.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.845+0000 7fbc3aa00700  1 --2- 172.21.15.171:0/3467108588 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c071540 0x7fbc3c12ae30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009840 tx=0x7fbc28009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c430e210b9d32400 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:51.847 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc3a000700  1 -- 172.21.15.171:0/3467108588 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28011830 con 0x7fbc3c071540
2024-03-29T09:08:51.847 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc3a000700  1 -- 172.21.15.171:0/3467108588 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28011990 con 0x7fbc3c071540
2024-03-29T09:08:51.847 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc3a000700  1 -- 172.21.15.171:0/3467108588 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28011d20 con 0x7fbc3c071540
2024-03-29T09:08:51.847 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 -- 172.21.15.171:0/3467108588 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c071540 msgr2=0x7fbc3c12ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:51.847 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 --2- 172.21.15.171:0/3467108588 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c071540 0x7fbc3c12ae30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009840 tx=0x7fbc28009b50 comp rx=0 tx=0).stop
2024-03-29T09:08:51.849 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 -- 172.21.15.171:0/3467108588 shutdown_connections
2024-03-29T09:08:51.849 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 --2- 172.21.15.171:0/3467108588 >> v2:172.21.15.171:3300/0 conn(0x7fbc3c12e9d0 0x7fbc3c12edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:51.849 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 --2- 172.21.15.171:0/3467108588 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c071540 0x7fbc3c12ae30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:51.849 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 -- 172.21.15.171:0/3467108588 >> 172.21.15.171:0/3467108588 conn(0x7fbc3c09d530 msgr2=0x7fbc3c09d940 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:51.849 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 -- 172.21.15.171:0/3467108588 shutdown_connections
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.846+0000 7fbc42800700  1 -- 172.21.15.171:0/3467108588 wait complete.
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1  Processor -- start
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1 --  start start
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc3c071540 0x7fbc3c1c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c12b370 0x7fbc3c1c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc3c12e9d0 0x7fbc3c08f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c1b6ff0 con 0x7fbc3c071540
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c1c3370 con 0x7fbc3c12e9d0
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.848+0000 7fbc42800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c091d30 con 0x7fbc3c12b370
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc3c071540 0x7fbc3c1c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3aa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c12b370 0x7fbc3c1c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:51.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc3c071540 0x7fbc3c1c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59292/0 (socket says 172.21.15.171:59292)
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 -- 172.21.15.171:0/1355537984 learned_addr learned my addr 172.21.15.171:0/1355537984 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3be00700  1 --2- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc3c12e9d0 0x7fbc3c08f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 -- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c12b370 msgr2=0x7fbc3c1c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 --2- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c12b370 0x7fbc3c1c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 -- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc3c12e9d0 msgr2=0x7fbc3c08f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 --2- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc3c12e9d0 0x7fbc3c08f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 -- 172.21.15.171:0/1355537984 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009550 con 0x7fbc3c071540
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3aa00700  1 --2- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbc3c12b370 0x7fbc3c1c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.849+0000 7fbc3b400700  1 --2- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc3c071540 0x7fbc3c1c3720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00ebe0 tx=0x7fbc2c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.850+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00c850 con 0x7fbc3c071540
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.850+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c00c9b0 con 0x7fbc3c071540
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.850+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00cd40 con 0x7fbc3c071540
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.850+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc280094a0 con 0x7fbc3c071540
2024-03-29T09:08:51.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.850+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c1c41a0 con 0x7fbc3c071540
2024-03-29T09:08:51.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.851+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc3c1b7870 con 0x7fbc3c071540
2024-03-29T09:08:51.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.851+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fbc2c013470 con 0x7fbc3c071540
2024-03-29T09:08:51.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.852+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fbc2c05c9a0 con 0x7fbc3c071540
2024-03-29T09:08:51.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.852+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 --> v1:172.21.15.171:6800/46596 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc1c051a40 con 0x7fbc1c04dd70
2024-03-29T09:08:51.853 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.852+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc2c0612c0 con 0x7fbc3c071540
2024-03-29T09:08:51.853 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.853+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== osd.0 v1:172.21.15.171:6800/46596 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7fbc1c051a40 con 0x7fbc1c04dd70
2024-03-29T09:08:51.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.868+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 --> v1:172.21.15.171:6800/46596 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc3c091320 con 0x7fbc1c04dd70
2024-03-29T09:08:51.871 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.868+0000 7fbc33400700  1 -- 172.21.15.171:0/1355537984 <== osd.0 v1:172.21.15.171:6800/46596 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7fbc3c091320 con 0x7fbc1c04dd70
2024-03-29T09:08:51.871 INFO:teuthology.orchestra.run.smithi171.stdout:{
2024-03-29T09:08:51.872 INFO:teuthology.orchestra.run.smithi171.stdout:    "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) "
2024-03-29T09:08:51.872 INFO:teuthology.orchestra.run.smithi171.stdout:}
2024-03-29T09:08:51.872 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.868+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 >> v1:172.21.15.171:6800/46596 conn(0x7fbc1c04dd70 legacy=0x7fbc1c0501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.868+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 >> v1:172.21.15.171:6816/44806 conn(0x7fbc1c0475f0 legacy=0x7fbc1c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.869+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc3c071540 msgr2=0x7fbc3c1c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.869+0000 7fbc42800700  1 --2- 172.21.15.171:0/1355537984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc3c071540 0x7fbc3c1c3720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00ebe0 tx=0x7fbc2c00eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.869+0000 7fbc3be00700  1 -- 172.21.15.171:0/1355537984 reap_dead start
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.869+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 shutdown_connections
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.869+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 >> 172.21.15.171:0/1355537984 conn(0x7fbc3c09d530 msgr2=0x7fbc3c06c340 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.869+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 shutdown_connections
2024-03-29T09:08:51.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:51.869+0000 7fbc42800700  1 -- 172.21.15.171:0/1355537984 wait complete.
2024-03-29T09:08:51.885 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0
2024-03-29T09:08:52.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.079+0000 7fe4a2400700  1  Processor -- start
2024-03-29T09:08:52.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.079+0000 7fe4a2400700  1 --  start start
2024-03-29T09:08:52.080 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe4a2400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12e3a0 0x7fe49c12e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe4a2400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe49c12b530 0x7fe49c136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe4a2400700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c070d80 con 0x7fe49c12ecc0
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe4a2400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0715e0 con 0x7fe49c12b530
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe4a2400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0722b0 con 0x7fe49c12e3a0
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe49be00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe49c12b530 0x7fe49c136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe49be00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fe49c12b530 0x7fe49c136740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59296/0 (socket says 172.21.15.171:59296)
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe49be00700  1 -- 172.21.15.171:0/2936832183 learned_addr learned my addr 172.21.15.171:0/2936832183 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.080+0000 7fe49b400700  1 --2- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12e3a0 0x7fe49c12e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49be00700  1 -- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12e3a0 msgr2=0x7fe49c12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49be00700  1 --2- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12e3a0 0x7fe49c12e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49be00700  1 -- 172.21.15.171:0/2936832183 >> v1:172.21.15.171:6789/0 conn(0x7fe49c12ecc0 legacy=0x7fe49c12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49be00700  1 -- 172.21.15.171:0/2936832183 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c071b40 con 0x7fe49c12b530
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49b400700  1 --2- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12e3a0 0x7fe49c12e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:52.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49a000700  1 -- 172.21.15.171:0/2936832183 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071934845 0 0) 0x7fe49c070d80 con 0x7fe49c12ecc0
2024-03-29T09:08:52.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49be00700  1 --2- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12b530 0x7fe49c136740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe494009e50 tx=0x7fe49400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5095ccbbf344fec server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:52.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49a000700  1 -- 172.21.15.171:0/2936832183 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400e070 con 0x7fe49c12b530
2024-03-29T09:08:52.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49a000700  1 -- 172.21.15.171:0/2936832183 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400b910 con 0x7fe49c12b530
2024-03-29T09:08:52.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.081+0000 7fe49a000700  1 -- 172.21.15.171:0/2936832183 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400bcc0 con 0x7fe49c12b530
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 -- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12b530 msgr2=0x7fe49c136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 --2- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12b530 0x7fe49c136740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe494009e50 tx=0x7fe49400b330 comp rx=0 tx=0).stop
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 -- 172.21.15.171:0/2936832183 shutdown_connections
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 --2- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12b530 0x7fe49c136740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 --2- 172.21.15.171:0/2936832183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12e3a0 0x7fe49c12e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 -- 172.21.15.171:0/2936832183 >> 172.21.15.171:0/2936832183 conn(0x7fe49c0a0d70 msgr2=0x7fe49c0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 -- 172.21.15.171:0/2936832183 shutdown_connections
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.082+0000 7fe4a2400700  1 -- 172.21.15.171:0/2936832183 wait complete.
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.083+0000 7fe4a2400700  1  Processor -- start
2024-03-29T09:08:52.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.083+0000 7fe4a2400700  1 --  start start
2024-03-29T09:08:52.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe4a2400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12b530 0x7fe49c1c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe4a2400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12e3a0 0x7fe49c1c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe4a2400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe49c12ecc0 0x7fe49c1c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.085 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe4a2400700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1247c0 con 0x7fe49c12e3a0
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe4a2400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c125050 con 0x7fe49c12b530
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe4a2400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1300d0 con 0x7fe49c12ecc0
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe49b400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12b530 0x7fe49c1c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe49b400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12b530 0x7fe49c1c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60382/0 (socket says 172.21.15.171:60382)
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe49b400700  1 -- 172.21.15.171:0/3964333194 learned_addr learned my addr 172.21.15.171:0/3964333194 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe49be00700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe49c12ecc0 0x7fe49c1c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.084+0000 7fe49aa00700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12e3a0 0x7fe49c1c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe49b400700  1 -- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe49c12ecc0 msgr2=0x7fe49c1c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe49b400700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe49c12ecc0 0x7fe49c1c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe49b400700  1 -- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12e3a0 msgr2=0x7fe49c1c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe49b400700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12e3a0 0x7fe49c1c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe49b400700  1 -- 172.21.15.171:0/3964333194 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0094a0 con 0x7fe49c12b530
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe49be00700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe49c12ecc0 0x7fe49c1c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:52.086 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe49b400700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12b530 0x7fe49c1c2f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00ebe0 tx=0x7fe48c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:52.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe493400700  1 -- 172.21.15.171:0/3964333194 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00c850 con 0x7fe49c12b530
2024-03-29T09:08:52.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe493400700  1 -- 172.21.15.171:0/3964333194 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c00c9b0 con 0x7fe49c12b530
2024-03-29T09:08:52.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe494009b30 con 0x7fe49c12b530
2024-03-29T09:08:52.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe493400700  1 -- 172.21.15.171:0/3964333194 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00cd40 con 0x7fe49c12b530
2024-03-29T09:08:52.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.085+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c123580 con 0x7fe49c12b530
2024-03-29T09:08:52.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.086+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c1171d0 con 0x7fe49c12b530
2024-03-29T09:08:52.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.087+0000 7fe493400700  1 -- 172.21.15.171:0/3964333194 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fe48c013470 con 0x7fe49c12b530
2024-03-29T09:08:52.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.087+0000 7fe493400700  1 -- 172.21.15.171:0/3964333194 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fe48c05ca10 con 0x7fe49c12b530
2024-03-29T09:08:52.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.091+0000 7fe493400700  1 -- 172.21.15.171:0/3964333194 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fe48c03a5c0 con 0x7fe49c12b530
2024-03-29T09:08:52.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.262+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe49c136c80 con 0x7fe47c0475f0
2024-03-29T09:08:52.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.263+0000 7fe493400700  1 -- 172.21.15.171:0/3964333194 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7fe4880012f0 con 0x7fe47c0475f0
2024-03-29T09:08:52.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.264+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 >> v1:172.21.15.171:6816/44806 conn(0x7fe47c0475f0 legacy=0x7fe47c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12b530 msgr2=0x7fe49c1c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12b530 0x7fe49c1c2f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00ebe0 tx=0x7fe48c00eef0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 shutdown_connections
2024-03-29T09:08:52.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fe49c12ecc0 0x7fe49c1c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe49c12b530 0x7fe49c1c2f00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 --2- 172.21.15.171:0/3964333194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe49c12e3a0 0x7fe49c1c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 >> 172.21.15.171:0/3964333194 conn(0x7fe49c0a0d70 msgr2=0x7fe49c06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:52.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 shutdown_connections
2024-03-29T09:08:52.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.265+0000 7fe4a2400700  1 -- 172.21.15.171:0/3964333194 wait complete.
2024-03-29T09:08:52.266 INFO:teuthology.orchestra.run.smithi171.stderr:instructed osd(s) 0 to deep-scrub
2024-03-29T09:08:52.283 INFO:tasks.ceph:Scrubbing osd.1
2024-03-29T09:08:52.283 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0
2024-03-29T09:08:52.481 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.479+0000 7fcfa2c00700  1  Processor -- start
2024-03-29T09:08:52.482 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.479+0000 7fcfa2c00700  1 --  start start
2024-03-29T09:08:52.488 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcfa2c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1339e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.488 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcfa2c00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fcf9c133f20 0x7fcf9c136310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.488 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcfa2c00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c06e400 con 0x7fcf9c06d5c0
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcfa2c00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c071f40 con 0x7fcf9c133f20
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcfa2c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c06f140 con 0x7fcf9c1315f0
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9b400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9b400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35442/0 (socket says 172.21.15.171:35442)
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9b400700  1 -- 172.21.15.171:0/4018851563 learned_addr learned my addr 172.21.15.171:0/4018851563 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcfa0c00700  1 --2- 172.21.15.171:0/4018851563 >> v2:172.21.15.171:3300/0 conn(0x7fcf9c133f20 0x7fcf9c136310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9b400700  1 -- 172.21.15.171:0/4018851563 >> v2:172.21.15.171:3300/0 conn(0x7fcf9c133f20 msgr2=0x7fcf9c136310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:52.489 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9b400700  1 --2- 172.21.15.171:0/4018851563 >> v2:172.21.15.171:3300/0 conn(0x7fcf9c133f20 0x7fcf9c136310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9b400700  1 -- 172.21.15.171:0/4018851563 >> v1:172.21.15.171:6789/0 conn(0x7fcf9c06d5c0 legacy=0x7fcf9c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9b400700  1 -- 172.21.15.171:0/4018851563 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c06f9a0 con 0x7fcf9c1315f0
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcfa0c00700  1 --2- 172.21.15.171:0/4018851563 >> v2:172.21.15.171:3300/0 conn(0x7fcf9c133f20 0x7fcf9c136310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed!
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.480+0000 7fcf9aa00700  1 -- 172.21.15.171:0/4018851563 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403857399 0 0) 0x7fcf9c06e400 con 0x7fcf9c06d5c0
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.481+0000 7fcf9b400700  1 --2- 172.21.15.171:0/4018851563 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1339e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf880098f0 tx=0x7fcf88009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67334f469667affb server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.481+0000 7fcf9aa00700  1 -- 172.21.15.171:0/4018851563 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8800b8a0 con 0x7fcf9c1315f0
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.481+0000 7fcf9aa00700  1 -- 172.21.15.171:0/4018851563 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8800ba00 con 0x7fcf9c1315f0
2024-03-29T09:08:52.490 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.481+0000 7fcf9aa00700  1 -- 172.21.15.171:0/4018851563 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8800bd90 con 0x7fcf9c1315f0
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.481+0000 7fcfa2c00700  1 -- 172.21.15.171:0/4018851563 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 msgr2=0x7fcf9c1339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.481+0000 7fcfa2c00700  1 --2- 172.21.15.171:0/4018851563 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1339e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf880098f0 tx=0x7fcf88009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.482+0000 7fcfa2c00700  1 -- 172.21.15.171:0/4018851563 shutdown_connections
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.482+0000 7fcfa2c00700  1 --2- 172.21.15.171:0/4018851563 >> v2:172.21.15.171:3300/0 conn(0x7fcf9c133f20 0x7fcf9c136310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.482+0000 7fcfa2c00700  1 --2- 172.21.15.171:0/4018851563 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1339e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.482+0000 7fcfa2c00700  1 -- 172.21.15.171:0/4018851563 >> 172.21.15.171:0/4018851563 conn(0x7fcf9c09d630 msgr2=0x7fcf9c09da40 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.482+0000 7fcfa2c00700  1 -- 172.21.15.171:0/4018851563 shutdown_connections
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.482+0000 7fcfa2c00700  1 -- 172.21.15.171:0/4018851563 wait complete.
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.483+0000 7fcfa2c00700  1  Processor -- start
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.483+0000 7fcfa2c00700  1 --  start start
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.483+0000 7fcfa2c00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c06d5c0 0x7fcf9c1c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcfa2c00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcfa2c00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c133f20 0x7fcf9c1c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcfa2c00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c099cb0 con 0x7fcf9c06d5c0
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcfa2c00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c099330 con 0x7fcf9c133f20
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcfa2c00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c128140 con 0x7fcf9c1315f0
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9be00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c06d5c0 0x7fcf9c1c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35456/0 (socket says 172.21.15.171:35456)
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 -- 172.21.15.171:0/1772512875 learned_addr learned my addr 172.21.15.171:0/1772512875 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcfa0c00700  1 --2- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c133f20 0x7fcf9c1c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 -- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c133f20 msgr2=0x7fcf9c1c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 --2- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c133f20 0x7fcf9c1c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 -- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c06d5c0 msgr2=0x7fcf9c1c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.492 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 --2- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c06d5c0 0x7fcf9c1c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 -- 172.21.15.171:0/1772512875 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88009550 con 0x7fcf9c1315f0
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9be00700  1 --2- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c06d5c0 0x7fcf9c1c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.484+0000 7fcf9b400700  1 --2- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1c3590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009c40 tx=0x7fcf88004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.485+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88004450 con 0x7fcf9c1315f0
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.485+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf880045b0 con 0x7fcf9c1315f0
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.485+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880038c0 con 0x7fcf9c1315f0
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.485+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c06ef40 con 0x7fcf9c1315f0
2024-03-29T09:08:52.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.485+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c098b00 con 0x7fcf9c1315f0
2024-03-29T09:08:52.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.486+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf9c136850 con 0x7fcf9c1315f0
2024-03-29T09:08:52.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.486+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fcf88021070 con 0x7fcf9c1315f0
2024-03-29T09:08:52.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.487+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fcf8805dba0 con 0x7fcf9c1315f0
2024-03-29T09:08:52.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.487+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 --> v1:172.21.15.171:6804/46686 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf7c051a40 con 0x7fcf7c04dd70
2024-03-29T09:08:52.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.487+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf880622c0 con 0x7fcf9c1315f0
2024-03-29T09:08:52.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.488+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== osd.1 v1:172.21.15.171:6804/46686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7fcf940152b0 con 0x7fcf7c04dd70
2024-03-29T09:08:52.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.503+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 --> v1:172.21.15.171:6804/46686 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf9c066fe0 con 0x7fcf7c04dd70
2024-03-29T09:08:52.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.503+0000 7fcf93e00700  1 -- 172.21.15.171:0/1772512875 <== osd.1 v1:172.21.15.171:6804/46686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7fcf9c066fe0 con 0x7fcf7c04dd70
2024-03-29T09:08:52.503 INFO:teuthology.orchestra.run.smithi171.stdout:{
2024-03-29T09:08:52.503 INFO:teuthology.orchestra.run.smithi171.stdout:    "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) "
2024-03-29T09:08:52.503 INFO:teuthology.orchestra.run.smithi171.stdout:}
2024-03-29T09:08:52.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.503+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 >> v1:172.21.15.171:6804/46686 conn(0x7fcf7c04dd70 legacy=0x7fcf7c0501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 >> v1:172.21.15.171:6816/44806 conn(0x7fcf7c0475f0 legacy=0x7fcf7c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 msgr2=0x7fcf9c1c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa2c00700  1 --2- 172.21.15.171:0/1772512875 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fcf9c1315f0 0x7fcf9c1c3590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009c40 tx=0x7fcf88004750 comp rx=0 tx=0).stop
2024-03-29T09:08:52.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa0c00700  1 -- 172.21.15.171:0/1772512875 reap_dead start
2024-03-29T09:08:52.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 shutdown_connections
2024-03-29T09:08:52.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 >> 172.21.15.171:0/1772512875 conn(0x7fcf9c09d630 msgr2=0x7fcf9c09c430 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:52.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 shutdown_connections
2024-03-29T09:08:52.505 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.504+0000 7fcfa2c00700  1 -- 172.21.15.171:0/1772512875 wait complete.
2024-03-29T09:08:52.521 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1
2024-03-29T09:08:52.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.716+0000 7facd1e00700  1  Processor -- start
2024-03-29T09:08:52.716 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.716+0000 7facd1e00700  1 --  start start
2024-03-29T09:08:52.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facd1e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12e3a0 0x7faccc12e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facd1e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12b530 0x7faccc136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facd1e00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc070d80 con 0x7faccc12ecc0
2024-03-29T09:08:52.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facd1e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0715e0 con 0x7faccc12b530
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facd1e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0722b0 con 0x7faccc12e3a0
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7faccb400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12b530 0x7faccc136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facca000700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7faccc12ecc0 0x7faccc12ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:41024/0 (socket says 172.21.15.171:41024)
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7faccaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12e3a0 0x7faccc12e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facca000700  1 -- 172.21.15.171:0/3227936337 learned_addr learned my addr 172.21.15.171:0/3227936337 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7faccb400700  1 -- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12e3a0 msgr2=0x7faccc12e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7faccb400700  1 --2- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12e3a0 0x7faccc12e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7faccb400700  1 -- 172.21.15.171:0/3227936337 >> v1:172.21.15.171:6789/0 conn(0x7faccc12ecc0 legacy=0x7faccc12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7facc9600700  1 -- 172.21.15.171:0/3227936337 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088027798 0 0) 0x7faccc070d80 con 0x7faccc12ecc0
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7faccb400700  1 -- 172.21.15.171:0/3227936337 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc071b40 con 0x7faccc12b530
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.717+0000 7faccaa00700  1 --2- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12e3a0 0x7faccc12e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:52.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.718+0000 7faccb400700  1 --2- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12b530 0x7faccc136740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facc4009dc0 tx=0x7facc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40f53918431b122a server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:52.719 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.718+0000 7facc9600700  1 -- 172.21.15.171:0/3227936337 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400e070 con 0x7faccc12b530
2024-03-29T09:08:52.719 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.718+0000 7facc9600700  1 -- 172.21.15.171:0/3227936337 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc400bb20 con 0x7faccc12b530
2024-03-29T09:08:52.719 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.718+0000 7facc9600700  1 -- 172.21.15.171:0/3227936337 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4012430 con 0x7faccc12b530
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.718+0000 7facd1e00700  1 -- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12b530 msgr2=0x7faccc136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.718+0000 7facd1e00700  1 --2- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12b530 0x7faccc136740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facc4009dc0 tx=0x7facc400b330 comp rx=0 tx=0).stop
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.719+0000 7facd1e00700  1 -- 172.21.15.171:0/3227936337 shutdown_connections
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.719+0000 7facd1e00700  1 --2- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12e3a0 0x7faccc12e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.719+0000 7facd1e00700  1 --2- 172.21.15.171:0/3227936337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12b530 0x7faccc136740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.719+0000 7facd1e00700  1 -- 172.21.15.171:0/3227936337 >> 172.21.15.171:0/3227936337 conn(0x7faccc0a0d70 msgr2=0x7faccc0a1180 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.719+0000 7facd1e00700  1 -- 172.21.15.171:0/3227936337 shutdown_connections
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.719+0000 7facd1e00700  1 -- 172.21.15.171:0/3227936337 wait complete.
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.720+0000 7facd1e00700  1  Processor -- start
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.720+0000 7facd1e00700  1 --  start start
2024-03-29T09:08:52.721 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facd1e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faccc12b530 0x7faccc123710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facd1e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12e3a0 0x7faccc123c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facd1e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12ecc0 0x7faccc124190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facd1e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc130aa0 con 0x7faccc12b530
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facd1e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc130d40 con 0x7faccc12e3a0
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facd1e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faccc130400 con 0x7faccc12ecc0
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facca000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12e3a0 0x7faccc123c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccaa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faccc12b530 0x7faccc123710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facca000700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12e3a0 0x7faccc123c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60424/0 (socket says 172.21.15.171:60424)
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facca000700  1 -- 172.21.15.171:0/3028614284 learned_addr learned my addr 172.21.15.171:0/3028614284 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccb400700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12ecc0 0x7faccc124190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccaa00700  1 -- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12ecc0 msgr2=0x7faccc124190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccaa00700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12ecc0 0x7faccc124190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccaa00700  1 -- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12e3a0 msgr2=0x7faccc123c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.723 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccaa00700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12e3a0 0x7faccc123c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.723 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccaa00700  1 -- 172.21.15.171:0/3028614284 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0094a0 con 0x7faccc12b530
2024-03-29T09:08:52.723 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7facca000700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12e3a0 0x7faccc123c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:52.723 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.721+0000 7faccb400700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12ecc0 0x7faccc124190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.722+0000 7faccaa00700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faccc12b530 0x7faccc123710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facbc00e9e0 tx=0x7facbc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.722+0000 7facc3400700  1 -- 172.21.15.171:0/3028614284 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00ee80 con 0x7faccc12b530
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.722+0000 7facc3400700  1 -- 172.21.15.171:0/3028614284 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc00c850 con 0x7faccc12b530
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.722+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc4009a70 con 0x7faccc12b530
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.722+0000 7facc3400700  1 -- 172.21.15.171:0/3028614284 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00cc00 con 0x7faccc12b530
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.722+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc1c2fe0 con 0x7faccc12b530
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.723+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc1250a0 con 0x7faccc12b530
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.723+0000 7facc3400700  1 -- 172.21.15.171:0/3028614284 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7facbc00cd60 con 0x7faccc12b530
2024-03-29T09:08:52.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.724+0000 7facc3400700  1 -- 172.21.15.171:0/3028614284 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7facbc05c820 con 0x7faccc12b530
2024-03-29T09:08:52.727 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.728+0000 7facc3400700  1 -- 172.21.15.171:0/3028614284 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7facbc03a4d0 con 0x7faccc12b530
2024-03-29T09:08:52.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.894+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7faccc136c80 con 0x7facac0475f0
2024-03-29T09:08:52.894 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.895+0000 7facc3400700  1 -- 172.21.15.171:0/3028614284 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7facb80017f0 con 0x7facac0475f0
2024-03-29T09:08:52.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 >> v1:172.21.15.171:6816/44806 conn(0x7facac0475f0 legacy=0x7facac049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faccc12b530 msgr2=0x7faccc123710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faccc12b530 0x7faccc123710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facbc00e9e0 tx=0x7facbc00ecf0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 shutdown_connections
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7faccc12ecc0 0x7faccc124190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faccc12b530 0x7faccc123710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 --2- 172.21.15.171:0/3028614284 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faccc12e3a0 0x7faccc123c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 >> 172.21.15.171:0/3028614284 conn(0x7faccc0a0d70 msgr2=0x7faccc06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 shutdown_connections
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:52.897+0000 7facd1e00700  1 -- 172.21.15.171:0/3028614284 wait complete.
2024-03-29T09:08:52.897 INFO:teuthology.orchestra.run.smithi171.stderr:instructed osd(s) 1 to deep-scrub
2024-03-29T09:08:52.914 INFO:tasks.ceph:Scrubbing osd.2
2024-03-29T09:08:52.914 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0
2024-03-29T09:08:53.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.111+0000 7f40bfe00700  1  Processor -- start
2024-03-29T09:08:53.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bfe00700  1 --  start start
2024-03-29T09:08:53.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bfe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b812edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bfe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f40b812b540 0x7f40b8136670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bfe00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b80a1970 con 0x7f40b812e9d0
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bfe00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b80719f0 con 0x7f40b812b540
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bfe00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b812e5a0 con 0x7f40b8071540
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bca00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b812edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bd400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f40b812e9d0 0x7f40b812ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:41028/0 (socket says 172.21.15.171:41028)
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bd400700  1 -- 172.21.15.171:0/2231841716 learned_addr learned my addr 172.21.15.171:0/2231841716 (peer_addr_for_me v1:172.21.15.171:0/0)
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.112+0000 7f40bde00700  1 --2- 172.21.15.171:0/2231841716 >> v2:172.21.15.171:3300/0 conn(0x7f40b812b540 0x7f40b8136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40b7e00700  1 -- 172.21.15.171:0/2231841716 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007301777 0 0) 0x7f40b80a1970 con 0x7f40b812e9d0
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40b7e00700  1 -- 172.21.15.171:0/2231841716 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a00035b0 con 0x7f40b812e9d0
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40bde00700  1 -- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 msgr2=0x7f40b812edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:53.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40bde00700  1 --2- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b812edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40bde00700  1 -- 172.21.15.171:0/2231841716 >> v1:172.21.15.171:6789/0 conn(0x7f40b812e9d0 legacy=0x7f40b812ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40bde00700  1 -- 172.21.15.171:0/2231841716 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8071d50 con 0x7f40b812b540
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40bca00700  1 --2- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b812edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40bde00700  1 --2- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812b540 0x7f40b8136670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009d90 tx=0x7f40b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f4e6c300e333c3 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40b7e00700  1 -- 172.21.15.171:0/2231841716 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b000e070 con 0x7f40b812b540
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40b7e00700  1 -- 172.21.15.171:0/2231841716 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b000bb20 con 0x7f40b812b540
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.113+0000 7f40b7e00700  1 -- 172.21.15.171:0/2231841716 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0012430 con 0x7f40b812b540
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 -- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812b540 msgr2=0x7f40b8136670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 --2- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812b540 0x7f40b8136670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009d90 tx=0x7f40b000b330 comp rx=0 tx=0).stop
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 -- 172.21.15.171:0/2231841716 shutdown_connections
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 --2- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812b540 0x7f40b8136670 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 --2- 172.21.15.171:0/2231841716 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b812edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 -- 172.21.15.171:0/2231841716 >> 172.21.15.171:0/2231841716 conn(0x7f40b809d530 msgr2=0x7f40b809d940 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:53.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 -- 172.21.15.171:0/2231841716 shutdown_connections
2024-03-29T09:08:53.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.114+0000 7f40bfe00700  1 -- 172.21.15.171:0/2231841716 wait complete.
2024-03-29T09:08:53.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.115+0000 7f40bfe00700  1  Processor -- start
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bfe00700  1 --  start start
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bfe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b81bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bfe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b812b540 0x7f40b81bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bfe00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812e9d0 0x7f40b81c0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bfe00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b81305d0 con 0x7f40b812e9d0
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bfe00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8130da0 con 0x7f40b812b540
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bfe00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8130b70 con 0x7f40b8071540
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bd400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b81bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bd400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b81bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35478/0 (socket says 172.21.15.171:35478)
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bd400700  1 -- 172.21.15.171:0/3424887033 learned_addr learned my addr 172.21.15.171:0/3424887033 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bca00700  1 --2- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b812b540 0x7f40b81bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.116+0000 7f40bde00700  1 --2- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812e9d0 0x7f40b81c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bd400700  1 -- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b812b540 msgr2=0x7f40b81bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bd400700  1 --2- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b812b540 0x7f40b81bff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bd400700  1 -- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812e9d0 msgr2=0x7f40b81c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bd400700  1 --2- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812e9d0 0x7f40b81c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bd400700  1 -- 172.21.15.171:0/3424887033 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40094a0 con 0x7f40b8071540
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bde00700  1 --2- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b812e9d0 0x7f40b81c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bd400700  1 --2- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b81bfa00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c730 tx=0x7f40ac00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac005d70 con 0x7f40b8071540
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac0070d0 con 0x7f40b8071540
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac007440 con 0x7f40b8071540
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b0009a70 con 0x7f40b8071540
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.117+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b81369e0 con 0x7f40b8071540
2024-03-29T09:08:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.118+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40b8066f70 con 0x7f40b8071540
2024-03-29T09:08:53.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.119+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f40ac0075a0 con 0x7f40b8071540
2024-03-29T09:08:53.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.119+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f40ac05bc80 con 0x7f40b8071540
2024-03-29T09:08:53.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.120+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 --> v1:172.21.15.171:6808/46803 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4098051a40 con 0x7f409804dd70
2024-03-29T09:08:53.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.120+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ac05e340 con 0x7f40b8071540
2024-03-29T09:08:53.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.121+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== osd.2 v1:172.21.15.171:6808/46803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7f4098051a40 con 0x7f409804dd70
2024-03-29T09:08:53.135 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 --> v1:172.21.15.171:6808/46803 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40b812bbd0 con 0x7f409804dd70
2024-03-29T09:08:53.135 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40b5600700  1 -- 172.21.15.171:0/3424887033 <== osd.2 v1:172.21.15.171:6808/46803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f40b812bbd0 con 0x7f409804dd70
2024-03-29T09:08:53.135 INFO:teuthology.orchestra.run.smithi171.stdout:{
2024-03-29T09:08:53.136 INFO:teuthology.orchestra.run.smithi171.stdout:    "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) "
2024-03-29T09:08:53.136 INFO:teuthology.orchestra.run.smithi171.stdout:}
2024-03-29T09:08:53.136 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 >> v1:172.21.15.171:6808/46803 conn(0x7f409804dd70 legacy=0x7f40980501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.136 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 >> v1:172.21.15.171:6816/44806 conn(0x7f40980475f0 legacy=0x7f4098049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 msgr2=0x7f40b81bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bfe00700  1 --2- 172.21.15.171:0/3424887033 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f40b8071540 0x7f40b81bfa00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c730 tx=0x7f40ac00ca40 comp rx=0 tx=0).stop
2024-03-29T09:08:53.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bde00700  1 -- 172.21.15.171:0/3424887033 reap_dead start
2024-03-29T09:08:53.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 shutdown_connections
2024-03-29T09:08:53.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.136+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 >> 172.21.15.171:0/3424887033 conn(0x7f40b809d530 msgr2=0x7f40b8127b00 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:53.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.137+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 shutdown_connections
2024-03-29T09:08:53.137 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.137+0000 7f40bfe00700  1 -- 172.21.15.171:0/3424887033 wait complete.
2024-03-29T09:08:53.153 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.345+0000 7fd096800700  1  Processor -- start
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.345+0000 7fd096800700  1 --  start start
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd096800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09012b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd096800700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fd09006ef70 0x7fd090133410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd096800700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd090072680 con 0x7fd09006e420
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd096800700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd090098a80 con 0x7fd09006ef70
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd096800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd090070b20 con 0x7fd09012b500
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd08f400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09012b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd08fe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fd09006ef70 0x7fd090133410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd08f400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09012b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60440/0 (socket says 172.21.15.171:60440)
2024-03-29T09:08:53.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd08f400700  1 -- 172.21.15.171:0/3001200674 learned_addr learned my addr 172.21.15.171:0/3001200674 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:53.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd08fe00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fd09006ef70 0x7fd090133410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59360/0 (socket says 172.21.15.171:59360)
2024-03-29T09:08:53.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.346+0000 7fd08ea00700  1 --1- 172.21.15.171:0/3001200674 >> v1:172.21.15.171:6789/0 conn(0x7fd09006e420 0x7fd09006e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:41034/0 (socket says 172.21.15.171:41034)
2024-03-29T09:08:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08fe00700  1 -- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 msgr2=0x7fd09012b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08fe00700  1 --2- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09012b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08fe00700  1 -- 172.21.15.171:0/3001200674 >> v1:172.21.15.171:6789/0 conn(0x7fd09006e420 legacy=0x7fd09006e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08fe00700  1 -- 172.21.15.171:0/3001200674 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09012b0d0 con 0x7fd09006ef70
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08f400700  1 --2- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09012b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08fe00700  1 --2- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 0x7fd090133410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd088009d90 tx=0x7fd08800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90378f089e43116e server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08e000700  1 -- 172.21.15.171:0/3001200674 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08800e070 con 0x7fd09006ef70
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08e000700  1 -- 172.21.15.171:0/3001200674 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08800bb20 con 0x7fd09006ef70
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.347+0000 7fd08e000700  1 -- 172.21.15.171:0/3001200674 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088012430 con 0x7fd09006ef70
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 -- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 msgr2=0x7fd090133410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 --2- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 0x7fd090133410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd088009d90 tx=0x7fd08800b330 comp rx=0 tx=0).stop
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 -- 172.21.15.171:0/3001200674 shutdown_connections
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 --2- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 0x7fd090133410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 --2- 172.21.15.171:0/3001200674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09012b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 -- 172.21.15.171:0/3001200674 >> 172.21.15.171:0/3001200674 conn(0x7fd0900978d0 msgr2=0x7fd090097ce0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 -- 172.21.15.171:0/3001200674 shutdown_connections
2024-03-29T09:08:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.348+0000 7fd096800700  1 -- 172.21.15.171:0/3001200674 wait complete.
2024-03-29T09:08:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.349+0000 7fd096800700  1  Processor -- start
2024-03-29T09:08:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.349+0000 7fd096800700  1 --  start start
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd096800700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd09006e420 0x7fd0901bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd096800700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 0x7fd0901bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd096800700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09008afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd096800700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09008e0f0 con 0x7fd09006ef70
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd096800700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09008d0d0 con 0x7fd09012b500
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd096800700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd09008dde0 con 0x7fd09006e420
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd08f400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd09006e420 0x7fd0901bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd08ea00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 0x7fd0901bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd08fe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09008afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd08f400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd09006e420 0x7fd0901bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35484/0 (socket says 172.21.15.171:35484)
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.350+0000 7fd08f400700  1 -- 172.21.15.171:0/595174284 learned_addr learned my addr 172.21.15.171:0/595174284 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd08f400700  1 -- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 msgr2=0x7fd09008afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd08f400700  1 --2- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09008afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd08f400700  1 -- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 msgr2=0x7fd0901bf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd08f400700  1 --2- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 0x7fd0901bf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd08f400700  1 -- 172.21.15.171:0/595174284 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08000b7f0 con 0x7fd09006e420
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd08f400700  1 --2- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd09006e420 0x7fd0901bf180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd080010fa0 tx=0x7fd08000e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd087400700  1 -- 172.21.15.171:0/595174284 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000eea0 con 0x7fd09006e420
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd087400700  1 -- 172.21.15.171:0/595174284 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080011650 con 0x7fd09006e420
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd088009a70 con 0x7fd09006e420
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd087400700  1 -- 172.21.15.171:0/595174284 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800119c0 con 0x7fd09006e420
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.351+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09008d740 con 0x7fd09006e420
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.352+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09008d450 con 0x7fd09006e420
2024-03-29T09:08:53.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.353+0000 7fd087400700  1 -- 172.21.15.171:0/595174284 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fd080011b20 con 0x7fd09006e420
2024-03-29T09:08:53.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.353+0000 7fd087400700  1 -- 172.21.15.171:0/595174284 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fd08005f670 con 0x7fd09006e420
2024-03-29T09:08:53.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.357+0000 7fd087400700  1 -- 172.21.15.171:0/595174284 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7fd08003d280 con 0x7fd09006e420
2024-03-29T09:08:53.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.526+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd09006d310 con 0x7fd0700475f0
2024-03-29T09:08:53.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.527+0000 7fd087400700  1 -- 172.21.15.171:0/595174284 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7fd07c001330 con 0x7fd0700475f0
2024-03-29T09:08:53.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.528+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 >> v1:172.21.15.171:6816/44806 conn(0x7fd0700475f0 legacy=0x7fd070049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.528+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd09006e420 msgr2=0x7fd0901bf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.528+0000 7fd096800700  1 --2- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd09006e420 0x7fd0901bf180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd080010fa0 tx=0x7fd08000e640 comp rx=0 tx=0).stop
2024-03-29T09:08:53.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.529+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 shutdown_connections
2024-03-29T09:08:53.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.529+0000 7fd096800700  1 --2- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd09012b500 0x7fd09008afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.529+0000 7fd096800700  1 --2- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fd09006e420 0x7fd0901bf180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.529+0000 7fd096800700  1 --2- 172.21.15.171:0/595174284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd09006ef70 0x7fd0901bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.529+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 >> 172.21.15.171:0/595174284 conn(0x7fd0900978d0 msgr2=0x7fd090125b40 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:53.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.529+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 shutdown_connections
2024-03-29T09:08:53.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.529+0000 7fd096800700  1 -- 172.21.15.171:0/595174284 wait complete.
2024-03-29T09:08:53.529 INFO:teuthology.orchestra.run.smithi171.stderr:instructed osd(s) 2 to deep-scrub
2024-03-29T09:08:53.546 INFO:tasks.ceph:Scrubbing osd.3
2024-03-29T09:08:53.546 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0
2024-03-29T09:08:53.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.744+0000 7fbdb2600700  1  Processor -- start
2024-03-29T09:08:53.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdb2600700  1 --  start start
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdb2600700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fbdac12e9d0 0x7fbdac12edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdb2600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac071540 0x7fbdac12ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdb2600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac12b370 0x7fbdac12b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdb2600700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0a1970 con 0x7fbdac12e9d0
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdb2600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0719f0 con 0x7fbdac12b370
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdb2600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac12e5a0 con 0x7fbdac071540
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdaaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac071540 0x7fbdac12ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.745+0000 7fbdab400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fbdac12e9d0 0x7fbdac12edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdabe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac12b370 0x7fbdac12b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac071540 0x7fbdac12ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35498/0 (socket says 172.21.15.171:35498)
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 -- 172.21.15.171:0/1154515786 learned_addr learned my addr 172.21.15.171:0/1154515786 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:53.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdabe00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac12b370 0x7fbdac12b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60456/0 (socket says 172.21.15.171:60456)
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdab400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7fbdac12e9d0 0x7fbdac12edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59380/0 (socket says 172.21.15.171:59380)
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 -- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac12b370 msgr2=0x7fbdac12b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 --2- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac12b370 0x7fbdac12b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 -- 172.21.15.171:0/1154515786 >> v2:172.21.15.171:3300/0 conn(0x7fbdac12e9d0 msgr2=0x7fbdac12edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 --2- 172.21.15.171:0/1154515786 >> v2:172.21.15.171:3300/0 conn(0x7fbdac12e9d0 0x7fbdac12edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 -- 172.21.15.171:0/1154515786 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac071d50 con 0x7fbdac071540
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdabe00700  1 --2- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac12b370 0x7fbdac12b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaaa00700  1 --2- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac071540 0x7fbdac12ae30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098f0 tx=0x7fbd98009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940f9bc4493af7b8 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.746+0000 7fbdaa000700  1 -- 172.21.15.171:0/1154515786 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011830 con 0x7fbdac071540
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdaa000700  1 -- 172.21.15.171:0/1154515786 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98011990 con 0x7fbdac071540
2024-03-29T09:08:53.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdaa000700  1 -- 172.21.15.171:0/1154515786 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011d20 con 0x7fbdac071540
2024-03-29T09:08:53.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 -- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac071540 msgr2=0x7fbdac12ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 --2- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac071540 0x7fbdac12ae30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098f0 tx=0x7fbd98009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:53.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 -- 172.21.15.171:0/1154515786 shutdown_connections
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 --2- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac12b370 0x7fbdac12b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 --2- 172.21.15.171:0/1154515786 >> v2:172.21.15.171:3300/0 conn(0x7fbdac12e9d0 0x7fbdac12edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 --2- 172.21.15.171:0/1154515786 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac071540 0x7fbdac12ae30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 -- 172.21.15.171:0/1154515786 >> 172.21.15.171:0/1154515786 conn(0x7fbdac09d530 msgr2=0x7fbdac09d940 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 -- 172.21.15.171:0/1154515786 shutdown_connections
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.747+0000 7fbdb2600700  1 -- 172.21.15.171:0/1154515786 wait complete.
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.749+0000 7fbdb2600700  1  Processor -- start
2024-03-29T09:08:53.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.749+0000 7fbdb2600700  1 --  start start
2024-03-29T09:08:53.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdb2600700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac071540 0x7fbdac12f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdb2600700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdac12b370 0x7fbdac12f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdb2600700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac12e9d0 0x7fbdac12fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdb2600700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1343c0 con 0x7fbdac12b370
2024-03-29T09:08:53.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdb2600700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac130fc0 con 0x7fbdac071540
2024-03-29T09:08:53.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdb2600700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac132050 con 0x7fbdac12e9d0
2024-03-29T09:08:53.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdab400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac071540 0x7fbdac12f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdaaa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdac12b370 0x7fbdac12f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdabe00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac12e9d0 0x7fbdac12fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdaaa00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdac12b370 0x7fbdac12f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59390/0 (socket says 172.21.15.171:59390)
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdaaa00700  1 -- 172.21.15.171:0/1464058627 learned_addr learned my addr 172.21.15.171:0/1464058627 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdabe00700  1 -- 172.21.15.171:0/1464058627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac071540 msgr2=0x7fbdac12f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdabe00700  1 --2- 172.21.15.171:0/1464058627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdac071540 0x7fbdac12f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdabe00700  1 -- 172.21.15.171:0/1464058627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdac12b370 msgr2=0x7fbdac12f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdabe00700  1 --2- 172.21.15.171:0/1464058627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdac12b370 0x7fbdac12f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.750+0000 7fbdabe00700  1 -- 172.21.15.171:0/1464058627 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4009a70 con 0x7fbdac12e9d0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.751+0000 7fbdabe00700  1 --2- 172.21.15.171:0/1464058627 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac12e9d0 0x7fbdac12fe00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbda400eed0 tx=0x7fbda400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.751+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4010040 con 0x7fbdac12e9d0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.751+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400ba80 con 0x7fbdac12e9d0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.751+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd98009550 con 0x7fbdac12e9d0
2024-03-29T09:08:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.751+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400be30 con 0x7fbdac12e9d0
2024-03-29T09:08:53.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.751+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac1316a0 con 0x7fbdac12e9d0
2024-03-29T09:08:53.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.752+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdac066f70 con 0x7fbdac12e9d0
2024-03-29T09:08:53.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.752+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== mon.2 v2:172.21.15.171:3302/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7fbda401d410 con 0x7fbdac12e9d0
2024-03-29T09:08:53.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.753+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== mon.2 v2:172.21.15.171:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7fbda405c8b0 con 0x7fbdac12e9d0
2024-03-29T09:08:53.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.753+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 --> v1:172.21.15.171:6812/46965 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd8c051a40 con 0x7fbd8c04dd70
2024-03-29T09:08:53.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.753+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== mon.2 v2:172.21.15.171:3302/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbda40612c0 con 0x7fbdac12e9d0
2024-03-29T09:08:53.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.754+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== osd.3 v1:172.21.15.171:6812/46965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (unknown 0 0 2513694155) 0x7fbd8c051a40 con 0x7fbd8c04dd70
2024-03-29T09:08:53.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.769+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 --> v1:172.21.15.171:6812/46965 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbdac06edb0 con 0x7fbd8c04dd70
2024-03-29T09:08:53.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.769+0000 7fbda3400700  1 -- 172.21.15.171:0/1464058627 <== osd.3 v1:172.21.15.171:6812/46965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7fbdac06edb0 con 0x7fbd8c04dd70
2024-03-29T09:08:53.769 INFO:teuthology.orchestra.run.smithi171.stdout:{
2024-03-29T09:08:53.769 INFO:teuthology.orchestra.run.smithi171.stdout:    "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) "
2024-03-29T09:08:53.769 INFO:teuthology.orchestra.run.smithi171.stdout:}
2024-03-29T09:08:53.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.769+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 >> v1:172.21.15.171:6812/46965 conn(0x7fbd8c04dd70 legacy=0x7fbd8c0501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.769+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 >> v1:172.21.15.171:6816/44806 conn(0x7fbd8c0475f0 legacy=0x7fbd8c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.769+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac12e9d0 msgr2=0x7fbdac12fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.769+0000 7fbdb2600700  1 --2- 172.21.15.171:0/1464058627 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7fbdac12e9d0 0x7fbdac12fe00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbda400eed0 tx=0x7fbda400b390 comp rx=0 tx=0).stop
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.770+0000 7fbdabe00700  1 -- 172.21.15.171:0/1464058627 reap_dead start
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.770+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 shutdown_connections
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.770+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 >> 172.21.15.171:0/1464058627 conn(0x7fbdac09d530 msgr2=0x7fbdac09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.770+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 shutdown_connections
2024-03-29T09:08:53.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.770+0000 7fbdb2600700  1 -- 172.21.15.171:0/1464058627 wait complete.
2024-03-29T09:08:53.786 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.981+0000 7f2e3a400700  1  Processor -- start
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.981+0000 7f2e3a400700  1 --  start start
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.981+0000 7f2e3a400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412b4d0 0x7f2e3412b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.981+0000 7f2e3a400700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f2e3412e480 0x7f2e3412e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.981+0000 7f2e3a400700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e34067250 con 0x7f2e3412ee40
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.981+0000 7f2e3a400700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3412f2b0 con 0x7f2e3412e480
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.981+0000 7f2e3a400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e340717c0 con 0x7f2e3412b4d0
2024-03-29T09:08:53.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412b4d0 0x7f2e3412b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e32a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f2e3412e480 0x7f2e3412e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412b4d0 0x7f2e3412b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35512/0 (socket says 172.21.15.171:35512)
2024-03-29T09:08:53.982 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 -- 172.21.15.171:0/1151490466 learned_addr learned my addr 172.21.15.171:0/1151490466 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:53.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 -- 172.21.15.171:0/1151490466 >> v2:172.21.15.171:3300/0 conn(0x7f2e3412e480 msgr2=0x7f2e3412e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:53.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 --2- 172.21.15.171:0/1151490466 >> v2:172.21.15.171:3300/0 conn(0x7f2e3412e480 0x7f2e3412e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 -- 172.21.15.171:0/1151490466 >> v1:172.21.15.171:6789/0 conn(0x7f2e3412ee40 legacy=0x7f2e341357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 -- 172.21.15.171:0/1151490466 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34071a70 con 0x7f2e3412b4d0
2024-03-29T09:08:53.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e33400700  1 --2- 172.21.15.171:0/1151490466 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412b4d0 0x7f2e3412b8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098f0 tx=0x7f2e24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e83bb251ada656c server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.982+0000 7f2e32000700  1 -- 172.21.15.171:0/1151490466 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011830 con 0x7f2e3412b4d0
2024-03-29T09:08:53.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e32000700  1 -- 172.21.15.171:0/1151490466 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24011990 con 0x7f2e3412b4d0
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e32000700  1 -- 172.21.15.171:0/1151490466 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011d20 con 0x7f2e3412b4d0
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 -- 172.21.15.171:0/1151490466 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412b4d0 msgr2=0x7f2e3412b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 --2- 172.21.15.171:0/1151490466 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412b4d0 0x7f2e3412b8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098f0 tx=0x7f2e24009c00 comp rx=0 tx=0).stop
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 -- 172.21.15.171:0/1151490466 shutdown_connections
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 --2- 172.21.15.171:0/1151490466 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412b4d0 0x7f2e3412b8b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 --2- 172.21.15.171:0/1151490466 >> v2:172.21.15.171:3300/0 conn(0x7f2e3412e480 0x7f2e3412e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 -- 172.21.15.171:0/1151490466 >> 172.21.15.171:0/1151490466 conn(0x7f2e3409d780 msgr2=0x7f2e3409db90 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 -- 172.21.15.171:0/1151490466 shutdown_connections
2024-03-29T09:08:53.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.983+0000 7f2e3a400700  1 -- 172.21.15.171:0/1151490466 wait complete.
2024-03-29T09:08:53.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.984+0000 7f2e3a400700  1  Processor -- start
2024-03-29T09:08:53.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e3a400700  1 --  start start
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e3a400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3412b4d0 0x7f2e341c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e3a400700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412e480 0x7f2e341c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e3a400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3412ee40 0x7f2e341c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e3a400700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34133980 con 0x7f2e3412ee40
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e3a400700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34133710 con 0x7f2e3412b4d0
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e3a400700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34134be0 con 0x7f2e3412e480
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e32a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412e480 0x7f2e341c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e33400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3412b4d0 0x7f2e341c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e33400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3412b4d0 0x7f2e341c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:60476/0 (socket says 172.21.15.171:60476)
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e32a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412e480 0x7f2e341c35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35516/0 (socket says 172.21.15.171:35516)
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e33400700  1 -- 172.21.15.171:0/2121637492 learned_addr learned my addr 172.21.15.171:0/2121637492 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.985+0000 7f2e33e00700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3412ee40 0x7f2e341c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e33400700  1 -- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412e480 msgr2=0x7f2e341c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e33400700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412e480 0x7f2e341c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e33400700  1 -- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3412ee40 msgr2=0x7f2e341c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e33400700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3412ee40 0x7f2e341c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e33400700  1 -- 172.21.15.171:0/2121637492 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009550 con 0x7f2e3412b4d0
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e32a00700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412e480 0x7f2e341c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e33400700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3412b4d0 0x7f2e341c3090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e34071900 tx=0x7f2e24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e2b400700  1 -- 172.21.15.171:0/2121637492 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24004510 con 0x7f2e3412b4d0
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e2b400700  1 -- 172.21.15.171:0/2121637492 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2401e070 con 0x7f2e3412b4d0
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e2b400700  1 -- 172.21.15.171:0/2121637492 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240038e0 con 0x7f2e3412b4d0
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.986+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e34134170 con 0x7f2e3412b4d0
2024-03-29T09:08:53.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.987+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e34134ea0 con 0x7f2e3412b4d0
2024-03-29T09:08:53.989 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.988+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e34136830 con 0x7f2e3412b4d0
2024-03-29T09:08:53.989 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.988+0000 7f2e2b400700  1 -- 172.21.15.171:0/2121637492 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f2e24003a40 con 0x7f2e3412b4d0
2024-03-29T09:08:53.989 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.989+0000 7f2e2b400700  1 -- 172.21.15.171:0/2121637492 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f2e24020070 con 0x7f2e3412b4d0
2024-03-29T09:08:53.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:53.993+0000 7f2e2b400700  1 -- 172.21.15.171:0/2121637492 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f2e24007c90 con 0x7f2e3412b4d0
2024-03-29T09:08:54.165 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.165+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e34136f10 con 0x7f2e140475f0
2024-03-29T09:08:54.165 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.165+0000 7f2e2b400700  1 -- 172.21.15.171:0/2121637492 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f2e20009c10 con 0x7f2e140475f0
2024-03-29T09:08:54.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.167+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 >> v1:172.21.15.171:6816/44806 conn(0x7f2e140475f0 legacy=0x7f2e14049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.167+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3412b4d0 msgr2=0x7f2e341c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.167+0000 7f2e3a400700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3412b4d0 0x7f2e341c3090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e34071900 tx=0x7f2e24004750 comp rx=0 tx=0).stop
2024-03-29T09:08:54.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.168+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 shutdown_connections
2024-03-29T09:08:54.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.168+0000 7f2e3a400700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3412ee40 0x7f2e341c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.168+0000 7f2e3a400700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3412b4d0 0x7f2e341c3090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.168+0000 7f2e3a400700  1 --2- 172.21.15.171:0/2121637492 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f2e3412e480 0x7f2e341c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.168+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 >> 172.21.15.171:0/2121637492 conn(0x7f2e3409d780 msgr2=0x7f2e34127da0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:54.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.168+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 shutdown_connections
2024-03-29T09:08:54.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.168+0000 7f2e3a400700  1 -- 172.21.15.171:0/2121637492 wait complete.
2024-03-29T09:08:54.168 INFO:teuthology.orchestra.run.smithi171.stderr:instructed osd(s) 3 to deep-scrub
2024-03-29T09:08:54.185 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:08:54.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.377+0000 7f06b7e00700  1  Processor -- start
2024-03-29T09:08:54.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.377+0000 7f06b7e00700  1 --  start start
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.377+0000 7f06b7e00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f06b01317d0 0x7f06b0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.377+0000 7f06b7e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b0134100 0x7f06b01364f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b7e00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b0067250 con 0x7f06b012b4d0
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b7e00700  1 --  --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b00717c0 con 0x7f06b01317d0
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b7e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0071a70 con 0x7f06b0134100
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b0134100 0x7f06b01364f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b4a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f06b01317d0 0x7f06b0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b0134100 0x7f06b01364f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35518/0 (socket says 172.21.15.171:35518)
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b4a00700  1 --2-  >> v2:172.21.15.171:3300/0 conn(0x7f06b01317d0 0x7f06b0133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59422/0 (socket says 172.21.15.171:59422)
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5e00700  1 -- 172.21.15.171:0/1474531556 learned_addr learned my addr 172.21.15.171:0/1474531556 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5400700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f06b012b4d0 0x7f06b012b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:41052/0 (socket says 172.21.15.171:41052)
2024-03-29T09:08:54.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5e00700  1 -- 172.21.15.171:0/1474531556 >> v2:172.21.15.171:3300/0 conn(0x7f06b01317d0 msgr2=0x7f06b0133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5e00700  1 --2- 172.21.15.171:0/1474531556 >> v2:172.21.15.171:3300/0 conn(0x7f06b01317d0 0x7f06b0133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5e00700  1 -- 172.21.15.171:0/1474531556 >> v1:172.21.15.171:6789/0 conn(0x7f06b012b4d0 legacy=0x7f06b012b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b5e00700  1 -- 172.21.15.171:0/1474531556 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b0071d30 con 0x7f06b0134100
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06afe00700  1 -- 172.21.15.171:0/1474531556 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577892042 0 0) 0x7f06b0067250 con 0x7f06b012b4d0
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.378+0000 7f06b4a00700  1 --2- 172.21.15.171:0/1474531556 >> v2:172.21.15.171:3300/0 conn(0x7f06b01317d0 0x7f06b0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b5e00700  1 --2- 172.21.15.171:0/1474531556 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b0134100 0x7f06b01364f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=263e4adeee526bfd server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06afe00700  1 -- 172.21.15.171:0/1474531556 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800e070 con 0x7f06b0134100
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06afe00700  1 -- 172.21.15.171:0/1474531556 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800b910 con 0x7f06b0134100
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06afe00700  1 -- 172.21.15.171:0/1474531556 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800bcc0 con 0x7f06b0134100
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b7e00700  1 -- 172.21.15.171:0/1474531556 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b0134100 msgr2=0x7f06b01364f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b7e00700  1 --2- 172.21.15.171:0/1474531556 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b0134100 0x7f06b01364f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).stop
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b7e00700  1 -- 172.21.15.171:0/1474531556 shutdown_connections
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b7e00700  1 --2- 172.21.15.171:0/1474531556 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b0134100 0x7f06b01364f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b7e00700  1 --2- 172.21.15.171:0/1474531556 >> v2:172.21.15.171:3300/0 conn(0x7f06b01317d0 0x7f06b0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b7e00700  1 -- 172.21.15.171:0/1474531556 >> 172.21.15.171:0/1474531556 conn(0x7f06b009d780 msgr2=0x7f06b009db90 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:54.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.379+0000 7f06b7e00700  1 -- 172.21.15.171:0/1474531556 shutdown_connections
2024-03-29T09:08:54.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.380+0000 7f06b7e00700  1 -- 172.21.15.171:0/1474531556 wait complete.
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1  Processor -- start
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1 --  start start
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06b012b4d0 0x7f06b01c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b01317d0 0x7f06b01c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06b0134100 0x7f06b01c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b006e850 con 0x7f06b0134100
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0128590 con 0x7f06b012b4d0
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.381+0000 7f06b7e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06b006e480 con 0x7f06b01317d0
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06b0134100 0x7f06b01c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06b012b4d0 0x7f06b01c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b4a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b01317d0 0x7f06b01c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:08:54.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06b0134100 0x7f06b01c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59430/0 (socket says 172.21.15.171:59430)
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b4a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b01317d0 0x7f06b01c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:35524/0 (socket says 172.21.15.171:35524)
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 -- 172.21.15.171:0/1889032212 learned_addr learned my addr 172.21.15.171:0/1889032212 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 -- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b01317d0 msgr2=0x7f06b01c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b01317d0 0x7f06b01c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 -- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06b012b4d0 msgr2=0x7f06b01c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06b012b4d0 0x7f06b01c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 -- 172.21.15.171:0/1889032212 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0094a0 con 0x7f06b0134100
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b4a00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b01317d0 0x7f06b01c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.382+0000 7f06b5e00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06b0134100 0x7f06b01c3930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06b0071bb0 tx=0x7f06a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.383+0000 7f06ad600700  1 -- 172.21.15.171:0/1889032212 <== mon.0 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8004670 con 0x7f06b0134100
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.383+0000 7f06ad600700  1 -- 172.21.15.171:0/1889032212 <== mon.0 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a80047f0 con 0x7f06b0134100
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.383+0000 7f06ad600700  1 -- 172.21.15.171:0/1889032212 <== mon.0 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a801c680 con 0x7f06b0134100
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.383+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a8009b30 con 0x7f06b0134100
2024-03-29T09:08:54.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.383+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b006d450 con 0x7f06b0134100
2024-03-29T09:08:54.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.384+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b00623e0 con 0x7f06b0134100
2024-03-29T09:08:54.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.384+0000 7f06ad600700  1 -- 172.21.15.171:0/1889032212 <== mon.0 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f06a801c7e0 con 0x7f06b0134100
2024-03-29T09:08:54.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.385+0000 7f06ad600700  1 -- 172.21.15.171:0/1889032212 <== mon.0 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f06a805df40 con 0x7f06b0134100
2024-03-29T09:08:54.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.388+0000 7f06ad600700  1 -- 172.21.15.171:0/1889032212 <== mon.0 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f06a803f470 con 0x7f06b0134100
2024-03-29T09:08:54.555 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.556+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06b006d870 con 0x7f06900475f0
2024-03-29T09:08:54.556 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.557+0000 7f06ad600700  1 -- 172.21.15.171:0/1889032212 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34623 (unknown 2965378022 0 1772220204) 0x7f06b006d870 con 0x7f06900475f0
2024-03-29T09:08:54.557 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.559+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 >> v1:172.21.15.171:6816/44806 conn(0x7f06900475f0 legacy=0x7f0690049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.559+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06b0134100 msgr2=0x7f06b01c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.559+0000 7f06b7e00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06b0134100 0x7f06b01c3930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06b0071bb0 tx=0x7f06a8004ad0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.559+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 shutdown_connections
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.560+0000 7f06b7e00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06b0134100 0x7f06b01c3930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.560+0000 7f06b7e00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06b012b4d0 0x7f06b01c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.560+0000 7f06b7e00700  1 --2- 172.21.15.171:0/1889032212 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f06b01317d0 0x7f06b01c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:08:54.559 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.560+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 >> 172.21.15.171:0/1889032212 conn(0x7f06b009d780 msgr2=0x7f06b01344e0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:08:54.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.560+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 shutdown_connections
2024-03-29T09:08:54.560 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:08:54.560+0000 7f06b7e00700  1 -- 172.21.15.171:0/1889032212 wait complete.
2024-03-29T09:08:54.560 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:08:54.576 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-29T09:08:54.081706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115108,"kb_used_data":2152,"kb_used_omap":4,"kb_used_meta":112891,"kb_avail":377372252,"statfs":{"total":386547056640,"available":386429186048,"internally_reserved":0,"allocated":2203648,"data_stored":1540340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4636,"internal_metadata":115600868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001619"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282241+0000","last_change":"2024-03-29T09:08:40.602229+0000","last_active":"2024-03-29T09:08:43.282241+0000","last_peered":"2024-03-29T09:08:43.282241+0000","last_clean":"2024-03-29T09:08:43.282241+0000","last_became_active":"2024-03-29T09:08:40.601985+0000","last_became_peered":"2024-03-29T09:08:40.601985+0000","last_unstale":"2024-03-29T09:08:43.282241+0000","last_undegraded":"2024-03-29T09:08:43.282241+0000","last_fullsized":"2024-03-29T09:08:43.282241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:02:05.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609604+0000","last_change":"2024-03-29T09:08:38.252447+0000","last_active":"2024-03-29T09:08:43.609604+0000","last_peered":"2024-03-29T09:08:43.609604+0000","last_clean":"2024-03-29T09:08:43.609604+0000","last_became_active":"2024-03-29T09:08:38.252122+0000","last_became_peered":"2024-03-29T09:08:38.252122+0000","last_unstale":"2024-03-29T09:08:43.609604+0000","last_undegraded":"2024-03-29T09:08:43.609604+0000","last_fullsized":"2024-03-29T09:08:43.609604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:20.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282186+0000","last_change":"2024-03-29T09:08:40.601753+0000","last_active":"2024-03-29T09:08:43.282186+0000","last_peered":"2024-03-29T09:08:43.282186+0000","last_clean":"2024-03-29T09:08:43.282186+0000","last_became_active":"2024-03-29T09:08:40.601418+0000","last_became_peered":"2024-03-29T09:08:40.601418+0000","last_unstale":"2024-03-29T09:08:43.282186+0000","last_undegraded":"2024-03-29T09:08:43.282186+0000","last_fullsized":"2024-03-29T09:08:43.282186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:11:37.158605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282070+0000","last_change":"2024-03-29T09:08:40.554498+0000","last_active":"2024-03-29T09:08:43.282070+0000","last_peered":"2024-03-29T09:08:43.282070+0000","last_clean":"2024-03-29T09:08:43.282070+0000","last_became_active":"2024-03-29T09:08:40.554228+0000","last_became_peered":"2024-03-29T09:08:40.554228+0000","last_unstale":"2024-03-29T09:08:43.282070+0000","last_undegraded":"2024-03-29T09:08:43.282070+0000","last_fullsized":"2024-03-29T09:08:43.282070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:33:35.566190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'98","reported_seq":158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609571+0000","last_change":"2024-03-29T09:08:38.258057+0000","last_active":"2024-03-29T09:08:43.609571+0000","last_peered":"2024-03-29T09:08:43.609571+0000","last_clean":"2024-03-29T09:08:43.609571+0000","last_became_active":"2024-03-29T09:08:38.252224+0000","last_became_peered":"2024-03-29T09:08:38.252224+0000","last_unstale":"2024-03-29T09:08:43.609571+0000","last_undegraded":"2024-03-29T09:08:43.609571+0000","last_fullsized":"2024-03-29T09:08:43.609571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T19:46:09.422195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282148+0000","last_change":"2024-03-29T09:08:40.253037+0000","last_active":"2024-03-29T09:08:43.282148+0000","last_peered":"2024-03-29T09:08:43.282148+0000","last_clean":"2024-03-29T09:08:43.282148+0000","last_became_active":"2024-03-29T09:08:40.252699+0000","last_became_peered":"2024-03-29T09:08:40.252699+0000","last_unstale":"2024-03-29T09:08:43.282148+0000","last_undegraded":"2024-03-29T09:08:43.282148+0000","last_fullsized":"2024-03-29T09:08:43.282148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:59:53.558716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.279082+0000","last_change":"2024-03-29T09:08:40.253174+0000","last_active":"2024-03-29T09:08:43.279082+0000","last_peered":"2024-03-29T09:08:43.279082+0000","last_clean":"2024-03-29T09:08:43.279082+0000","last_became_active":"2024-03-29T09:08:40.252878+0000","last_became_peered":"2024-03-29T09:08:40.252878+0000","last_unstale":"2024-03-29T09:08:43.279082+0000","last_undegraded":"2024-03-29T09:08:43.279082+0000","last_fullsized":"2024-03-29T09:08:43.279082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:52:36.947448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.282101+0000","last_change":"2024-03-29T09:08:40.550924+0000","last_active":"2024-03-29T09:08:43.282101+0000","last_peered":"2024-03-29T09:08:43.282101+0000","last_clean":"2024-03-29T09:08:43.282101+0000","last_became_active":"2024-03-29T09:08:40.550604+0000","last_became_peered":"2024-03-29T09:08:40.550604+0000","last_unstale":"2024-03-29T09:08:43.282101+0000","last_undegraded":"2024-03-29T09:08:43.282101+0000","last_fullsized":"2024-03-29T09:08:43.282101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:36:25.128918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T09:08:43.609633+0000","last_change":"2024-03-29T09:08:38.251213+0000","last_active":"2024-03-29T09:08:43.609633+0000","last_peered":"2024-03-29T09:08:43.609633+0000","last_clean":"2024-03-29T09:08:43.609633+0000","last_became_active":"2024-03-29T09:08:38.250953+0000","last_became_peered":"2024-03-29T09:08:38.250953+0000","last_unstale":"2024-03-29T09:08:43.609633+0000","last_undegraded":"2024-03-29T09:08:43.609633+0000","last_fullsized":"2024-03-29T09:08:43.609633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T08:54:28.530580+0000","last_clean_scrub_stamp":"2024-03-29T08:54:28.530580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:06:03.995157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149701,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":2,"up_from":25,"seq":107374182405,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":0,"up_from":23,"seq":98784247813,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":1,"up_from":24,"seq":103079215109,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31294,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":32045945},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.580 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-29T08:54:28.530580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=9, tm_min=8, tm_sec=50, tm_wday=4, tm_yday=89, tm_isdst=0)
2024-03-29T09:08:54.581 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed.
2024-03-29T09:09:14.582 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
2024-03-29T09:09:14.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.787+0000 7f48e8a00700  1  Processor -- start
2024-03-29T09:09:14.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.787+0000 7f48e8a00700  1 --  start start
2024-03-29T09:09:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e8a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e412ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e8a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e412f4c0 0x7f48e406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e8a00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e40726f0 con 0x7f48e406e090
2024-03-29T09:09:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e8a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e406b2b0 con 0x7f48e412f4c0
2024-03-29T09:09:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e8a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48e406fa00 con 0x7f48e412eba0
2024-03-29T09:09:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e1400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e412f4c0 0x7f48e406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e1e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e412ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e1400700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e412f4c0 0x7f48e406db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40878/0 (socket says 172.21.15.171:40878)
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e2800700  1 --1-  >> v1:172.21.15.171:6789/0 conn(0x7f48e406e090 0x7f48e406e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:46538/0 (socket says 172.21.15.171:46538)
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.788+0000 7f48e1400700  1 -- 172.21.15.171:0/2460390704 learned_addr learned my addr 172.21.15.171:0/2460390704 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e1400700  1 -- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 msgr2=0x7f48e412ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e1400700  1 --2- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e412ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e0a00700  1 -- 172.21.15.171:0/2460390704 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581137129 0 0) 0x7f48e40726f0 con 0x7f48e406e090
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e1400700  1 -- 172.21.15.171:0/2460390704 >> v1:172.21.15.171:6789/0 conn(0x7f48e406e090 legacy=0x7f48e406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e1400700  1 -- 172.21.15.171:0/2460390704 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e409b610 con 0x7f48e412f4c0
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e1e00700  1 --2- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e412ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e1400700  1 --2- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e412f4c0 0x7f48e406db50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009920 tx=0x7f48d0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b466043dd9abba28 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e0a00700  1 -- 172.21.15.171:0/2460390704 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011830 con 0x7f48e412f4c0
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e0a00700  1 -- 172.21.15.171:0/2460390704 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0011990 con 0x7f48e412f4c0
2024-03-29T09:09:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.789+0000 7f48e0a00700  1 -- 172.21.15.171:0/2460390704 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011d20 con 0x7f48e412f4c0
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 -- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e412f4c0 msgr2=0x7f48e406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 --2- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e412f4c0 0x7f48e406db50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009920 tx=0x7f48d0009c30 comp rx=0 tx=0).stop
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 -- 172.21.15.171:0/2460390704 shutdown_connections
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 --2- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e412ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 --2- 172.21.15.171:0/2460390704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e412f4c0 0x7f48e406db50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 -- 172.21.15.171:0/2460390704 >> 172.21.15.171:0/2460390704 conn(0x7f48e4099750 msgr2=0x7f48e4099b60 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 -- 172.21.15.171:0/2460390704 shutdown_connections
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.790+0000 7f48e8a00700  1 -- 172.21.15.171:0/2460390704 wait complete.
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.792+0000 7f48e8a00700  1  Processor -- start
2024-03-29T09:09:14.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.792+0000 7f48e8a00700  1 --  start start
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e8a00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e406e090 0x7f48e41bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e8a00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e41c0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e8a00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e412f4c0 0x7f48e41c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e8a00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e4093a70 con 0x7f48e412f4c0
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e8a00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e4093d80 con 0x7f48e406e090
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e8a00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48e4092920 con 0x7f48e412eba0
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e406e090 0x7f48e41bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e406e090 0x7f48e41bfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40882/0 (socket says 172.21.15.171:40882)
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 -- 172.21.15.171:0/2764895499 learned_addr learned my addr 172.21.15.171:0/2764895499 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1400700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e41c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:14.794 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e2800700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e412f4c0 0x7f48e41c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 -- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 msgr2=0x7f48e41c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e41c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 -- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e412f4c0 msgr2=0x7f48e41c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e412f4c0 0x7f48e41c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.793+0000 7f48e1e00700  1 -- 172.21.15.171:0/2764895499 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40094a0 con 0x7f48e406e090
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.794+0000 7f48e1e00700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e406e090 0x7f48e41bfbf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48d400ebe0 tx=0x7f48d400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.794+0000 7f48da000700  1 -- 172.21.15.171:0/2764895499 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400c850 con 0x7f48e406e090
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.794+0000 7f48da000700  1 -- 172.21.15.171:0/2764895499 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d400c9b0 con 0x7f48e406e090
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.794+0000 7f48da000700  1 -- 172.21.15.171:0/2764895499 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400cd40 con 0x7f48e406e090
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.794+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d0009550 con 0x7f48e406e090
2024-03-29T09:09:14.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.794+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e4093340 con 0x7f48e406e090
2024-03-29T09:09:14.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.795+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e40934d0 con 0x7f48e406e090
2024-03-29T09:09:14.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.795+0000 7f48da000700  1 -- 172.21.15.171:0/2764895499 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f48d4013470 con 0x7f48e406e090
2024-03-29T09:09:14.796 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.796+0000 7f48da000700  1 -- 172.21.15.171:0/2764895499 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f48d405cc70 con 0x7f48e406e090
2024-03-29T09:09:14.799 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.800+0000 7f48da000700  1 -- 172.21.15.171:0/2764895499 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f48d403a8c0 con 0x7f48e406e090
2024-03-29T09:09:14.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.964+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 --> v1:172.21.15.171:6816/44806 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48e4136c20 con 0x7f48c40475f0
2024-03-29T09:09:14.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.965+0000 7f48da000700  1 -- 172.21.15.171:0/2764895499 <== mgr.14098 v1:172.21.15.171:6816/44806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34777 (unknown 2965378022 0 684712586) 0x7f48d0006c60 con 0x7f48c40475f0
2024-03-29T09:09:14.965 INFO:teuthology.orchestra.run.smithi171.stdout:
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 >> v1:172.21.15.171:6816/44806 conn(0x7f48c40475f0 legacy=0x7f48c4049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e406e090 msgr2=0x7f48e41bfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e406e090 0x7f48e41bfbf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48d400ebe0 tx=0x7f48d400eef0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 shutdown_connections
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e412f4c0 0x7f48e41c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e406e090 0x7f48e41bfbf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 --2- 172.21.15.171:0/2764895499 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f48e412eba0 0x7f48e41c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.967+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 >> 172.21.15.171:0/2764895499 conn(0x7f48e4099750 msgr2=0x7f48e4070700 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:09:14.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.968+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 shutdown_connections
2024-03-29T09:09:14.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:14.968+0000 7f48e8a00700  1 -- 172.21.15.171:0/2764895499 wait complete.
2024-03-29T09:09:14.968 INFO:teuthology.orchestra.run.smithi171.stderr:dumped all
2024-03-29T09:09:14.986 INFO:teuthology.orchestra.run.smithi171.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-29T09:09:14.086106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115080,"kb_used_data":2152,"kb_used_omap":4,"kb_used_meta":112891,"kb_avail":377372280,"statfs":{"total":386547056640,"available":386429214720,"internally_reserved":0,"allocated":2203648,"data_stored":1540340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4636,"internal_metadata":115600868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002714"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:09:07.461046+0000","last_change":"2024-03-29T09:09:07.461163+0000","last_active":"2024-03-29T09:09:07.461046+0000","last_peered":"2024-03-29T09:09:07.461046+0000","last_clean":"2024-03-29T09:09:07.461046+0000","last_became_active":"2024-03-29T09:08:40.601985+0000","last_became_peered":"2024-03-29T09:08:40.601985+0000","last_unstale":"2024-03-29T09:09:07.461046+0000","last_undegraded":"2024-03-29T09:09:07.461046+0000","last_fullsized":"2024-03-29T09:09:07.461046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:09:07.461021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:09:07.461021+0000","last_clean_scrub_stamp":"2024-03-29T09:09:07.461021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:09:42.042889+0000","scrub_duration":0.0019930130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:08:55.535244+0000","last_change":"2024-03-29T09:08:55.535416+0000","last_active":"2024-03-29T09:08:55.535244+0000","last_peered":"2024-03-29T09:08:55.535244+0000","last_clean":"2024-03-29T09:08:55.535244+0000","last_became_active":"2024-03-29T09:08:38.252122+0000","last_became_peered":"2024-03-29T09:08:38.252122+0000","last_unstale":"2024-03-29T09:08:55.535244+0000","last_undegraded":"2024-03-29T09:08:55.535244+0000","last_fullsized":"2024-03-29T09:08:55.535244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:08:55.535218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:08:55.535218+0000","last_clean_scrub_stamp":"2024-03-29T09:08:55.535218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:28:41.713447+0000","scrub_duration":0.001832013,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:09:03.467621+0000","last_change":"2024-03-29T09:09:03.467764+0000","last_active":"2024-03-29T09:09:03.467621+0000","last_peered":"2024-03-29T09:09:03.467621+0000","last_clean":"2024-03-29T09:09:03.467621+0000","last_became_active":"2024-03-29T09:08:40.601418+0000","last_became_peered":"2024-03-29T09:08:40.601418+0000","last_unstale":"2024-03-29T09:09:03.467621+0000","last_undegraded":"2024-03-29T09:09:03.467621+0000","last_fullsized":"2024-03-29T09:09:03.467621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:09:03.467598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:09:03.467598+0000","last_clean_scrub_stamp":"2024-03-29T09:09:03.467598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:14:05.166337+0000","scrub_duration":0.0017719260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:08:56.504257+0000","last_change":"2024-03-29T09:08:56.504404+0000","last_active":"2024-03-29T09:08:56.504257+0000","last_peered":"2024-03-29T09:08:56.504257+0000","last_clean":"2024-03-29T09:08:56.504257+0000","last_became_active":"2024-03-29T09:08:40.554228+0000","last_became_peered":"2024-03-29T09:08:40.554228+0000","last_unstale":"2024-03-29T09:08:56.504257+0000","last_undegraded":"2024-03-29T09:08:56.504257+0000","last_fullsized":"2024-03-29T09:08:56.504257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:08:56.504232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:08:56.504232+0000","last_clean_scrub_stamp":"2024-03-29T09:08:56.504232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T20:17:26.982243+0000","scrub_duration":0.001874536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'98","reported_seq":170,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:08:54.584270+0000","last_change":"2024-03-29T09:08:54.584365+0000","last_active":"2024-03-29T09:08:54.584270+0000","last_peered":"2024-03-29T09:08:54.584270+0000","last_clean":"2024-03-29T09:08:54.584270+0000","last_became_active":"2024-03-29T09:08:38.252224+0000","last_became_peered":"2024-03-29T09:08:38.252224+0000","last_unstale":"2024-03-29T09:08:54.584270+0000","last_undegraded":"2024-03-29T09:08:54.584270+0000","last_fullsized":"2024-03-29T09:08:54.584270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'98","last_scrub_stamp":"2024-03-29T09:08:54.584249+0000","last_deep_scrub":"26'98","last_deep_scrub_stamp":"2024-03-29T09:08:54.584249+0000","last_clean_scrub_stamp":"2024-03-29T09:08:54.584249+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:37:44.014318+0000","scrub_duration":0.003682233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:08:54.453631+0000","last_change":"2024-03-29T09:08:54.453725+0000","last_active":"2024-03-29T09:08:54.453631+0000","last_peered":"2024-03-29T09:08:54.453631+0000","last_clean":"2024-03-29T09:08:54.453631+0000","last_became_active":"2024-03-29T09:08:40.252699+0000","last_became_peered":"2024-03-29T09:08:40.252699+0000","last_unstale":"2024-03-29T09:08:54.453631+0000","last_undegraded":"2024-03-29T09:08:54.453631+0000","last_fullsized":"2024-03-29T09:08:54.453631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:08:54.453610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:08:54.453610+0000","last_clean_scrub_stamp":"2024-03-29T09:08:54.453610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T19:40:24.061732+0000","scrub_duration":0.0014768470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:08:58.696410+0000","last_change":"2024-03-29T09:08:58.696531+0000","last_active":"2024-03-29T09:08:58.696410+0000","last_peered":"2024-03-29T09:08:58.696410+0000","last_clean":"2024-03-29T09:08:58.696410+0000","last_became_active":"2024-03-29T09:08:40.252878+0000","last_became_peered":"2024-03-29T09:08:40.252878+0000","last_unstale":"2024-03-29T09:08:58.696410+0000","last_undegraded":"2024-03-29T09:08:58.696410+0000","last_fullsized":"2024-03-29T09:08:58.696410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:08:58.696388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:08:58.696388+0000","last_clean_scrub_stamp":"2024-03-29T09:08:58.696388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T17:20:25.792748+0000","scrub_duration":0.0019630479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:08:58.515304+0000","last_change":"2024-03-29T09:08:58.515431+0000","last_active":"2024-03-29T09:08:58.515304+0000","last_peered":"2024-03-29T09:08:58.515304+0000","last_clean":"2024-03-29T09:08:58.515304+0000","last_became_active":"2024-03-29T09:08:40.550604+0000","last_became_peered":"2024-03-29T09:08:40.550604+0000","last_unstale":"2024-03-29T09:08:58.515304+0000","last_undegraded":"2024-03-29T09:08:58.515304+0000","last_fullsized":"2024-03-29T09:08:58.515304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:08:58.515281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:08:58.515281+0000","last_clean_scrub_stamp":"2024-03-29T09:08:58.515281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:07:10.392948+0000","scrub_duration":0.0020333930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-29T09:08:56.556914+0000","last_change":"2024-03-29T09:08:56.557033+0000","last_active":"2024-03-29T09:08:56.556914+0000","last_peered":"2024-03-29T09:08:56.556914+0000","last_clean":"2024-03-29T09:08:56.556914+0000","last_became_active":"2024-03-29T09:08:38.250953+0000","last_became_peered":"2024-03-29T09:08:38.250953+0000","last_unstale":"2024-03-29T09:08:56.556914+0000","last_undegraded":"2024-03-29T09:08:56.556914+0000","last_fullsized":"2024-03-29T09:08:56.556914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T09:08:56.556888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T09:08:56.556888+0000","last_clean_scrub_stamp":"2024-03-29T09:08:56.556888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:32:38.428254+0000","scrub_duration":0.0016646300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":92,"num_write":138,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":26,"seq":111669149705,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":2,"up_from":25,"seq":107374182409,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":253952,"data_stored":89901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":0,"up_from":23,"seq":98784247817,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27198,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":27851641},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":1,"up_from":24,"seq":103079215113,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31294,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":847872,"data_stored":680269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159,"internal_metadata":32045945},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan  1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}}
2024-03-29T09:09:14.987 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph config set global mon_health_to_clog false
2024-03-29T09:09:15.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.175+0000 7f8462e00700  1  Processor -- start
2024-03-29T09:09:15.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.175+0000 7f8462e00700  1 --  start start
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.175+0000 7f8462e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12e290 0x7f845c12e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.175+0000 7f8462e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.175+0000 7f8462e00700  1 --  --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0673a0 con 0x7f845c12ebb0
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f8462e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c06f860 con 0x7f845c12b4a0
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f8462e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f845c06f490 con 0x7f845c12e290
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845be00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12e290 0x7f845c12e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f8460e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:15.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845be00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12e290 0x7f845c12e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3302/0 says I am v2:172.21.15.171:54382/0 (socket says 172.21.15.171:54382)
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845be00700  1 -- 172.21.15.171:0/1681611508 learned_addr learned my addr 172.21.15.171:0/1681611508 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845be00700  1 -- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 msgr2=0x7f845c1365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845be00700  1 --2- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845be00700  1 -- 172.21.15.171:0/1681611508 >> v1:172.21.15.171:6789/0 conn(0x7f845c12ebb0 legacy=0x7f845c12ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845be00700  1 -- 172.21.15.171:0/1681611508 --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c12f010 con 0x7f845c12e290
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f845aa00700  1 -- 172.21.15.171:0/1681611508 <== mon.0 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908312268 0 0) 0x7f845c0673a0 con 0x7f845c12ebb0
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.176+0000 7f8460e00700  1 --2- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f845be00700  1 --2- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12e290 0x7f845c12e670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f844c009920 tx=0x7f844c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03e6bd7433ce2b5 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f845aa00700  1 -- 172.21.15.171:0/1681611508 <== mon.2 v2:172.21.15.171:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c011830 con 0x7f845c12e290
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f845aa00700  1 -- 172.21.15.171:0/1681611508 <== mon.2 v2:172.21.15.171:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c011990 con 0x7f845c12e290
2024-03-29T09:09:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f845aa00700  1 -- 172.21.15.171:0/1681611508 <== mon.2 v2:172.21.15.171:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c011d20 con 0x7f845c12e290
2024-03-29T09:09:15.178 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f8462e00700  1 -- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12e290 msgr2=0x7f845c12e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:15.178 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f8462e00700  1 --2- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12e290 0x7f845c12e670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f844c009920 tx=0x7f844c009c30 comp rx=0 tx=0).stop
2024-03-29T09:09:15.178 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f8462e00700  1 -- 172.21.15.171:0/1681611508 shutdown_connections
2024-03-29T09:09:15.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f8462e00700  1 --2- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12e290 0x7f845c12e670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f8462e00700  1 --2- 172.21.15.171:0/1681611508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f8462e00700  1 -- 172.21.15.171:0/1681611508 >> 172.21.15.171:0/1681611508 conn(0x7f845c09d6a0 msgr2=0x7f845c09dab0 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:09:15.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.177+0000 7f8462e00700  1 -- 172.21.15.171:0/1681611508 shutdown_connections
2024-03-29T09:09:15.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.178+0000 7f8462e00700  1 -- 172.21.15.171:0/1681611508 wait complete.
2024-03-29T09:09:15.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.179+0000 7f8462e00700  1  Processor -- start
2024-03-29T09:09:15.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.179+0000 7f8462e00700  1 --  start start
2024-03-29T09:09:15.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.179+0000 7f8462e00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:15.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.179+0000 7f8462e00700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f845c12e290 0x7f845c1c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.179+0000 7f8462e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12ebb0 0x7f845c1c0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f8462e00700  1 --  --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1329b0 con 0x7f845c12e290
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f8462e00700  1 --  --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1318d0 con 0x7f845c12b4a0
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f8462e00700  1 --  --> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f845c132110 con 0x7f845c12ebb0
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f8460e00700  1 --2-  >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12ebb0 0x7f845c1c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845b400700  1 --2-  >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f845c12e290 0x7f845c1c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 --2-  >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1bfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40896/0 (socket says 172.21.15.171:40896)
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 -- 172.21.15.171:0/2555504529 learned_addr learned my addr 172.21.15.171:0/2555504529 (peer_addr_for_me v2:172.21.15.171:0/0)
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 -- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12ebb0 msgr2=0x7f845c1c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12ebb0 0x7f845c1c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 -- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f845c12e290 msgr2=0x7f845c1c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f845c12e290 0x7f845c1c0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 -- 172.21.15.171:0/2555504529 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009a70 con 0x7f845c12b4a0
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845b400700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f845c12e290 0x7f845c1c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f8460e00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12ebb0 0x7f845c1c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed!
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.180+0000 7f845be00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1bfbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f844c000c00 tx=0x7f844c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.181+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c004450 con 0x7f845c12b4a0
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.181+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0045b0 con 0x7f845c12b4a0
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.181+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c009550 con 0x7f845c12b4a0
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.181+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0038a0 con 0x7f845c12b4a0
2024-03-29T09:09:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.181+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c1c32b0 con 0x7f845c12b4a0
2024-03-29T09:09:15.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.182+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 9) v1 ==== 55204+0+0 (secure 0 0 0) 0x7f844c021070 con 0x7f845c12b4a0
2024-03-29T09:09:15.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.182+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c06d5d0 con 0x7f845c12b4a0
2024-03-29T09:09:15.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.183+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 2961+0+0 (secure 0 0 0) 0x7f844c05db40 con 0x7f845c12b4a0
2024-03-29T09:09:15.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.186+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0  v0) v1 ==== 72+0+145302 (secure 0 0 0) 0x7f844c05cc30 con 0x7f845c12b4a0
2024-03-29T09:09:15.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.354+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f845c06bc80 con 0x7f845c12b4a0
2024-03-29T09:09:15.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.358+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f844c05cc30 con 0x7f845c12b4a0
2024-03-29T09:09:15.358 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.359+0000 7f8453e00700  1 -- 172.21.15.171:0/2555504529 <== mon.1 v2:172.21.15.171:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0  v6)=0  v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f844c016c30 con 0x7f845c12b4a0
2024-03-29T09:09:15.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 >> v1:172.21.15.171:6816/44806 conn(0x7f843c0475f0 legacy=0x7f843c049ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:15.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 msgr2=0x7f845c1bfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2024-03-29T09:09:15.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1bfbd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f844c000c00 tx=0x7f844c004750 comp rx=0 tx=0).stop
2024-03-29T09:09:15.361 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 shutdown_connections
2024-03-29T09:09:15.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3302/0,v1:172.21.15.171:6791/0] conn(0x7f845c12ebb0 0x7f845c1c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f845c12b4a0 0x7f845c1bfbd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 --2- 172.21.15.171:0/2555504529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f845c12e290 0x7f845c1c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop
2024-03-29T09:09:15.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 >> 172.21.15.171:0/2555504529 conn(0x7f845c09d6a0 msgr2=0x7f845c070420 unknown :-1 s=STATE_NONE l=0).mark_down
2024-03-29T09:09:15.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 shutdown_connections
2024-03-29T09:09:15.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-29T09:09:15.362+0000 7f8462e00700  1 -- 172.21.15.171:0/2555504529 wait complete.
2024-03-29T09:09:15.380 INFO:teuthology.misc:Shutting down mds daemons...
2024-03-29T09:09:15.380 INFO:teuthology.misc:Shutting down osd daemons...
2024-03-29T09:09:15.380 DEBUG:tasks.ceph.osd.0:waiting for process to exit
2024-03-29T09:09:15.380 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.424 INFO:tasks.ceph.osd.0:Stopped
2024-03-29T09:09:15.424 DEBUG:tasks.ceph.osd.1:waiting for process to exit
2024-03-29T09:09:15.424 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.473 INFO:tasks.ceph.osd.1:Stopped
2024-03-29T09:09:15.473 DEBUG:tasks.ceph.osd.2:waiting for process to exit
2024-03-29T09:09:15.473 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.515 INFO:tasks.ceph.osd.2:Stopped
2024-03-29T09:09:15.516 DEBUG:tasks.ceph.osd.3:waiting for process to exit
2024-03-29T09:09:15.516 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.553 INFO:tasks.ceph.osd.3:Stopped
2024-03-29T09:09:15.553 INFO:teuthology.misc:Shutting down mgr daemons...
2024-03-29T09:09:15.553 DEBUG:tasks.ceph.mgr.x:waiting for process to exit
2024-03-29T09:09:15.553 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.646 INFO:tasks.ceph.mgr.x:Stopped
2024-03-29T09:09:15.646 DEBUG:tasks.ceph.mgr.y:waiting for process to exit
2024-03-29T09:09:15.646 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.695 INFO:tasks.ceph.mgr.y:Stopped
2024-03-29T09:09:15.695 INFO:teuthology.misc:Shutting down mon daemons...
2024-03-29T09:09:15.695 DEBUG:tasks.ceph.mon.a:waiting for process to exit
2024-03-29T09:09:15.695 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.712 INFO:tasks.ceph.mon.a:Stopped
2024-03-29T09:09:15.712 DEBUG:tasks.ceph.mon.b:waiting for process to exit
2024-03-29T09:09:15.712 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.770 INFO:tasks.ceph.mon.b:Stopped
2024-03-29T09:09:15.771 DEBUG:tasks.ceph.mon.c:waiting for process to exit
2024-03-29T09:09:15.771 INFO:teuthology.orchestra.run:waiting for 300
2024-03-29T09:09:15.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s
2024-03-29T09:09:15.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s
2024-03-29T09:09:15.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s
2024-03-29T09:09:15.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s
2024-03-29T09:09:15.829 INFO:tasks.ceph.mon.c:Stopped
2024-03-29T09:09:15.829 INFO:tasks.ceph:Checking cluster log for badness...
2024-03-29T09:09:15.830 DEBUG:teuthology.orchestra.run.smithi171:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1
2024-03-29T09:09:15.967 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T09:09:15.967 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0
2024-03-29T09:09:16.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T09:09:16.267 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1
2024-03-29T09:09:16.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T09:09:16.405 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2
2024-03-29T09:09:16.513 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T09:09:16.513 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3
2024-03-29T09:09:16.640 INFO:tasks.ceph:Archiving mon data...
2024-03-29T09:09:16.642 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161/data/mon.a.tgz
2024-03-29T09:09:16.642 DEBUG:teuthology.orchestra.run.smithi171:> mktemp
2024-03-29T09:09:16.686 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.ZF0HzKOOKN
2024-03-29T09:09:16.686 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZF0HzKOOKN
2024-03-29T09:09:16.989 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.ZF0HzKOOKN
2024-03-29T09:09:17.102 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.ZF0HzKOOKN is 525KB
2024-03-29T09:09:17.202 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.ZF0HzKOOKN
2024-03-29T09:09:17.246 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161/data/mon.b.tgz
2024-03-29T09:09:17.246 DEBUG:teuthology.orchestra.run.smithi171:> mktemp
2024-03-29T09:09:17.330 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.x4uwmggiBC
2024-03-29T09:09:17.330 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.x4uwmggiBC
2024-03-29T09:09:17.603 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.x4uwmggiBC
2024-03-29T09:09:17.716 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.x4uwmggiBC is 564KB
2024-03-29T09:09:17.816 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.x4uwmggiBC
2024-03-29T09:09:17.862 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161/data/mon.c.tgz
2024-03-29T09:09:17.862 DEBUG:teuthology.orchestra.run.smithi171:> mktemp
2024-03-29T09:09:17.946 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.iV4QgfduBY
2024-03-29T09:09:17.946 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iV4QgfduBY
2024-03-29T09:09:18.224 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.iV4QgfduBY
2024-03-29T09:09:18.338 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.iV4QgfduBY is 564KB
2024-03-29T09:09:18.438 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.iV4QgfduBY
2024-03-29T09:09:18.482 INFO:tasks.ceph:Cleaning ceph cluster...
2024-03-29T09:09:18.482 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid
2024-03-29T09:09:18.588 INFO:tasks.ceph:Checking for errors in any valgrind logs...
2024-03-29T09:09:18.589 DEBUG:teuthology.orchestra.run.smithi171:> sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq
2024-03-29T09:09:18.672 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory
2024-03-29T09:09:18.688 INFO:tasks.ceph:Archiving crash dumps...
2024-03-29T09:09:18.690 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161/remote/smithi171/crash
2024-03-29T09:09:18.691 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2024-03-29T09:09:18.755 INFO:tasks.ceph:Compressing logs...
2024-03-29T09:09:18.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --
2024-03-29T09:09:20.224 INFO:tasks.ceph:Archiving logs...
2024-03-29T09:09:20.224 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161/remote/smithi171/log
2024-03-29T09:09:20.225 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- .
2024-03-29T09:09:20.559 DEBUG:teuthology.run_tasks:Unwinding manager install
2024-03-29T09:09:20.572 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer...
2024-03-29T09:09:20.573 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer
2024-03-29T09:09:20.677 DEBUG:teuthology.run_tasks:Unwinding manager clock
2024-03-29T09:09:20.688 INFO:teuthology.task.clock:Checking final clock skew...
2024-03-29T09:09:20.689 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2024-03-29T09:09:20.731 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found
2024-03-29T09:09:20.738 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
2024-03-29T09:09:20.739 INFO:teuthology.orchestra.run.smithi171.stdout:===============================================================================
2024-03-29T09:09:20.739 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv01.front.sepia.ceph.com     2   6   377    50   +431us[ +431us] +/-   71ms
2024-03-29T09:09:20.739 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv02.front.sepia.ceph.com     3   6   377    54   -533us[ -532us] +/-   52ms
2024-03-29T09:09:20.739 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com     3   6   377    50   +245us[ +245us] +/-   67ms
2024-03-29T09:09:20.739 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com     0   8     0     -     +0ns[   +0ns] +/-    0ns
2024-03-29T09:09:20.740 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab
2024-03-29T09:09:20.753 INFO:teuthology.task.ansible:Skipping ansible cleanup...
2024-03-29T09:09:20.753 DEBUG:teuthology.run_tasks:Unwinding manager selinux
2024-03-29T09:09:20.766 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log
2024-03-29T09:09:20.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored
2024-03-29T09:09:20.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored
2024-03-29T09:09:20.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored
2024-03-29T09:09:20.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored
2024-03-29T09:09:20.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0
2024-03-29T09:09:20.975 INFO:teuthology.orchestra.run.smithi171.stdout:type=AVC msg=audit(1711701836.320:210): avc:  denied  { checkpoint_restore } for  pid=1636 comm="agetty" capability=40  scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1
2024-03-29T09:09:20.976 DEBUG:teuthology.task.selinux:ubuntu@smithi171.front.sepia.ceph.com has 1 denials
2024-03-29T09:09:20.976 ERROR:teuthology.run_tasks:Manager failed: selinux
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks
    suppress = manager.__exit__(*exc_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__
    self.teardown()
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown
    self.get_new_denials()
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials
    raise SELinuxError(node=remote,
teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi171.front.sepia.ceph.com: ['type=AVC msg=audit(1711701836.320:210): avc:  denied  { checkpoint_restore } for  pid=1636 comm="agetty" capability=40  scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1']
2024-03-29T09:09:20.977 DEBUG:teuthology.run_tasks:Unwinding manager pcp
2024-03-29T09:09:20.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer
2024-03-29T09:09:21.000 INFO:teuthology.task.internal:Duration was 1526.021181 seconds
2024-03-29T09:09:21.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog
2024-03-29T09:09:21.012 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring...
2024-03-29T09:09:21.012 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart
2024-03-29T09:09:21.124 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service
2024-03-29T09:09:21.410 INFO:teuthology.task.internal.syslog:Checking logs for errors...
2024-03-29T09:09:21.410 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com
2024-03-29T09:09:21.410 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1
2024-03-29T09:09:21.468 INFO:teuthology.task.internal.syslog:Compressing syslogs...
2024-03-29T09:09:21.469 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --
2024-03-29T09:09:21.556 INFO:teuthology.task.internal.syslog:Gathering journactl -b0...
2024-03-29T09:09:21.557 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz
2024-03-29T09:09:21.675 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo
2024-03-29T09:09:21.688 INFO:teuthology.task.internal:Restoring /etc/sudoers...
2024-03-29T09:09:21.688 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers
2024-03-29T09:09:21.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump
2024-03-29T09:09:21.777 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump
2024-03-29T09:09:21.843 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core
2024-03-29T09:09:21.877 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump
2024-03-29T09:09:21.919 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-03-29T09:09:21.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
2024-03-29T09:09:21.933 INFO:teuthology.task.internal:Transferring archived files...
2024-03-29T09:09:21.934 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161/remote/smithi171
2024-03-29T09:09:21.934 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2024-03-29T09:09:22.038 INFO:teuthology.task.internal:Removing archive directory...
2024-03-29T09:09:22.038 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive
2024-03-29T09:09:22.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload
2024-03-29T09:09:22.095 INFO:teuthology.task.internal:Not uploading archives.
2024-03-29T09:09:22.095 DEBUG:teuthology.run_tasks:Unwinding manager internal.base
2024-03-29T09:09:22.107 INFO:teuthology.task.internal:Tidying up after the test...
2024-03-29T09:09:22.108 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest
2024-03-29T09:09:22.167 INFO:teuthology.orchestra.run.smithi171.stdout:   524297      4 drwxr-xr-x   2  ubuntu   ubuntu       4096 Mar 29 09:09 /home/ubuntu/cephtest
2024-03-29T09:09:22.171 DEBUG:teuthology.run_tasks:Unwinding manager kernel
2024-03-29T09:09:22.184 DEBUG:teuthology.run_tasks:Unwinding manager console_log
2024-03-29T09:09:22.197 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi171.front.sepia.ceph.com: ['type=AVC msg=audit(1711701836.320:210): avc:  denied  { checkpoint_restore } for  pid=1636 comm="agetty" capability=40  scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1']
2024-03-29T09:09:22.197 INFO:teuthology.nuke:Checking targets against current locks
2024-03-29T09:09:22.222 DEBUG:teuthology.nuke:shortname: smithi171
2024-03-29T09:09:22.222 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-03-29T09:09:22.242 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-28_11:21:59-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7628161', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 08:34:23.910850', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhVHZfeYp5C9I6Dx1p4wqUvcyFVGjokI+WviqpJ+4RjSvLf8DskHjuKy8w87ofcjt8Jm2LCE+GTLz/ZRCRhQ6g='}
2024-03-29T09:09:22.294 INFO:teuthology.orchestra.console.smithi171:Power off
2024-03-29T09:09:22.294 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-29T09:09:22.318 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off
2024-03-29T09:09:22.318 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-29T09:09:22.341 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-03-29T09:09:26.343 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-29T09:09:26.452 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-03-29T09:09:30.454 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-29T09:09:30.563 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-03-29T09:09:30.664 INFO:teuthology.orchestra.console.smithi171:Power off completed
2024-03-29T09:09:30.772 INFO:teuthology.run:Summary data:
description: fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd}
  no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn}
  tasks/{0-pacific 1-upgrade}}
duration: 1526.0211811065674
failure_reason: 'SELinux denials found on ubuntu@smithi171.front.sepia.ceph.com: [''type=AVC
  msg=audit(1711701836.320:210): avc:  denied  { checkpoint_restore } for  pid=1636
  comm="agetty" capability=40  scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023
  tclass=capability2 permissive=1'']'
flavor: default
mon.a-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2
owner: scheduled_vshankar@teuthology
status: fail
success: false

2024-03-29T09:09:30.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-29T09:09:30.856 INFO:teuthology.run:FAIL